Jul 15 19:36:19.199023 ip-10-0-128-48 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 19:36:19.199059 ip-10-0-128-48 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 19:36:19.199068 ip-10-0-128-48 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 19:36:19.199339 ip-10-0-128-48 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 19:36:29.234113 ip-10-0-128-48 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 19:36:29.234130 ip-10-0-128-48 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bdebd85a4b9f426baa3800d3a5efe7f1 --
Jul 15 19:38:18.818444 ip-10-0-128-48 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 19:38:19.118611 ip-10-0-128-48 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:38:19.118611 ip-10-0-128-48 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 19:38:19.118611 ip-10-0-128-48 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:38:19.118611 ip-10-0-128-48 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 19:38:19.118611 ip-10-0-128-48 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 19:38:19.119427 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.119273    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 19:38:19.122596 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122574    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:19.122596 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122591    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:19.122596 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122599    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:19.122596 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122604    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122609    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122614    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122618    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122621    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122626    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122629    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122634    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122637    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122641    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122645    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122649    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122652    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122656    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122659    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122663    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122667    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122670    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122674    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:19.122849 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122678    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122683    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122686    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122690    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122694    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122698    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122701    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122705    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122708    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122714    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122719    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122724    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122728    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122733    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122737    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122743    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122748    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122755    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122759    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122763    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:19.123638 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122768    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122772    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122776    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122780    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122784    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122788    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122793    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122797    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122801    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122805    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122810    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122814    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122818    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122822    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122826    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122830    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122834    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122839    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122843    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122846    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:19.124356 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122850    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122856    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122861    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122864    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122869    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122873    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122878    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122882    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122888    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122892    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122896    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122900    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122904    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122909    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122912    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122917    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122921    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122927    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122933    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:19.125148 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122937    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122942    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122945    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122950    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122954    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122958    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122962    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122967    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122971    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122975    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122979    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122983    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122987    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122991    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122995    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.122999    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.123004    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.123008    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124563    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124574    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:19.125950 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124580    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124585    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124593    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124598    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124602    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124607    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124611    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124615    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124619    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124623    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124628    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124632    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124636    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124640    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124644    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124648    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124653    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124656    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124660    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124664    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:19.126825 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124669    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124673    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124677    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124681    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124685    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124689    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124693    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124697    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124701    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124705    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124710    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124714    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124720    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124724    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124728    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124733    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124737    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124741    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124745    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:19.127615 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124749    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124753    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124758    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124762    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124766    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124770    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124775    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124779    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124783    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124787    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124791    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124795    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124800    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124804    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124808    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124812    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124817    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124822    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124826    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:19.128258 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124830    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124838    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124843    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124848    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124855    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124861    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124866    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124870    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124875    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124880    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124886    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124891    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124898    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124902    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124907    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124911    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124916    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124920    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124925    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:19.128716 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124929    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124933    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124937    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124941    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124946    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124950    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124954    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124958    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124962    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124967    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124971    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124978    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124984    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124988    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124993    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.124997    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125001    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125006    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125010    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125015    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:19.129192 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125660    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125670    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125676    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125683    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125688    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125693    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125698    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125702    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125707    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125711    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125716    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125721    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125726    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125731    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125736    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125740    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125744    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125748    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125752    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125757    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:19.129684 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125761    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125765    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125770    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125774    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125778    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125782    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125786    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125791    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125795    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125799    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125804    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125808    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125813    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125817    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125821    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125825    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125837    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125842    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125849    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125854    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:19.130151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125859    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125863    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125867    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125872    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125876    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125881    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125887    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125892    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125897    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125901    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125905    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125909    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125913    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125917    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125922    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125926    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125930    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125934    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125940    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:19.130648 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125944    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125948    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125952    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125956    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125961    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125967    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125972    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125978    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125984    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125988    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125993    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.125998    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126002    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126006    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126011    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126014    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126019    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126023    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126027    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:19.131103 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126031    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126035    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126039    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126043    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126047    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126052    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126055    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126060    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126064    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126069    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126074    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126078    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126082    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126086    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126090    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126094    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126098    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126102    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126106    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126110    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:19.131557 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.126114    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126223    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126247    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126258    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126265    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126272    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126277    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126283    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126290    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126295    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126300    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126306    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126311    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126317    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126322    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126326    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126331    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126335    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126341    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126347    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126355    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126360    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126365    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126371    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 19:38:19.132102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126377    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126382    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126388    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126393    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126398    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126403    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126407    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126412    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126417    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126424    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126429    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126434    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126438    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126444    2576 flags.go:64] FLAG: --enable-server="true"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126448    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126562    2576 flags.go:64] FLAG: --event-burst="100"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126570    2576 flags.go:64] FLAG: --event-qps="50"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126575    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126581    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126586    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126593    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126598    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.126604    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127380    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127390    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 19:38:19.132702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127397    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127404    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127409    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127415    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127421    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127426    2576 flags.go:64] FLAG: --feature-gates=""
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127457    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127463    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127469    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127474    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127480    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127485    2576 flags.go:64] FLAG: --help="false"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127490    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127495    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127505    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127510    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127516    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127521    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127527    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127531    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127536    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127541    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127546    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127556    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 19:38:19.133343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127561    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127566    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127571    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127576    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127580    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127585    2576 flags.go:64] FLAG: --lock-file=""
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127590    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127597    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127608    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127617    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127622    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127627    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127633    2576 flags.go:64] FLAG: --logging-format="text"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127671    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127720    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127873    2576 flags.go:64] FLAG: --manifest-url=""
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127884    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127894    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127898    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127903    2576 flags.go:64] FLAG: --max-pods="110"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127907    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127911    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127915    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127918    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127922    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 19:38:19.133922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127925    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127928    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127937    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127941    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127944    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127947    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127950    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127957    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127960    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127963    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127966    2576 flags.go:64] FLAG: --port="10250"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127970    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127973    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09f2c7edcd1a35bb2"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127976    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127980    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127984    2576 flags.go:64] FLAG: --register-node="true"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127987    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127991    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127994    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.127997    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128000    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128004    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128007    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128011    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128014    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 19:38:19.134558 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128017    2576 flags.go:64] FLAG: --runonce="false"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128020    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128024    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128027    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128030    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128033    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128036    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128039    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128042    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128045    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128048    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128051    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128054    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128057    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128060    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128063    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128070    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128073    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128076    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128082    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128085    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128088    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128091    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128094    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128097    2576 flags.go:64] FLAG: --v="2"
Jul 15 19:38:19.135361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128101    2576 flags.go:64] FLAG: --version="false"
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128105    2576 flags.go:64] FLAG: --vmodule=""
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128108    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128112    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128269    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128274    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128277    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128280    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128283    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128286    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128289    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128291    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128294    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128297    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128299    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128302    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128304    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128307    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128310    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128312    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:19.135957 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128315    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128318    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128320    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128323    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128326    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128328    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128331    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128333    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128336    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128338    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128341    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128343    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128346    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128348    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128350    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128354    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128357    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128359    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128362    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128365    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:19.136468 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128367    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128369    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128373    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128377    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128380    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128382    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128385    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128387    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128390    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128393    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128396    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128398    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128401    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128403    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128408    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128412    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128415    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128419    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128421    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:19.136943 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128425    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128427    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128430    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128433    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128436    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128439    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128442    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128445    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128449    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128452    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128454    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128457    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128460    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128463    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128466    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128469    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128471    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128474    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128476    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:19.137430 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128479    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128481    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128484    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128486    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128489    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128491    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128494    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128496    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128499    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128502    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128504    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128508    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128512    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128515    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128518    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128521    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128523    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128526    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128528    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:19.137887 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128531    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128534    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128538    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128540    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128543    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.128545    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.128983    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.135329    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.135345    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.135367    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.135373    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135430    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135434    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135438    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:19.138355 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135441    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135444    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135446    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135449    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135452    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135454    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135457    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135461    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135465    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135468    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135471    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135475    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135477    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135480    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135482    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135484    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135487    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135489    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135492    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135495    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:19.138708 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135497    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135500    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135502    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135505    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135507    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135510    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135515    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135518    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135521    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135525    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135528    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135531    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135533    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135536    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135539    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135541    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135544    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135548    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135550    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:19.139197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135553    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135555    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135558    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135560    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135563    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135565    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135568    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135570    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135573    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135576    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135578    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135581    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135583    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135586    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135588    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135591    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135594    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135597    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135599    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135603    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:19.139655 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135607    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135609    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135612    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135615    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135618    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135620    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135623    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135626    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135628    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135630    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135633    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135636    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135639    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135641    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135643    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135646    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135649    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135651    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135654    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135656    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:19.140136 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135659    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135662    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135664    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135667    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135669    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135672    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135674    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135677    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135680    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135682    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135686    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135690    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135693    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135697    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135700    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135702    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:19.140736 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135705    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.135710    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135824    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135829    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135833    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135836    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135839    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135841    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135844    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135846    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135849    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135851    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135854    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135857    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135859    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 19:38:19.141151 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135862    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135865    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135868    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135871    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135873    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135875    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135878    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135880    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135883    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135885    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135888    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135891    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135893    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135896    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135899    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135902    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135905    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135908    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135910    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 19:38:19.141553 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135913    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135915    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135918    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135920    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135923    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135925    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135928    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135930    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135933    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135935    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135938    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135940    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135942    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135945    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135947    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135950    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135953    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135955    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135958    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135961    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 19:38:19.142004 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135963    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135966    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135970    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135974    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135977    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135980    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135983    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135986    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135988    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135992    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135994    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.135997    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136000    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136002    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136006    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136009    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136012    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136015    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136018    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 19:38:19.142493 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136021    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136023    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136025    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136028    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136030    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136033    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136035    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136038    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136040    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136043    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136045    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136048    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136050    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136053    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136055    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136058    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136060    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136063    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136066    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136069    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 19:38:19.142960 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136071    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136074    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136077    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136079    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136082    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136084    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136087    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:19.136089    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.136094    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.136230    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.138297    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.139330    2576 server.go:1019] "Starting client certificate rotation"
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.139427    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:38:19.143450 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.139454    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 19:38:19.143761 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.141306    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:38:19.143761 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.142798    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 19:38:19.153853 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.153553    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 15 19:38:19.155955 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.155939    2576 log.go:25] "Validated CRI v1 image API"
Jul 15 19:38:19.157381 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.157365    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 19:38:19.159378 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.159359    2576 fs.go:135] Filesystem UUIDs: map[0fb0bef0-29f6-429c-b87f-22142095dc07:/dev/nvme0n1p3 0fc14641-87f1-4359-a5df-1ef789b20add:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 15 19:38:19.159427 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.159378    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 19:38:19.165141 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.165033    2576 manager.go:216] Machine: {Timestamp:2026-07-15 19:38:19.163331137 +0000 UTC m=+0.244525509 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100134 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e24fcc1f4fb43915b712eb49c7690 SystemUUID:ec2e24fc-c1f4-fb43-915b-712eb49c7690 BootID:bdebd85a-4b9f-426b-aa38-00d3a5efe7f1 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:40:5a:e6:1c:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:40:5a:e6:1c:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:92:c4:88:fb:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 19:38:19.165141 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.165139    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 19:38:19.165276 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.165264    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 19:38:19.166195 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.166159    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 19:38:19.166331 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.166199    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 19:38:19.167193 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.167182    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 19:38:19.167269 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.167196    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 19:38:19.167269 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.167204    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:38:19.167711 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.167702    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 19:38:19.168309 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.168293    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:38:19.168813 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.168802    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 19:38:19.172661 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.172650    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:38:19.172793 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.172783    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 19:38:19.172832 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.172815    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 19:38:19.172832 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.172828    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 19:38:19.172882 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.172851    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 19:38:19.172882 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.172863    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 15 19:38:19.172882 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.172875    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 19:38:19.173224 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.173213    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:38:19.173288 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.173230    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 19:38:19.174868 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.174849    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 19:38:19.176440 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176428    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 19:38:19.176487 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176457    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 19:38:19.176607 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176598    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 19:38:19.176640 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176613    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 19:38:19.176640 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176619    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 19:38:19.176640 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176624    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 19:38:19.176640 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176632    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 19:38:19.176640 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176637    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 19:38:19.177002 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.176994    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 19:38:19.177002 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.177002    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 19:38:19.177056 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.177008    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 19:38:19.177056 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.177014    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 19:38:19.177056 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.177022    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 19:38:19.177056 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.177030    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 19:38:19.178020 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.178011    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 19:38:19.178020 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.178019    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 19:38:19.181080 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.181067    2576 server.go:1268] "Started kubelet"
Jul 15 19:38:19.181178 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.181146    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 19:38:19.181232 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.181200    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 19:38:19.181833 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.181719    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 19:38:19.181918 ip-10-0-128-48 systemd[1]: Started Kubernetes Kubelet.
Jul 15 19:38:19.182484 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.182319    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 19:38:19.183891 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.183876    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 19:38:19.184358 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.184339    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 19:38:19.184440 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.184348    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 19:38:19.184993 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.184413    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 19:38:19.185562 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.185491    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 19:38:19.190562 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.190537    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 19:38:19.190562 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.190548    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 19:38:19.190696 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.190608    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.191233 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191038    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 19:38:19.191233 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191059    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 19:38:19.191233 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191073    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 19:38:19.191233 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191210    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 19:38:19.191233 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191221    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 19:38:19.191562 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191543    2576 factory.go:55] Registering systemd factory
Jul 15 19:38:19.191625 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191587    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 15 19:38:19.191884 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191864    2576 factory.go:153] Registering CRI-O factory
Jul 15 19:38:19.191884 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191886    2576 factory.go:223] Registration of the crio container factory successfully
Jul 15 19:38:19.192045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191941    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 19:38:19.192045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191966    2576 factory.go:103] Registering Raw factory
Jul 15 19:38:19.192045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.191982    2576 manager.go:1196] Started watching for new ooms in manager
Jul 15 19:38:19.192633 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.192614    2576 manager.go:349] Starting recovery of all containers
Jul 15 19:38:19.194474 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.194427    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 19:38:19.194539 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.194523    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 19:38:19.195525 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.194630    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-48.ec2.internal.18c28dc98cb96948  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-48.ec2.internal,UID:ip-10-0-128-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-48.ec2.internal,},FirstTimestamp:2026-07-15 19:38:19.181041992 +0000 UTC m=+0.262236344,LastTimestamp:2026-07-15 19:38:19.181041992 +0000 UTC m=+0.262236344,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-48.ec2.internal,}"
Jul 15 19:38:19.200845 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.200723    2576 manager.go:354] Recovery completed
Jul 15 19:38:19.206126 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.206105    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ftm8s"
Jul 15 19:38:19.206512 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.206495    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:19.208763 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.208744    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:19.208835 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.208776    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:19.208835 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.208787    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:19.209382 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.209368    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 19:38:19.209463 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.209383    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 19:38:19.209463 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.209387    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:19.209463 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.209404    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 19:38:19.210680 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.210659    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:19.210766 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.210695    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:19.210766 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.210712    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:19.210866 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.210708    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-48.ec2.internal.18c28dc98e605e90  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-48.ec2.internal,UID:ip-10-0-128-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-48.ec2.internal,},FirstTimestamp:2026-07-15 19:38:19.208760976 +0000 UTC m=+0.289955334,LastTimestamp:2026-07-15 19:38:19.208760976 +0000 UTC m=+0.289955334,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-48.ec2.internal,}"
Jul 15 19:38:19.211872 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.211853    2576 policy_none.go:49] "None policy: Start"
Jul 15 19:38:19.211925 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.211882    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 19:38:19.211925 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.211900    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 19:38:19.213564 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.213539    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ftm8s"
Jul 15 19:38:19.214165 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.214135    2576 policy_none.go:47] "Start"
Jul 15 19:38:19.259871 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.259855    2576 manager.go:337] "Starting Device Plugin manager"
Jul 15 19:38:19.259987 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.259893    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 19:38:19.259987 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.259904    2576 server.go:87] "Starting device plugin registration server"
Jul 15 19:38:19.260229 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.260199    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 19:38:19.260271 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.260234    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 19:38:19.260342 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.260324    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 19:38:19.260421 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.260408    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 19:38:19.260421 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.260420    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 19:38:19.261054 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.261019    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 19:38:19.261153 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.261081    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.324130 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.324088    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 19:38:19.326550 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.325363    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 19:38:19.326550 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.325403    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 19:38:19.326550 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.325430    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 19:38:19.326550 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.325466    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 19:38:19.328300 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.328265    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:19.360993 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.360963    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:19.362444 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.362417    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:19.362548 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.362457    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:19.362548 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.362472    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:19.362548 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.362498    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.369421 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.369371    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.369421 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.369394    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-48.ec2.internal\": node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.386594 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.386567    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.425594 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.425553    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"]
Jul 15 19:38:19.425725 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.425624    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:19.427493 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.427471    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:19.427594 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.427505    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:19.427594 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.427515    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:19.430168 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.430154    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:19.430279 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.430264    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.430324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.430294    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:19.430973 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.430956    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:19.431079 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.430983    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:19.431079 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.430998    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:19.431079 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.431012    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:19.431079 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.431036    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:19.431079 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.431047    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:19.433555 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.433534    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.433662 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.433569    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 19:38:19.434312 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.434297    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 19:38:19.434386 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.434328    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 19:38:19.434386 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.434367    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeHasSufficientPID"
Jul 15 19:38:19.453859 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.453838    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-48.ec2.internal\" not found" node="ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.457554 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.457540    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-48.ec2.internal\" not found" node="ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.487472 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.487446    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.493252 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.493223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.493316 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.493250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.493316 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.493273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc266b970294ca7e6b02e58f7dfbfaf7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"fc266b970294ca7e6b02e58f7dfbfaf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.587537 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.587505    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.594434 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.594412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.594496 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.594440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.594496 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.594458    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc266b970294ca7e6b02e58f7dfbfaf7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"fc266b970294ca7e6b02e58f7dfbfaf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.594577 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.594513    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc266b970294ca7e6b02e58f7dfbfaf7-config\") pod \"kube-apiserver-proxy-ip-10-0-128-48.ec2.internal\" (UID: \"fc266b970294ca7e6b02e58f7dfbfaf7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.594577 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.594514    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.594577 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.594542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b41c40da60a15333861b842213a29712-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal\" (UID: \"b41c40da60a15333861b842213a29712\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.688283 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.688196    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.757382 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.757345    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.760732 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:19.760712    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:19.788763 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.788717    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.894655 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.894600    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:19.994757 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:19.994684    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:20.095464 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:20.095411    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:20.138620 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.138593    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 19:38:20.139133 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.138768    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 19:38:20.175860 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.175830    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:20.196149 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:20.196118    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:20.218125 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.218080    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 19:33:19 +0000 UTC" deadline="2028-03-10 19:46:21.579365006 +0000 UTC"
Jul 15 19:38:20.218341 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.218141    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14496h8m1.361256172s"
Jul 15 19:38:20.297361 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:20.297273    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-48.ec2.internal\" not found"
Jul 15 19:38:20.339826 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.339796    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:20.362197 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:20.362164    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc266b970294ca7e6b02e58f7dfbfaf7.slice/crio-9eddebfcffbc385a17706fdb87e5b773a397dd455a5701e68c0387f0050fa0b9 WatchSource:0}: Error finding container 9eddebfcffbc385a17706fdb87e5b773a397dd455a5701e68c0387f0050fa0b9: Status 404 returned error can't find the container with id 9eddebfcffbc385a17706fdb87e5b773a397dd455a5701e68c0387f0050fa0b9
Jul 15 19:38:20.362432 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:20.362416    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb41c40da60a15333861b842213a29712.slice/crio-a57abf5e707238e639b912e5144fbc9be7fab08fecb6de07c376f3e4cd0d9ab4 WatchSource:0}: Error finding container a57abf5e707238e639b912e5144fbc9be7fab08fecb6de07c376f3e4cd0d9ab4: Status 404 returned error can't find the container with id a57abf5e707238e639b912e5144fbc9be7fab08fecb6de07c376f3e4cd0d9ab4
Jul 15 19:38:20.366348 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.366334    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:38:20.391271 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.391239    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:20.401683 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.401652    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:38:20.403130 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.403111    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"
Jul 15 19:38:20.414909 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.414890    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 19:38:20.643478 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:20.643451    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:21.173363 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.173327    2576 apiserver.go:52] "Watching apiserver"
Jul 15 19:38:21.181330 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.181291    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 19:38:21.181906 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.181880    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-zvxbg","openshift-multus/multus-h6rbr","openshift-multus/network-metrics-daemon-ffdd6","openshift-network-operator/iptables-alerter-lbwns","kube-system/global-pull-secret-syncer-fmcqm","kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9","openshift-cluster-node-tuning-operator/tuned-w79bp","openshift-dns/node-resolver-brbhw","openshift-network-diagnostics/network-check-target-ft2wd","openshift-ovn-kubernetes/ovnkube-node-lvkp6","kube-system/konnectivity-agent-rkkl8","openshift-image-registry/node-ca-shvrr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal"]
Jul 15 19:38:21.184971 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.184946    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.188024 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.187537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.188024 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.187833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 19:38:21.188024 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.187869    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 19:38:21.188300 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.188038    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r8pvn\""
Jul 15 19:38:21.188512 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.188491    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 19:38:21.191010 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.189705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:21.191010 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.189783    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:21.191010 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.190875    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 19:38:21.191216 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.191148    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 19:38:21.191569 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.191431    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 19:38:21.191569 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.191439    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 19:38:21.191569 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.191444    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-d8rdb\""
Jul 15 19:38:21.192190 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.192155    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.195015 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.194584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jj9x6\""
Jul 15 19:38:21.195015 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.194583    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.195015 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.194757    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:21.195015 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.194794    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 19:38:21.195015 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.194833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:38:21.195015 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.194843    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 19:38:21.197183 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.197036    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.199636 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.199610    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.202471    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-sys-fs\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzwl9\" (UniqueName: \"kubernetes.io/projected/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-kube-api-access-tzwl9\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2486a2b9-8d95-49fe-8e7f-5089ec201788-iptables-alerter-script\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2486a2b9-8d95-49fe-8e7f-5089ec201788-host-slash\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203523    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9skl\" (UniqueName: \"kubernetes.io/projected/2486a2b9-8d95-49fe-8e7f-5089ec201788-kube-api-access-m9skl\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203548    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-socket-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203573    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-registration-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-serviceca\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-device-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203662    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-host\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203688    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cxqb\" (UniqueName: \"kubernetes.io/projected/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-kube-api-access-4cxqb\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203721    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203750    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:21.204108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.203776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlrxl\" (UniqueName: \"kubernetes.io/projected/b633058a-84da-4566-98b1-4e124a4b55ab-kube-api-access-dlrxl\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.206802    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207052    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207113    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207126    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207313    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207328    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207328    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207410    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvsqr\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207537    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 19:38:21.207694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.207679    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k26sg\""
Jul 15 19:38:21.210262 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.208939    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8vx9q\""
Jul 15 19:38:21.210262 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.209135    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 19:38:21.210262 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.209570    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:21.210262 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.209633    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:21.210262 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.209763    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 19:38:21.216595 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.216124    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r7v2k\""
Jul 15 19:38:21.218513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.218490    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 19:38:21.220147 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.220126    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.223329 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.222559    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:21.223329 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.222729    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 19:38:21.223482 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.223396    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x764r\""
Jul 15 19:38:21.223660 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.223643    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 19:38:21.223960 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.223939    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 19:38:21.224108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.224090    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 19:38:21.224184 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.224135    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 19:38:21.224302 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.224283    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 19:38:21.224840 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.224818    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 19:38:21.225273 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.225255    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m2vjk\""
Jul 15 19:38:21.225394 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.225375    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 19:38:21.231474 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.230990    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5wzf5"
Jul 15 19:38:21.237535 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.237501    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5wzf5"
Jul 15 19:38:21.293102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.293082    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 19:38:21.304511 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304482    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:21.304621 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysconfig\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.304621 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovnkube-config\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.304621 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzwl9\" (UniqueName: \"kubernetes.io/projected/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-kube-api-access-tzwl9\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.304725 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304639    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9skl\" (UniqueName: \"kubernetes.io/projected/2486a2b9-8d95-49fe-8e7f-5089ec201788-kube-api-access-m9skl\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.304725 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304667    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-system-cni-dir\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.304725 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-cni-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.304725 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304719    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-netns\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.304847 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-etc-kubernetes\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.304880 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.304836    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:21.304880 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxz65\" (UniqueName: \"kubernetes.io/projected/9dccbb46-cadc-40a5-8621-6dd067fa1943-kube-api-access-zxz65\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.304944 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-socket-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.304944 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-run\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.305003 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.304939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-lib-modules\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.305003 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.304969    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs podName:b633058a-84da-4566-98b1-4e124a4b55ab nodeName:}" failed. No retries permitted until 2026-07-15 19:38:21.804941916 +0000 UTC m=+2.886136262 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs") pod "network-metrics-daemon-ffdd6" (UID: "b633058a-84da-4566-98b1-4e124a4b55ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:21.305073 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-kubelet\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.305073 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-systemd-units\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.305177 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305072    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-device-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.305177 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305099    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cxqb\" (UniqueName: \"kubernetes.io/projected/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-kube-api-access-4cxqb\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.305177 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-socket-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.305370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5953ff9-c877-41a2-877f-e74120fa7580-hosts-file\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.305370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cni-binary-copy\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.305370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305267    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-device-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.305370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-os-release\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.305370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-multus-certs\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.305370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.305682 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-node-log\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.305682 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlrxl\" (UniqueName: \"kubernetes.io/projected/b633058a-84da-4566-98b1-4e124a4b55ab-kube-api-access-dlrxl\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:21.305682 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305580    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-cni-bin\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.305682 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovnkube-script-lib\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.305885 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305711    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c220f879-813d-4809-8415-17c99b43300c-agent-certs\") pod \"konnectivity-agent-rkkl8\" (UID: \"c220f879-813d-4809-8415-17c99b43300c\") " pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:21.305885 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.305885 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-sys-fs\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.306047 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.306047 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.306047 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305971    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-sys-fs\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.306047 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.305978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb49h\" (UniqueName: \"kubernetes.io/projected/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-kube-api-access-rb49h\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.306224 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-serviceca\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.306224 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0af40cba-63c1-44af-929b-cccdcdeb732d-dbus\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.306224 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306155    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-sys\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.306224 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306181    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5953ff9-c877-41a2-877f-e74120fa7580-tmp-dir\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.306448 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-hostroot\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.306448 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-cni-bin\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.306448 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c220f879-813d-4809-8415-17c99b43300c-konnectivity-ca\") pod \"konnectivity-agent-rkkl8\" (UID: \"c220f879-813d-4809-8415-17c99b43300c\") " pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:21.306448 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.306448 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306356    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysctl-d\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.306448 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysctl-conf\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.306448 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-var-lib-kubelet\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.306448 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306431    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6380b7a7-82b7-4171-901e-540e296eb180-etc-tuned\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306454    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6380b7a7-82b7-4171-901e-540e296eb180-tmp\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cnibin\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-modprobe-d\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-serviceca\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-systemd\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306643    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-cnibin\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306671    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-cni-binary-copy\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306697    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-socket-dir-parent\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-run-netns\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-etc-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-cni-netd\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.306883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306850    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2486a2b9-8d95-49fe-8e7f-5089ec201788-host-slash\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-kubernetes\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306921    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-os-release\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-daemon-config\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306944    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2486a2b9-8d95-49fe-8e7f-5089ec201788-host-slash\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.306977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-registration-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-env-overrides\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-host\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307111    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-registration-dir\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l68w8\" (UniqueName: \"kubernetes.io/projected/6380b7a7-82b7-4171-901e-540e296eb180-kube-api-access-l68w8\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-host\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307280    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-kubelet\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-systemd\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-etc-selinux\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.307542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307436    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-host\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw68f\" (UniqueName: \"kubernetes.io/projected/e5953ff9-c877-41a2-877f-e74120fa7580-kube-api-access-rw68f\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307539    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-cni-multus\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-var-lib-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-log-socket\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2486a2b9-8d95-49fe-8e7f-5089ec201788-iptables-alerter-script\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307672    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0af40cba-63c1-44af-929b-cccdcdeb732d-kubelet-config\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307716    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-k8s-cni-cncf-io\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-conf-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf5kf\" (UniqueName: \"kubernetes.io/projected/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-kube-api-access-kf5kf\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-system-cni-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-slash\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307933    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-ovn\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.308045 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.307983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovn-node-metrics-cert\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.308818 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.308142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2486a2b9-8d95-49fe-8e7f-5089ec201788-iptables-alerter-script\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.313903 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.313876    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 19:38:21.317891 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.317867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9skl\" (UniqueName: \"kubernetes.io/projected/2486a2b9-8d95-49fe-8e7f-5089ec201788-kube-api-access-m9skl\") pod \"iptables-alerter-lbwns\" (UID: \"2486a2b9-8d95-49fe-8e7f-5089ec201788\") " pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.321052 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.321021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cxqb\" (UniqueName: \"kubernetes.io/projected/e235c3ae-a21d-41b6-a3aa-729a0849eb4b-kube-api-access-4cxqb\") pod \"node-ca-shvrr\" (UID: \"e235c3ae-a21d-41b6-a3aa-729a0849eb4b\") " pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.321199 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.321170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzwl9\" (UniqueName: \"kubernetes.io/projected/1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081-kube-api-access-tzwl9\") pod \"aws-ebs-csi-driver-node-s6qq9\" (UID: \"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.321931 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.321887    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 19:38:21.323399 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.323378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlrxl\" (UniqueName: \"kubernetes.io/projected/b633058a-84da-4566-98b1-4e124a4b55ab-kube-api-access-dlrxl\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:21.331653 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.331581    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"b41c40da60a15333861b842213a29712","Type":"ContainerStarted","Data":"a57abf5e707238e639b912e5144fbc9be7fab08fecb6de07c376f3e4cd0d9ab4"}
Jul 15 19:38:21.337776 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.337739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" event={"ID":"fc266b970294ca7e6b02e58f7dfbfaf7","Type":"ContainerStarted","Data":"9eddebfcffbc385a17706fdb87e5b773a397dd455a5701e68c0387f0050fa0b9"}
Jul 15 19:38:21.409100 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-system-cni-dir\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.409100 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-cni-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409100 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-netns\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-system-cni-dir\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409132    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-etc-kubernetes\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409179    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-etc-kubernetes\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409207    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-netns\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-cni-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxz65\" (UniqueName: \"kubernetes.io/projected/9dccbb46-cadc-40a5-8621-6dd067fa1943-kube-api-access-zxz65\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-run\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-run\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-lib-modules\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-kubelet\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409401    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-systemd-units\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409428    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5953ff9-c877-41a2-877f-e74120fa7580-hosts-file\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cni-binary-copy\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-os-release\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-systemd-units\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-kubelet\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.409497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409504    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-multus-certs\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-multus-certs\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-os-release\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e5953ff9-c877-41a2-877f-e74120fa7580-hosts-file\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409625    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-lib-modules\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-node-log\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409670    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-cni-bin\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409699    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-node-log\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409721    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovnkube-script-lib\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409755    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c220f879-813d-4809-8415-17c99b43300c-agent-certs\") pod \"konnectivity-agent-rkkl8\" (UID: \"c220f879-813d-4809-8415-17c99b43300c\") " pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409788    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409797    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-cni-bin\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb49h\" (UniqueName: \"kubernetes.io/projected/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-kube-api-access-rb49h\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409847    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0af40cba-63c1-44af-929b-cccdcdeb732d-dbus\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-sys\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5953ff9-c877-41a2-877f-e74120fa7580-tmp-dir\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.410385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-hostroot\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-cni-bin\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.409979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c220f879-813d-4809-8415-17c99b43300c-konnectivity-ca\") pod \"konnectivity-agent-rkkl8\" (UID: \"c220f879-813d-4809-8415-17c99b43300c\") " pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysctl-d\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysctl-conf\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410081    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-var-lib-kubelet\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6380b7a7-82b7-4171-901e-540e296eb180-etc-tuned\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6380b7a7-82b7-4171-901e-540e296eb180-tmp\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cnibin\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410211    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-cni-bin\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-modprobe-d\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-systemd\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-cnibin\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-cni-binary-copy\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-socket-dir-parent\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.411270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovnkube-script-lib\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-run-netns\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410386    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-etc-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-cni-netd\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-kubernetes\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410468    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-os-release\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410476    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0af40cba-63c1-44af-929b-cccdcdeb732d-dbus\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410480    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cnibin\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-daemon-config\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410554    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-var-lib-kubelet\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-env-overrides\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410593    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l68w8\" (UniqueName: \"kubernetes.io/projected/6380b7a7-82b7-4171-901e-540e296eb180-kube-api-access-l68w8\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysctl-conf\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-kubelet\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410686    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-kubelet\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412170 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-systemd\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410728    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-host\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410748    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-socket-dir-parent\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw68f\" (UniqueName: \"kubernetes.io/projected/e5953ff9-c877-41a2-877f-e74120fa7580-kube-api-access-rw68f\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410786    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-etc-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-cni-multus\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cni-binary-copy\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-var-lib-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410850    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-cni-netd\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410876    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-log-socket\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.410968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-run-netns\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-kubernetes\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411074    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-var-lib-cni-multus\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c220f879-813d-4809-8415-17c99b43300c-konnectivity-ca\") pod \"konnectivity-agent-rkkl8\" (UID: \"c220f879-813d-4809-8415-17c99b43300c\") " pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-modprobe-d\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411134    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-cni-binary-copy\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.412985 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysctl-d\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-sys\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-run-ovn-kubernetes\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411373    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5953ff9-c877-41a2-877f-e74120fa7580-tmp-dir\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-log-socket\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.411401    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411466    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-systemd\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.411492    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret podName:0af40cba-63c1-44af-929b-cccdcdeb732d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:21.911470255 +0000 UTC m=+2.992664616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret") pod "global-pull-secret-syncer-fmcqm" (UID: "0af40cba-63c1-44af-929b-cccdcdeb732d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-host\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-cnibin\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411660    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-env-overrides\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411675    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411701    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-systemd\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-var-lib-openvswitch\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411774    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-hostroot\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0af40cba-63c1-44af-929b-cccdcdeb732d-kubelet-config\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411825    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-os-release\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-k8s-cni-cncf-io\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0af40cba-63c1-44af-929b-cccdcdeb732d-kubelet-config\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411912    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-conf-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411936    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-host-run-k8s-cni-cncf-io\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.411987    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf5kf\" (UniqueName: \"kubernetes.io/projected/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-kube-api-access-kf5kf\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412027    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-system-cni-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-conf-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-slash\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412100    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-slash\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412125    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-system-cni-dir\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-ovn\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-run-ovn\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovn-node-metrics-cert\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412288    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9dccbb46-cadc-40a5-8621-6dd067fa1943-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-multus-daemon-config\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.414910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysconfig\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.416032 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovnkube-config\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.416032 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6380b7a7-82b7-4171-901e-540e296eb180-etc-sysconfig\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.416032 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.412880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovnkube-config\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.416032 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.414348    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c220f879-813d-4809-8415-17c99b43300c-agent-certs\") pod \"konnectivity-agent-rkkl8\" (UID: \"c220f879-813d-4809-8415-17c99b43300c\") " pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:21.416032 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.414412    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6380b7a7-82b7-4171-901e-540e296eb180-tmp\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.416032 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.414970    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9dccbb46-cadc-40a5-8621-6dd067fa1943-ovn-node-metrics-cert\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.416032 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.415299    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6380b7a7-82b7-4171-901e-540e296eb180-etc-tuned\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.418982 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.418957    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:21.418982 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.418985    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:21.419164 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.418999    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gwnkj for pod openshift-network-diagnostics/network-check-target-ft2wd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:21.419164 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.419073    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj podName:22d63025-972c-4239-b212-4ee5b2b815da nodeName:}" failed. No retries permitted until 2026-07-15 19:38:21.919054302 +0000 UTC m=+3.000248658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gwnkj" (UniqueName: "kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj") pod "network-check-target-ft2wd" (UID: "22d63025-972c-4239-b212-4ee5b2b815da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:21.419976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.419822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxz65\" (UniqueName: \"kubernetes.io/projected/9dccbb46-cadc-40a5-8621-6dd067fa1943-kube-api-access-zxz65\") pod \"ovnkube-node-lvkp6\" (UID: \"9dccbb46-cadc-40a5-8621-6dd067fa1943\") " pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.420342 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.420307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb49h\" (UniqueName: \"kubernetes.io/projected/ea3e77ca-fbaf-40df-ba83-c49fb7d98509-kube-api-access-rb49h\") pod \"multus-additional-cni-plugins-zvxbg\" (UID: \"ea3e77ca-fbaf-40df-ba83-c49fb7d98509\") " pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.421774 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.421705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw68f\" (UniqueName: \"kubernetes.io/projected/e5953ff9-c877-41a2-877f-e74120fa7580-kube-api-access-rw68f\") pod \"node-resolver-brbhw\" (UID: \"e5953ff9-c877-41a2-877f-e74120fa7580\") " pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.422279 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.422195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l68w8\" (UniqueName: \"kubernetes.io/projected/6380b7a7-82b7-4171-901e-540e296eb180-kube-api-access-l68w8\") pod \"tuned-w79bp\" (UID: \"6380b7a7-82b7-4171-901e-540e296eb180\") " pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.425073 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.425015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf5kf\" (UniqueName: \"kubernetes.io/projected/8e4e4433-bdec-4dad-8a62-f121bc45d0e6-kube-api-access-kf5kf\") pod \"multus-h6rbr\" (UID: \"8e4e4433-bdec-4dad-8a62-f121bc45d0e6\") " pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.516553 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.516514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9"
Jul 15 19:38:21.527305 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.527279    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-shvrr"
Jul 15 19:38:21.529923 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:21.529892    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf3a2f8_73b8_4dcf_8e5d_9c403a3c9081.slice/crio-f17f83413e6580762fd0d63f838331ed31a42ede0464b8fa74518d20a9559e76 WatchSource:0}: Error finding container f17f83413e6580762fd0d63f838331ed31a42ede0464b8fa74518d20a9559e76: Status 404 returned error can't find the container with id f17f83413e6580762fd0d63f838331ed31a42ede0464b8fa74518d20a9559e76
Jul 15 19:38:21.539658 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:21.539620    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode235c3ae_a21d_41b6_a3aa_729a0849eb4b.slice/crio-38d01c2c2cf297e028fe482f95345cb3242bfa3c38ab9e98967830053a6342bf WatchSource:0}: Error finding container 38d01c2c2cf297e028fe482f95345cb3242bfa3c38ab9e98967830053a6342bf: Status 404 returned error can't find the container with id 38d01c2c2cf297e028fe482f95345cb3242bfa3c38ab9e98967830053a6342bf
Jul 15 19:38:21.540472 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.540338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbwns"
Jul 15 19:38:21.549599 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.549466    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w79bp"
Jul 15 19:38:21.551329 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:21.551292    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2486a2b9_8d95_49fe_8e7f_5089ec201788.slice/crio-6a765f9b7d7abde89c9a586c95d2a4c0fd0064720130f3366f30089b1f264d10 WatchSource:0}: Error finding container 6a765f9b7d7abde89c9a586c95d2a4c0fd0064720130f3366f30089b1f264d10: Status 404 returned error can't find the container with id 6a765f9b7d7abde89c9a586c95d2a4c0fd0064720130f3366f30089b1f264d10
Jul 15 19:38:21.557506 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.557322    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-brbhw"
Jul 15 19:38:21.561371 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:21.561349    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6380b7a7_82b7_4171_901e_540e296eb180.slice/crio-9653f0866a37e8d596fcc396663780c49d3b615b99b8ba955b1f9ff0beecd39d WatchSource:0}: Error finding container 9653f0866a37e8d596fcc396663780c49d3b615b99b8ba955b1f9ff0beecd39d: Status 404 returned error can't find the container with id 9653f0866a37e8d596fcc396663780c49d3b615b99b8ba955b1f9ff0beecd39d
Jul 15 19:38:21.567361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.567342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zvxbg"
Jul 15 19:38:21.572876 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:21.572839    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5953ff9_c877_41a2_877f_e74120fa7580.slice/crio-fb7fb915362a48b0c4e958d603bfe789c0579c32d8c9298c1c9f7f71c5953116 WatchSource:0}: Error finding container fb7fb915362a48b0c4e958d603bfe789c0579c32d8c9298c1c9f7f71c5953116: Status 404 returned error can't find the container with id fb7fb915362a48b0c4e958d603bfe789c0579c32d8c9298c1c9f7f71c5953116
Jul 15 19:38:21.576203 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.576097    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h6rbr"
Jul 15 19:38:21.585524 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.585494    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:21.590486 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:21.590454    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4e4433_bdec_4dad_8a62_f121bc45d0e6.slice/crio-0dd92aca008d9d5e286b510dd66fb9fa9fec924fff4252ad60a96f8ad39cad76 WatchSource:0}: Error finding container 0dd92aca008d9d5e286b510dd66fb9fa9fec924fff4252ad60a96f8ad39cad76: Status 404 returned error can't find the container with id 0dd92aca008d9d5e286b510dd66fb9fa9fec924fff4252ad60a96f8ad39cad76
Jul 15 19:38:21.592642 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.592618    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:21.603969 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:21.603861    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dccbb46_cadc_40a5_8621_6dd067fa1943.slice/crio-3bf243831b50e6b8e5fd285982c7df514091bd54e30bdfeb42b0296d3a76801d WatchSource:0}: Error finding container 3bf243831b50e6b8e5fd285982c7df514091bd54e30bdfeb42b0296d3a76801d: Status 404 returned error can't find the container with id 3bf243831b50e6b8e5fd285982c7df514091bd54e30bdfeb42b0296d3a76801d
Jul 15 19:38:21.609487 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:21.609445    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc220f879_813d_4809_8415_17c99b43300c.slice/crio-8c759ceb2b5458a66096cc7c4890faed1836be0c7d7eb29af6cabbd2255845e9 WatchSource:0}: Error finding container 8c759ceb2b5458a66096cc7c4890faed1836be0c7d7eb29af6cabbd2255845e9: Status 404 returned error can't find the container with id 8c759ceb2b5458a66096cc7c4890faed1836be0c7d7eb29af6cabbd2255845e9
Jul 15 19:38:21.816514 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.816476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:21.816702 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.816662    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:21.816755 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.816733    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs podName:b633058a-84da-4566-98b1-4e124a4b55ab nodeName:}" failed. No retries permitted until 2026-07-15 19:38:22.816716988 +0000 UTC m=+3.897911329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs") pod "network-metrics-daemon-ffdd6" (UID: "b633058a-84da-4566-98b1-4e124a4b55ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:21.917549 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:21.917502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:21.917751 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.917702    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:21.917821 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:21.917785    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret podName:0af40cba-63c1-44af-929b-cccdcdeb732d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:22.917763902 +0000 UTC m=+3.998958246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret") pod "global-pull-secret-syncer-fmcqm" (UID: "0af40cba-63c1-44af-929b-cccdcdeb732d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:22.018358 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.018319    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:22.018541 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.018519    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:22.018594 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.018547    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:22.018594 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.018558    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gwnkj for pod openshift-network-diagnostics/network-check-target-ft2wd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:22.018663 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.018615    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj podName:22d63025-972c-4239-b212-4ee5b2b815da nodeName:}" failed. No retries permitted until 2026-07-15 19:38:23.018597655 +0000 UTC m=+4.099792010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwnkj" (UniqueName: "kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj") pod "network-check-target-ft2wd" (UID: "22d63025-972c-4239-b212-4ee5b2b815da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:22.242710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.242563    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:33:21 +0000 UTC" deadline="2028-04-22 03:50:10.44465151 +0000 UTC"
Jul 15 19:38:22.242710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.242604    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15512h11m48.202051958s"
Jul 15 19:38:22.326374 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.326330    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:22.326568 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.326496    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:22.340705 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.340665    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rkkl8" event={"ID":"c220f879-813d-4809-8415-17c99b43300c","Type":"ContainerStarted","Data":"8c759ceb2b5458a66096cc7c4890faed1836be0c7d7eb29af6cabbd2255845e9"}
Jul 15 19:38:22.342139 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.342083    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"3bf243831b50e6b8e5fd285982c7df514091bd54e30bdfeb42b0296d3a76801d"}
Jul 15 19:38:22.343484 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.343456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" event={"ID":"ea3e77ca-fbaf-40df-ba83-c49fb7d98509","Type":"ContainerStarted","Data":"da20d3a8c9c76c4d43cbcd4544ada777d62cfcb04c8846fd2fd98fbe9b9fa0af"}
Jul 15 19:38:22.344968 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.344938    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-brbhw" event={"ID":"e5953ff9-c877-41a2-877f-e74120fa7580","Type":"ContainerStarted","Data":"fb7fb915362a48b0c4e958d603bfe789c0579c32d8c9298c1c9f7f71c5953116"}
Jul 15 19:38:22.346433 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.346407    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-shvrr" event={"ID":"e235c3ae-a21d-41b6-a3aa-729a0849eb4b","Type":"ContainerStarted","Data":"38d01c2c2cf297e028fe482f95345cb3242bfa3c38ab9e98967830053a6342bf"}
Jul 15 19:38:22.348088 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.348059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9" event={"ID":"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081","Type":"ContainerStarted","Data":"f17f83413e6580762fd0d63f838331ed31a42ede0464b8fa74518d20a9559e76"}
Jul 15 19:38:22.349735 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.349709    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h6rbr" event={"ID":"8e4e4433-bdec-4dad-8a62-f121bc45d0e6","Type":"ContainerStarted","Data":"0dd92aca008d9d5e286b510dd66fb9fa9fec924fff4252ad60a96f8ad39cad76"}
Jul 15 19:38:22.351371 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.351341    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w79bp" event={"ID":"6380b7a7-82b7-4171-901e-540e296eb180","Type":"ContainerStarted","Data":"9653f0866a37e8d596fcc396663780c49d3b615b99b8ba955b1f9ff0beecd39d"}
Jul 15 19:38:22.352615 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.352578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbwns" event={"ID":"2486a2b9-8d95-49fe-8e7f-5089ec201788","Type":"ContainerStarted","Data":"6a765f9b7d7abde89c9a586c95d2a4c0fd0064720130f3366f30089b1f264d10"}
Jul 15 19:38:22.826939 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.826327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:22.826939 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.826504    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:22.826939 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.826569    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs podName:b633058a-84da-4566-98b1-4e124a4b55ab nodeName:}" failed. No retries permitted until 2026-07-15 19:38:24.82654855 +0000 UTC m=+5.907742904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs") pod "network-metrics-daemon-ffdd6" (UID: "b633058a-84da-4566-98b1-4e124a4b55ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:22.926875 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:22.926834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:22.927054 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.927004    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:22.927112 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:22.927087    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret podName:0af40cba-63c1-44af-929b-cccdcdeb732d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:24.927063613 +0000 UTC m=+6.008257975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret") pod "global-pull-secret-syncer-fmcqm" (UID: "0af40cba-63c1-44af-929b-cccdcdeb732d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:23.028340 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:23.027453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:23.028340 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:23.027856    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:23.028340 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:23.027881    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:23.028340 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:23.027909    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gwnkj for pod openshift-network-diagnostics/network-check-target-ft2wd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:23.028340 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:23.028068    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj podName:22d63025-972c-4239-b212-4ee5b2b815da nodeName:}" failed. No retries permitted until 2026-07-15 19:38:25.027949054 +0000 UTC m=+6.109143420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwnkj" (UniqueName: "kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj") pod "network-check-target-ft2wd" (UID: "22d63025-972c-4239-b212-4ee5b2b815da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:23.243738 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:23.243621    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 19:33:21 +0000 UTC" deadline="2028-05-02 14:58:31.263177538 +0000 UTC"
Jul 15 19:38:23.243738 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:23.243681    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15763h20m8.01950134s"
Jul 15 19:38:23.328615 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:23.327941    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:23.328615 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:23.328072    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:23.328615 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:23.328461    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:23.328615 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:23.328556    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:23.370892 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:23.370368    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" event={"ID":"fc266b970294ca7e6b02e58f7dfbfaf7","Type":"ContainerStarted","Data":"d2feff2fef4cf1f1fcd1e00f65cb6b65f033194d3047045f1b44e5040ba67b22"}
Jul 15 19:38:24.326746 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:24.326236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:24.326746 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:24.326375    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:24.390711 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:24.390670    2576 generic.go:356] "Generic (PLEG): container finished" podID="b41c40da60a15333861b842213a29712" containerID="07ce8ef40a9ce293dad8919739cde231f4f0fc6b5c44f0e294cd7505b10f82fb" exitCode=0
Jul 15 19:38:24.391373 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:24.391347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"b41c40da60a15333861b842213a29712","Type":"ContainerDied","Data":"07ce8ef40a9ce293dad8919739cde231f4f0fc6b5c44f0e294cd7505b10f82fb"}
Jul 15 19:38:24.409055 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:24.408995    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-48.ec2.internal" podStartSLOduration=4.408947551 podStartE2EDuration="4.408947551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:23.386304211 +0000 UTC m=+4.467498598" watchObservedRunningTime="2026-07-15 19:38:24.408947551 +0000 UTC m=+5.490141913"
Jul 15 19:38:24.846678 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:24.846641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:24.846876 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:24.846781    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:24.846876 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:24.846847    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs podName:b633058a-84da-4566-98b1-4e124a4b55ab nodeName:}" failed. No retries permitted until 2026-07-15 19:38:28.846824872 +0000 UTC m=+9.928019223 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs") pod "network-metrics-daemon-ffdd6" (UID: "b633058a-84da-4566-98b1-4e124a4b55ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:24.947979 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:24.947943    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:24.948199 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:24.948174    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:24.948284 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:24.948251    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret podName:0af40cba-63c1-44af-929b-cccdcdeb732d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:28.948232929 +0000 UTC m=+10.029427272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret") pod "global-pull-secret-syncer-fmcqm" (UID: "0af40cba-63c1-44af-929b-cccdcdeb732d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:25.048876 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:25.048836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:25.049058 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:25.049044    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:25.049117 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:25.049066    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:25.049117 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:25.049079    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gwnkj for pod openshift-network-diagnostics/network-check-target-ft2wd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:25.049255 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:25.049140    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj podName:22d63025-972c-4239-b212-4ee5b2b815da nodeName:}" failed. No retries permitted until 2026-07-15 19:38:29.049119683 +0000 UTC m=+10.130314035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwnkj" (UniqueName: "kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj") pod "network-check-target-ft2wd" (UID: "22d63025-972c-4239-b212-4ee5b2b815da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:25.326674 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:25.326620    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:25.326830 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:25.326783    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:25.327102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:25.326839    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:25.327102 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:25.326929    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:26.326299 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:26.325882    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:26.326299 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:26.326003    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:27.327192 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:27.326657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:27.327192 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:27.326791    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:27.327192 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:27.326657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:27.327192 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:27.326915    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:28.326221 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:28.326009    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:28.326221 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:28.326179    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:28.884447 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:28.884406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:28.884894 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:28.884598    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:28.884894 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:28.884664    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs podName:b633058a-84da-4566-98b1-4e124a4b55ab nodeName:}" failed. No retries permitted until 2026-07-15 19:38:36.88464603 +0000 UTC m=+17.965840384 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs") pod "network-metrics-daemon-ffdd6" (UID: "b633058a-84da-4566-98b1-4e124a4b55ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:28.984894 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:28.984851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:28.985065 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:28.985025    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:28.985129 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:28.985102    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret podName:0af40cba-63c1-44af-929b-cccdcdeb732d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:36.985081327 +0000 UTC m=+18.066275684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret") pod "global-pull-secret-syncer-fmcqm" (UID: "0af40cba-63c1-44af-929b-cccdcdeb732d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:29.086322 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:29.085666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:29.086322 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:29.085861    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:29.086322 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:29.085884    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:29.086322 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:29.085897    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gwnkj for pod openshift-network-diagnostics/network-check-target-ft2wd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:29.086322 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:29.085974    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj podName:22d63025-972c-4239-b212-4ee5b2b815da nodeName:}" failed. No retries permitted until 2026-07-15 19:38:37.085944157 +0000 UTC m=+18.167138499 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwnkj" (UniqueName: "kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj") pod "network-check-target-ft2wd" (UID: "22d63025-972c-4239-b212-4ee5b2b815da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:29.327367 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:29.327334    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:29.327544 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:29.327442    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:29.327544 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:29.327478    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:29.327660 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:29.327599    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:30.326129 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:30.325968    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:30.326129 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:30.326120    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:31.326277 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:31.326243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:31.326733 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:31.326253    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:31.326733 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:31.326390    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:31.326733 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:31.326465    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:32.326493 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:32.326461    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:32.326842 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:32.326566    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:33.325621 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:33.325591    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:33.325807 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:33.325712    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:33.325807 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:33.325747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:33.325921 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:33.325809    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:34.325819 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:34.325781    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:34.326330 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:34.325933    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:35.326575 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:35.326539    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:35.326575 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:35.326574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:35.327100 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:35.326664    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:35.327100 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:35.326722    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:36.326518 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:36.326480    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:36.326779 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:36.326605    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:36.945892 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:36.945854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:36.946060 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:36.945997    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:36.946060 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:36.946059    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs podName:b633058a-84da-4566-98b1-4e124a4b55ab nodeName:}" failed. No retries permitted until 2026-07-15 19:38:52.94604271 +0000 UTC m=+34.027237053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs") pod "network-metrics-daemon-ffdd6" (UID: "b633058a-84da-4566-98b1-4e124a4b55ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:37.047210 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:37.047149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:37.047371 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:37.047316    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:37.047435 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:37.047394    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret podName:0af40cba-63c1-44af-929b-cccdcdeb732d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:53.047372948 +0000 UTC m=+34.128567291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret") pod "global-pull-secret-syncer-fmcqm" (UID: "0af40cba-63c1-44af-929b-cccdcdeb732d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:37.148145 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:37.148104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:37.148337 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:37.148302    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:37.148337 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:37.148327    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:37.148444 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:37.148342    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gwnkj for pod openshift-network-diagnostics/network-check-target-ft2wd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:37.148444 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:37.148408    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj podName:22d63025-972c-4239-b212-4ee5b2b815da nodeName:}" failed. No retries permitted until 2026-07-15 19:38:53.148388019 +0000 UTC m=+34.229582361 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwnkj" (UniqueName: "kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj") pod "network-check-target-ft2wd" (UID: "22d63025-972c-4239-b212-4ee5b2b815da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:37.326127 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:37.326090    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:37.326334 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:37.326246    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:37.326334 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:37.326299    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:37.326448 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:37.326400    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:38.326019 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:38.325981    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:38.326416 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:38.326126    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:39.326827 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:39.326795    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:39.327300 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:39.326887    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:39.327300 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:39.326969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:39.327300 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:39.327066    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:40.325642 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:40.325607    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:40.325829 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:40.325743    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:41.326155 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.325953    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:41.327081 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.325999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:41.327081 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:41.326268    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:41.327081 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:41.326323    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:41.426840 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.426808    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" event={"ID":"b41c40da60a15333861b842213a29712","Type":"ContainerStarted","Data":"13115e2d5545afc6ff334b54d11910a1155f75af8cdd8037f942d0be73c269e8"}
Jul 15 19:38:41.428148 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.428124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h6rbr" event={"ID":"8e4e4433-bdec-4dad-8a62-f121bc45d0e6","Type":"ContainerStarted","Data":"cd725c3986faa025e8d52a848e95b39d817bb49771cf6c05de1d76caa05cfed0"}
Jul 15 19:38:41.429553 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.429531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w79bp" event={"ID":"6380b7a7-82b7-4171-901e-540e296eb180","Type":"ContainerStarted","Data":"c1ddb6fb1e88278cac18a89c435f079b14f4f0b2f663fd21b9e823b82b23933a"}
Jul 15 19:38:41.430733 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.430713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rkkl8" event={"ID":"c220f879-813d-4809-8415-17c99b43300c","Type":"ContainerStarted","Data":"39180d99a3c802f38342ebb27df6295342c443a9beea950c051bcea8285628d7"}
Jul 15 19:38:41.432278 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.432259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"344dc695a49519677a6ed6d15b3f51fc051445dae22662ac71b2422c425e2ea6"}
Jul 15 19:38:41.433582 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.433563    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea3e77ca-fbaf-40df-ba83-c49fb7d98509" containerID="cb4a227b315c35de40d14957e1b1d2f794599266e22926ee173f9390f2a53af2" exitCode=0
Jul 15 19:38:41.433663 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.433623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" event={"ID":"ea3e77ca-fbaf-40df-ba83-c49fb7d98509","Type":"ContainerDied","Data":"cb4a227b315c35de40d14957e1b1d2f794599266e22926ee173f9390f2a53af2"}
Jul 15 19:38:41.435230 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.435211    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-brbhw" event={"ID":"e5953ff9-c877-41a2-877f-e74120fa7580","Type":"ContainerStarted","Data":"47c59615b79eef0a3b2336c2b2b2a9c060fe983f6410a03e972eebb775b8533c"}
Jul 15 19:38:41.436616 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.436595    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-shvrr" event={"ID":"e235c3ae-a21d-41b6-a3aa-729a0849eb4b","Type":"ContainerStarted","Data":"f9790b96ece8f6c9e9cf33648eaee045bdb16b97dea8cc90af68c16de7b496f6"}
Jul 15 19:38:41.437990 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.437953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9" event={"ID":"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081","Type":"ContainerStarted","Data":"f3c97d3cb8e7329912578df34d6a15739dfb06d9a3f8b3f8c678c5ce56c8e1d2"}
Jul 15 19:38:41.445887 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.445849    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-48.ec2.internal" podStartSLOduration=21.445838411 podStartE2EDuration="21.445838411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:41.445099877 +0000 UTC m=+22.526294242" watchObservedRunningTime="2026-07-15 19:38:41.445838411 +0000 UTC m=+22.527032772"
Jul 15 19:38:41.464650 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.464611    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h6rbr" podStartSLOduration=3.031812479 podStartE2EDuration="22.464596921s" totalImagesPullingTime="19.432784442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:41.464102558 +0000 UTC m=+22.545296918" watchObservedRunningTime="2026-07-15 19:38:41.464596921 +0000 UTC m=+22.545791282"
Jul 15 19:38:41.481483 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.481440    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rkkl8" podStartSLOduration=11.594934511 podStartE2EDuration="22.481427804s" totalImagesPullingTime="10.886493293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:41.480839576 +0000 UTC m=+22.562033935" watchObservedRunningTime="2026-07-15 19:38:41.481427804 +0000 UTC m=+22.562622164"
Jul 15 19:38:41.502779 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.502736    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w79bp" podStartSLOduration=3.087233152 podStartE2EDuration="22.502723877s" totalImagesPullingTime="19.415490725s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:41.502383632 +0000 UTC m=+22.583577992" watchObservedRunningTime="2026-07-15 19:38:41.502723877 +0000 UTC m=+22.583918238"
Jul 15 19:38:41.556021 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.555890    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-brbhw" podStartSLOduration=3.169035672 podStartE2EDuration="22.555875253s" totalImagesPullingTime="19.386839581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:41.519416932 +0000 UTC m=+22.600611292" watchObservedRunningTime="2026-07-15 19:38:41.555875253 +0000 UTC m=+22.637069613"
Jul 15 19:38:41.579958 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:41.579915    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-shvrr" podStartSLOduration=3.158038404 podStartE2EDuration="22.579900471s" totalImagesPullingTime="19.421862067s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:41.579518513 +0000 UTC m=+22.660712873" watchObservedRunningTime="2026-07-15 19:38:41.579900471 +0000 UTC m=+22.661094832"
Jul 15 19:38:42.199370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.199342    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:42.200387 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.200365    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:42.326429 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.326394    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:42.326861 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:42.326515    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:42.444458 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.444422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"5218bffcd22015a50e4fe9e9c325743514ed5bf2b9eefca6b0cb1f8412a19794"}
Jul 15 19:38:42.444600 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.444510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"1a30992abc2c0dbe6b64431256ffaa52be8a64680faf967792cab93a61b3ae0a"}
Jul 15 19:38:42.444600 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.444559    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"72696d419cf24d9f54a9e0b08a92f4346b54544b4a5746eb0f011752cbdd35ee"}
Jul 15 19:38:42.444711 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.444605    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"43c33b9c127ede8bc3506352b449cda4cb6166302ea58e8b7f0cefb8cc9d9991"}
Jul 15 19:38:42.444711 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.444655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"63f0a223aa1358acecf79c470a718989d0ffa5e6a43282bb3cc583f98852b449"}
Jul 15 19:38:42.445379 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.445329    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:42.445677 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.445652    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rkkl8"
Jul 15 19:38:42.574452 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:42.574411    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 19:38:43.277139 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:43.277047    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T19:38:42.574431966Z","UUID":"4ef5dd95-ef13-4d00-8fdc-3992cd0a589a","Handler":null,"Name":"","Endpoint":""}
Jul 15 19:38:43.278618 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:43.278591    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 19:38:43.278745 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:43.278630    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 19:38:43.326246 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:43.326217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:43.326433 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:43.326255    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:43.326433 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:43.326342    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:43.326842 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:43.326535    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:43.449152 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:43.449113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9" event={"ID":"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081","Type":"ContainerStarted","Data":"3e931852405ee651ebc97f43ff480a7c72552f2355a5e6098dab9cd487bfea7b"}
Jul 15 19:38:43.450834 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:43.450803    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbwns" event={"ID":"2486a2b9-8d95-49fe-8e7f-5089ec201788","Type":"ContainerStarted","Data":"ee4912bca89cf28ea1470ecd518a7b677984ffb0d52f80a0e336f2ba92f8eaaa"}
Jul 15 19:38:43.466474 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:43.466399    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lbwns" podStartSLOduration=5.041996286 podStartE2EDuration="24.466384227s" totalImagesPullingTime="19.424387941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:43.465683189 +0000 UTC m=+24.546877563" watchObservedRunningTime="2026-07-15 19:38:43.466384227 +0000 UTC m=+24.547578589"
Jul 15 19:38:44.325953 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:44.325922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:44.326116 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:44.326038    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:45.326536 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:45.326336    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:45.327107 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:45.326364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:45.327107 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:45.326624    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:45.327107 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:45.326723    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:46.326392 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:46.326333    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:46.326516 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:46.326431    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:46.459713 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:46.459673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9" event={"ID":"1cf3a2f8-73b8-4dcf-8e5d-9c403a3c9081","Type":"ContainerStarted","Data":"6e672e9dcce6bc95cfdc6e04ae51940660cbae03400de14e9ee3e72393e7fa3c"}
Jul 15 19:38:46.465637 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:46.465607    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"198a9e9ce77f464598aac78f60671a47e01b2d376563b0edf35f895b398a2da0"}
Jul 15 19:38:46.467247 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:46.467225    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea3e77ca-fbaf-40df-ba83-c49fb7d98509" containerID="7d7aa3f0a71172f2f39843759ac6a24cc966e6c41bd226b468a7895a85132faf" exitCode=0
Jul 15 19:38:46.467353 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:46.467255    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" event={"ID":"ea3e77ca-fbaf-40df-ba83-c49fb7d98509","Type":"ContainerDied","Data":"7d7aa3f0a71172f2f39843759ac6a24cc966e6c41bd226b468a7895a85132faf"}
Jul 15 19:38:46.477902 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:46.477857    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s6qq9" podStartSLOduration=3.354104332 podStartE2EDuration="27.477841451s" totalImagesPullingTime="24.123737119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:46.47772987 +0000 UTC m=+27.558924230" watchObservedRunningTime="2026-07-15 19:38:46.477841451 +0000 UTC m=+27.559035813"
Jul 15 19:38:47.326552 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:47.326514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:47.326735 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:47.326649    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:47.326735 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:47.326693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:47.326805 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:47.326781    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:48.326616 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:48.326349    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:48.326936 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:48.326737    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:48.474580 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:48.474463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" event={"ID":"9dccbb46-cadc-40a5-8621-6dd067fa1943","Type":"ContainerStarted","Data":"31726704b9993b65a08cea638840a01bb7fdde791d508670ae5bcca7f0173362"}
Jul 15 19:38:48.474749 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:48.474695    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:48.476587 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:48.476559    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea3e77ca-fbaf-40df-ba83-c49fb7d98509" containerID="72c909c1d991e05b2193d9015025f06b38887cc31e5a85e8e235cc686afbdae8" exitCode=0
Jul 15 19:38:48.476697 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:48.476610    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" event={"ID":"ea3e77ca-fbaf-40df-ba83-c49fb7d98509","Type":"ContainerDied","Data":"72c909c1d991e05b2193d9015025f06b38887cc31e5a85e8e235cc686afbdae8"}
Jul 15 19:38:48.490811 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:48.490788    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:48.505452 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:48.505408    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6" podStartSLOduration=9.882953917 podStartE2EDuration="29.505393333s" totalImagesPullingTime="19.622439416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:48.504947307 +0000 UTC m=+29.586141691" watchObservedRunningTime="2026-07-15 19:38:48.505393333 +0000 UTC m=+29.586587693"
Jul 15 19:38:49.327119 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:49.327081    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:49.327643 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:49.327207    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:49.327643 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:49.327246    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:49.327643 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:49.327324    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:49.479897 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:49.479866    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:49.480057 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:49.479955    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:49.505116 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:49.505090    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:38:50.251768 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:50.251556    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fmcqm"]
Jul 15 19:38:50.251959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:50.251893    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:50.252028 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:50.252000    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:50.254750 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:50.254722    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ffdd6"]
Jul 15 19:38:50.255062 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:50.254885    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:50.255126 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:50.255038    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:50.255608 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:50.255581    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ft2wd"]
Jul 15 19:38:50.255731 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:50.255697    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:50.255802 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:50.255783    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:50.483781 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:50.483749    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea3e77ca-fbaf-40df-ba83-c49fb7d98509" containerID="fcd96532991d9c1acebb9b7bb42c7e885f080071696891646b02c34ebad49a9c" exitCode=0
Jul 15 19:38:50.484224 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:50.483831    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" event={"ID":"ea3e77ca-fbaf-40df-ba83-c49fb7d98509","Type":"ContainerDied","Data":"fcd96532991d9c1acebb9b7bb42c7e885f080071696891646b02c34ebad49a9c"}
Jul 15 19:38:52.326616 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:52.326590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:52.327127 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:52.326590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:52.327127 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:52.326710    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:52.327127 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:52.326590    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:52.327127 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:52.326798    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:52.327127 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:52.326859    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:52.965428 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:52.965377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:52.965589 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:52.965558    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:52.965670 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:52.965628    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs podName:b633058a-84da-4566-98b1-4e124a4b55ab nodeName:}" failed. No retries permitted until 2026-07-15 19:39:24.965607631 +0000 UTC m=+66.046801986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs") pod "network-metrics-daemon-ffdd6" (UID: "b633058a-84da-4566-98b1-4e124a4b55ab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 19:38:53.066336 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:53.066302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:53.066496 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:53.066418    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:53.066496 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:53.066467    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret podName:0af40cba-63c1-44af-929b-cccdcdeb732d nodeName:}" failed. No retries permitted until 2026-07-15 19:39:25.066454258 +0000 UTC m=+66.147648597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret") pod "global-pull-secret-syncer-fmcqm" (UID: "0af40cba-63c1-44af-929b-cccdcdeb732d") : object "kube-system"/"original-pull-secret" not registered
Jul 15 19:38:53.167243 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:53.167208    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:53.167427 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:53.167354    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 19:38:53.167427 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:53.167370    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 19:38:53.167427 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:53.167379    2576 projected.go:196] Error preparing data for projected volume kube-api-access-gwnkj for pod openshift-network-diagnostics/network-check-target-ft2wd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:53.167427 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:53.167426    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj podName:22d63025-972c-4239-b212-4ee5b2b815da nodeName:}" failed. No retries permitted until 2026-07-15 19:39:25.167412869 +0000 UTC m=+66.248607207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwnkj" (UniqueName: "kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj") pod "network-check-target-ft2wd" (UID: "22d63025-972c-4239-b212-4ee5b2b815da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 19:38:54.326388 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.326353    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:54.326923 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.326357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:54.326923 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:54.326476    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fmcqm" podUID="0af40cba-63c1-44af-929b-cccdcdeb732d"
Jul 15 19:38:54.326923 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.326507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:54.326923 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:54.326610    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ft2wd" podUID="22d63025-972c-4239-b212-4ee5b2b815da"
Jul 15 19:38:54.326923 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:54.326689    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffdd6" podUID="b633058a-84da-4566-98b1-4e124a4b55ab"
Jul 15 19:38:54.668376 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.668313    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-brbhw_e5953ff9-c877-41a2-877f-e74120fa7580/dns-node-resolver/0.log"
Jul 15 19:38:54.752690 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.752654    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-48.ec2.internal" event="NodeReady"
Jul 15 19:38:54.752844 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.752815    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 19:38:54.790540 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.790505    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"]
Jul 15 19:38:54.796570 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.796537    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.799841 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.799816    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 19:38:54.799841 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.799824    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2tjcx\""
Jul 15 19:38:54.800026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.799880    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 19:38:54.800026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.799996    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 19:38:54.805595 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.804557    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4dds4"]
Jul 15 19:38:54.806622 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.806595    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 19:38:54.810156 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.809207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4dds4"
Jul 15 19:38:54.810156 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.809747    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ss47p"]
Jul 15 19:38:54.812286 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.812258    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t8bxm\""
Jul 15 19:38:54.812286 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.812274    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 19:38:54.812806 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.812629    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 19:38:54.812990 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.812969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 19:38:54.815150 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.815132    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"]
Jul 15 19:38:54.815287 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.815269    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:54.818641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.818583    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 19:38:54.818641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.818593    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 19:38:54.818797 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.818679    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 19:38:54.818959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.818937    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hjcsl\""
Jul 15 19:38:54.818959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.818956    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 19:38:54.823968 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.823947    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ss47p"]
Jul 15 19:38:54.831259 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.831234    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4dds4"]
Jul 15 19:38:54.837946 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.837920    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9vtsr"]
Jul 15 19:38:54.841905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.841884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:54.844267 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.844252    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 19:38:54.844267 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.844261    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2fvq2\""
Jul 15 19:38:54.844542 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.844518    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 19:38:54.853030 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.853005    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vtsr"]
Jul 15 19:38:54.879034 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.878996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffdn7\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-kube-api-access-ffdn7\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.879236 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.879050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-trusted-ca\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.879236 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.879089    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-certificates\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.879236 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.879148    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.879236 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.879197    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-installation-pull-secrets\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.879440 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.879266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-image-registry-private-configuration\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.879440 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.879297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a36aff9-4c6f-4097-be5d-fed220e0608d-ca-trust-extracted\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.879440 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.879327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-bound-sa-token\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.980426 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.980396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.980547 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.980443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a272420b-2a9c-469e-ab0b-17788c1782ff-cert\") pod \"ingress-canary-4dds4\" (UID: \"a272420b-2a9c-469e-ab0b-17788c1782ff\") " pod="openshift-ingress-canary/ingress-canary-4dds4"
Jul 15 19:38:54.980547 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.980493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:54.980547 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.980519    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:54.980668 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.980553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-installation-pull-secrets\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.980668 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:54.980572    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:38:54.980668 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:54.980591    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d: secret "image-registry-tls" not found
Jul 15 19:38:54.980795 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:54.980674    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls podName:3a36aff9-4c6f-4097-be5d-fed220e0608d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:55.480654156 +0000 UTC m=+36.561848515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls") pod "image-registry-5f9c6fdcd7-qdl8d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d") : secret "image-registry-tls" not found
Jul 15 19:38:54.980795 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.980760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-image-registry-private-configuration\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.980795 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.980791    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a36aff9-4c6f-4097-be5d-fed220e0608d-ca-trust-extracted\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.980982 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.980958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6tvk\" (UniqueName: \"kubernetes.io/projected/67fc290d-d259-4697-b316-63f352ccfe05-kube-api-access-m6tvk\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:54.981056 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-bound-sa-token\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.981056 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g87h9\" (UniqueName: \"kubernetes.io/projected/a272420b-2a9c-469e-ab0b-17788c1782ff-kube-api-access-g87h9\") pod \"ingress-canary-4dds4\" (UID: \"a272420b-2a9c-469e-ab0b-17788c1782ff\") " pod="openshift-ingress-canary/ingress-canary-4dds4"
Jul 15 19:38:54.981179 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981111    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffdn7\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-kube-api-access-ffdn7\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.981179 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/800dff05-96b8-4243-85ac-6305f7e82630-data-volume\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:54.981298 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981180    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67fc290d-d259-4697-b316-63f352ccfe05-tmp-dir\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:54.981298 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981202    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a36aff9-4c6f-4097-be5d-fed220e0608d-ca-trust-extracted\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.981298 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-trusted-ca\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.981595 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66cgc\" (UniqueName: \"kubernetes.io/projected/800dff05-96b8-4243-85ac-6305f7e82630-kube-api-access-66cgc\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:54.981595 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:54.981595 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981573    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/800dff05-96b8-4243-85ac-6305f7e82630-crio-socket\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:54.981749 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67fc290d-d259-4697-b316-63f352ccfe05-config-volume\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:54.981749 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.981635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-certificates\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.982175 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.982134    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-certificates\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.983516 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.982487    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-trusted-ca\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.986300 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.985667    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-installation-pull-secrets\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.986300 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.985823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-image-registry-private-configuration\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.993391 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.993352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-bound-sa-token\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:54.994455 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:54.994436    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffdn7\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-kube-api-access-ffdn7\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:55.082915 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.082885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a272420b-2a9c-469e-ab0b-17788c1782ff-cert\") pod \"ingress-canary-4dds4\" (UID: \"a272420b-2a9c-469e-ab0b-17788c1782ff\") " pod="openshift-ingress-canary/ingress-canary-4dds4"
Jul 15 19:38:55.083052 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.082930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.083052 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.082956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.083052 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.082999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6tvk\" (UniqueName: \"kubernetes.io/projected/67fc290d-d259-4697-b316-63f352ccfe05-kube-api-access-m6tvk\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:55.083052 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g87h9\" (UniqueName: \"kubernetes.io/projected/a272420b-2a9c-469e-ab0b-17788c1782ff-kube-api-access-g87h9\") pod \"ingress-canary-4dds4\" (UID: \"a272420b-2a9c-469e-ab0b-17788c1782ff\") " pod="openshift-ingress-canary/ingress-canary-4dds4"
Jul 15 19:38:55.083052 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.083038    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:38:55.083324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/800dff05-96b8-4243-85ac-6305f7e82630-data-volume\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.083324 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.083101    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:38:55.083324 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.083128    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm podName:800dff05-96b8-4243-85ac-6305f7e82630 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:55.583109813 +0000 UTC m=+36.664304183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ss47p" (UID: "800dff05-96b8-4243-85ac-6305f7e82630") : configmap "kube-rbac-proxy" not found
Jul 15 19:38:55.083324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67fc290d-d259-4697-b316-63f352ccfe05-tmp-dir\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:55.083324 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.083225    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls podName:800dff05-96b8-4243-85ac-6305f7e82630 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:55.583153454 +0000 UTC m=+36.664347814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ss47p" (UID: "800dff05-96b8-4243-85ac-6305f7e82630") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:38:55.083324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66cgc\" (UniqueName: \"kubernetes.io/projected/800dff05-96b8-4243-85ac-6305f7e82630-kube-api-access-66cgc\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.083324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:55.083680 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/800dff05-96b8-4243-85ac-6305f7e82630-crio-socket\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.083680 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083363    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67fc290d-d259-4697-b316-63f352ccfe05-config-volume\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:55.083680 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67fc290d-d259-4697-b316-63f352ccfe05-tmp-dir\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:55.083680 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.083517    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:38:55.083680 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.083571    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls podName:67fc290d-d259-4697-b316-63f352ccfe05 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:55.583555179 +0000 UTC m=+36.664749522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls") pod "dns-default-9vtsr" (UID: "67fc290d-d259-4697-b316-63f352ccfe05") : secret "dns-default-metrics-tls" not found
Jul 15 19:38:55.083846 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/800dff05-96b8-4243-85ac-6305f7e82630-crio-socket\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.083846 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67fc290d-d259-4697-b316-63f352ccfe05-config-volume\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:55.083972 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.083956    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/800dff05-96b8-4243-85ac-6305f7e82630-data-volume\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.085641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.085625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a272420b-2a9c-469e-ab0b-17788c1782ff-cert\") pod \"ingress-canary-4dds4\" (UID: \"a272420b-2a9c-469e-ab0b-17788c1782ff\") " pod="openshift-ingress-canary/ingress-canary-4dds4"
Jul 15 19:38:55.093708 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.093678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66cgc\" (UniqueName: \"kubernetes.io/projected/800dff05-96b8-4243-85ac-6305f7e82630-kube-api-access-66cgc\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.093895 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.093880    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6tvk\" (UniqueName: \"kubernetes.io/projected/67fc290d-d259-4697-b316-63f352ccfe05-kube-api-access-m6tvk\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:55.094400 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.094379    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g87h9\" (UniqueName: \"kubernetes.io/projected/a272420b-2a9c-469e-ab0b-17788c1782ff-kube-api-access-g87h9\") pod \"ingress-canary-4dds4\" (UID: \"a272420b-2a9c-469e-ab0b-17788c1782ff\") " pod="openshift-ingress-canary/ingress-canary-4dds4"
Jul 15 19:38:55.120523 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.120497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4dds4"
Jul 15 19:38:55.272869 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.272692    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4dds4"]
Jul 15 19:38:55.276027 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:38:55.276003    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda272420b_2a9c_469e_ab0b_17788c1782ff.slice/crio-22725cecc928ac3947b1fb71c487af84a0c0bc56446bdddc29e9d8408f0774c4 WatchSource:0}: Error finding container 22725cecc928ac3947b1fb71c487af84a0c0bc56446bdddc29e9d8408f0774c4: Status 404 returned error can't find the container with id 22725cecc928ac3947b1fb71c487af84a0c0bc56446bdddc29e9d8408f0774c4
Jul 15 19:38:55.487358 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.487275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:55.487913 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.487428    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:38:55.487913 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.487447    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d: secret "image-registry-tls" not found
Jul 15 19:38:55.487913 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.487507    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls podName:3a36aff9-4c6f-4097-be5d-fed220e0608d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:56.487483627 +0000 UTC m=+37.568677967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls") pod "image-registry-5f9c6fdcd7-qdl8d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d") : secret "image-registry-tls" not found
Jul 15 19:38:55.502848 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.502813    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea3e77ca-fbaf-40df-ba83-c49fb7d98509" containerID="2a7e98f6a04868d992e0283f78e1db2b7edd4ab75728db1587e5c2b645a41bf9" exitCode=0
Jul 15 19:38:55.502986 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.502891    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" event={"ID":"ea3e77ca-fbaf-40df-ba83-c49fb7d98509","Type":"ContainerDied","Data":"2a7e98f6a04868d992e0283f78e1db2b7edd4ab75728db1587e5c2b645a41bf9"}
Jul 15 19:38:55.503996 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.503976    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4dds4" event={"ID":"a272420b-2a9c-469e-ab0b-17788c1782ff","Type":"ContainerStarted","Data":"22725cecc928ac3947b1fb71c487af84a0c0bc56446bdddc29e9d8408f0774c4"}
Jul 15 19:38:55.587907 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.587880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.588023 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.587913    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:55.588023 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.588007    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:38:55.588126 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.588075    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm podName:800dff05-96b8-4243-85ac-6305f7e82630 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:56.588055595 +0000 UTC m=+37.669249944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ss47p" (UID: "800dff05-96b8-4243-85ac-6305f7e82630") : configmap "kube-rbac-proxy" not found
Jul 15 19:38:55.588126 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.588107    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:38:55.588243 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.588134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:55.588243 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.588197    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls podName:800dff05-96b8-4243-85ac-6305f7e82630 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:56.588152432 +0000 UTC m=+37.669346771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ss47p" (UID: "800dff05-96b8-4243-85ac-6305f7e82630") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:38:55.588243 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.588226    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:38:55.588362 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:55.588263    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls podName:67fc290d-d259-4697-b316-63f352ccfe05 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:56.588253743 +0000 UTC m=+37.669448082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls") pod "dns-default-9vtsr" (UID: "67fc290d-d259-4697-b316-63f352ccfe05") : secret "dns-default-metrics-tls" not found
Jul 15 19:38:55.851951 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:55.851924    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-shvrr_e235c3ae-a21d-41b6-a3aa-729a0849eb4b/node-ca/0.log"
Jul 15 19:38:56.326367 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.326335    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:38:56.326367 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.326372    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:38:56.326571 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.326335    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:38:56.330099 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.330074    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:38:56.330246 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.330121    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lw97b\""
Jul 15 19:38:56.330246 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.330136    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vqmsl\""
Jul 15 19:38:56.330246 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.330176    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:38:56.330246 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.330124    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:38:56.330402 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.330082    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:38:56.496779 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.496743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:56.497238 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.496875    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:38:56.497238 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.496892    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d: secret "image-registry-tls" not found
Jul 15 19:38:56.497238 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.496953    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls podName:3a36aff9-4c6f-4097-be5d-fed220e0608d nodeName:}" failed. No retries permitted until 2026-07-15 19:38:58.496936611 +0000 UTC m=+39.578130968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls") pod "image-registry-5f9c6fdcd7-qdl8d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d") : secret "image-registry-tls" not found
Jul 15 19:38:56.510252 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.510220    2576 generic.go:356] "Generic (PLEG): container finished" podID="ea3e77ca-fbaf-40df-ba83-c49fb7d98509" containerID="cb1f55c72b2f47cfffa97de3aac7b8bc01c13ee74604540991efc3521b951e86" exitCode=0
Jul 15 19:38:56.510381 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.510258    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" event={"ID":"ea3e77ca-fbaf-40df-ba83-c49fb7d98509","Type":"ContainerDied","Data":"cb1f55c72b2f47cfffa97de3aac7b8bc01c13ee74604540991efc3521b951e86"}
Jul 15 19:38:56.598142 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.598116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:56.598276 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.598261    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 19:38:56.598326 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.598275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:56.598370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:56.598340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:56.598432 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.598384    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm podName:800dff05-96b8-4243-85ac-6305f7e82630 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:58.598354355 +0000 UTC m=+39.679548707 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ss47p" (UID: "800dff05-96b8-4243-85ac-6305f7e82630") : configmap "kube-rbac-proxy" not found
Jul 15 19:38:56.598485 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.598430    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:38:56.598485 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.598432    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:38:56.598485 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.598477    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls podName:67fc290d-d259-4697-b316-63f352ccfe05 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:58.598462759 +0000 UTC m=+39.679657113 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls") pod "dns-default-9vtsr" (UID: "67fc290d-d259-4697-b316-63f352ccfe05") : secret "dns-default-metrics-tls" not found
Jul 15 19:38:56.598602 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:56.598490    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls podName:800dff05-96b8-4243-85ac-6305f7e82630 nodeName:}" failed. No retries permitted until 2026-07-15 19:38:58.59848396 +0000 UTC m=+39.679678299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ss47p" (UID: "800dff05-96b8-4243-85ac-6305f7e82630") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:38:57.517574 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:57.517540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" event={"ID":"ea3e77ca-fbaf-40df-ba83-c49fb7d98509","Type":"ContainerStarted","Data":"0f298028963248d42ab1290763ebed11126f7c05dfb053008ab6aa9883606327"}
Jul 15 19:38:57.541945 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:57.541883    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zvxbg" podStartSLOduration=8.025579508 podStartE2EDuration="38.541860475s" totalImagesPullingTime="30.516280967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:57.540990977 +0000 UTC m=+38.622185357" watchObservedRunningTime="2026-07-15 19:38:57.541860475 +0000 UTC m=+38.623054838"
Jul 15 19:38:58.514467 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:58.514436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:38:58.514676 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:58.514570    2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 19:38:58.514676 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:58.514590    2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d: secret "image-registry-tls" not found
Jul 15 19:38:58.514676 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:58.514642    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls podName:3a36aff9-4c6f-4097-be5d-fed220e0608d nodeName:}" failed. No retries permitted until 2026-07-15 19:39:02.514626944 +0000 UTC m=+43.595821283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls") pod "image-registry-5f9c6fdcd7-qdl8d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d") : secret "image-registry-tls" not found
Jul 15 19:38:58.615449 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:58.615262    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:38:58.615799 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:58.615481    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:58.615799 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:58.615419    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 19:38:58.615799 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:58.615502    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:58.615799 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:58.615556    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls podName:67fc290d-d259-4697-b316-63f352ccfe05 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:02.615541851 +0000 UTC m=+43.696736190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls") pod "dns-default-9vtsr" (UID: "67fc290d-d259-4697-b316-63f352ccfe05") : secret "dns-default-metrics-tls" not found
Jul 15 19:38:58.615799 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:58.615603    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:38:58.615799 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:38:58.615661    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls podName:800dff05-96b8-4243-85ac-6305f7e82630 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:02.615643938 +0000 UTC m=+43.696838278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ss47p" (UID: "800dff05-96b8-4243-85ac-6305f7e82630") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:38:58.616015 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:58.615965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800dff05-96b8-4243-85ac-6305f7e82630-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:38:59.526489 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:59.526458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4dds4" event={"ID":"a272420b-2a9c-469e-ab0b-17788c1782ff","Type":"ContainerStarted","Data":"db6cc1ed7e07c54a799e02a45e94c4cbb3f54471db271071bcca98292a542af6"}
Jul 15 19:38:59.547378 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:38:59.547327    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4dds4" podStartSLOduration=2.2875790670000002 podStartE2EDuration="5.547310622s" totalImagesPullingTime="3.259731555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:38:59.546947957 +0000 UTC m=+40.628142351" watchObservedRunningTime="2026-07-15 19:38:59.547310622 +0000 UTC m=+40.628505009"
Jul 15 19:39:02.547727 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.547687    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:39:02.551764 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.551743    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") pod \"image-registry-5f9c6fdcd7-qdl8d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") " pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:39:02.610754 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.610714    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:39:02.648599 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.648568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:39:02.648755 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.648627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:39:02.648755 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:39:02.648732    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 19:39:02.648839 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:39:02.648798    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls podName:800dff05-96b8-4243-85ac-6305f7e82630 nodeName:}" failed. No retries permitted until 2026-07-15 19:39:10.648781402 +0000 UTC m=+51.729975749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ss47p" (UID: "800dff05-96b8-4243-85ac-6305f7e82630") : secret "insights-runtime-extractor-tls" not found
Jul 15 19:39:02.650889 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.650873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67fc290d-d259-4697-b316-63f352ccfe05-metrics-tls\") pod \"dns-default-9vtsr\" (UID: \"67fc290d-d259-4697-b316-63f352ccfe05\") " pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:39:02.651785 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.651769    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:39:02.791489 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.791460    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"]
Jul 15 19:39:02.794920 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:02.794892    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a36aff9_4c6f_4097_be5d_fed220e0608d.slice/crio-61976dcfaf20a2dde6106ca43f512348fa0ec7df5c1fabd95af59a35ccc4d9e5 WatchSource:0}: Error finding container 61976dcfaf20a2dde6106ca43f512348fa0ec7df5c1fabd95af59a35ccc4d9e5: Status 404 returned error can't find the container with id 61976dcfaf20a2dde6106ca43f512348fa0ec7df5c1fabd95af59a35ccc4d9e5
Jul 15 19:39:02.821968 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:02.821941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vtsr"]
Jul 15 19:39:02.824915 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:02.824886    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67fc290d_d259_4697_b316_63f352ccfe05.slice/crio-2b9ad020ced1a2ae54bd7033fbe8f6d571f1efaf7128a49e29862ed8023d1737 WatchSource:0}: Error finding container 2b9ad020ced1a2ae54bd7033fbe8f6d571f1efaf7128a49e29862ed8023d1737: Status 404 returned error can't find the container with id 2b9ad020ced1a2ae54bd7033fbe8f6d571f1efaf7128a49e29862ed8023d1737
Jul 15 19:39:03.540923 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:03.538226    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d" event={"ID":"3a36aff9-4c6f-4097-be5d-fed220e0608d","Type":"ContainerStarted","Data":"1aafa18281cd4a217623bc4fee3003241e65fa48121c77b6fba598352de91b4c"}
Jul 15 19:39:03.540923 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:03.538325    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d" event={"ID":"3a36aff9-4c6f-4097-be5d-fed220e0608d","Type":"ContainerStarted","Data":"61976dcfaf20a2dde6106ca43f512348fa0ec7df5c1fabd95af59a35ccc4d9e5"}
Jul 15 19:39:03.540923 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:03.538550    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:39:03.540923 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:03.540217    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vtsr" event={"ID":"67fc290d-d259-4697-b316-63f352ccfe05","Type":"ContainerStarted","Data":"2b9ad020ced1a2ae54bd7033fbe8f6d571f1efaf7128a49e29862ed8023d1737"}
Jul 15 19:39:03.560528 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:03.560478    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d" podStartSLOduration=38.560462179 podStartE2EDuration="38.560462179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:03.559365513 +0000 UTC m=+44.640559886" watchObservedRunningTime="2026-07-15 19:39:03.560462179 +0000 UTC m=+44.641656547"
Jul 15 19:39:05.547730 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:05.547696    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vtsr" event={"ID":"67fc290d-d259-4697-b316-63f352ccfe05","Type":"ContainerStarted","Data":"849b327dd1f64a5c5e55d4699eb062aeff870ec23916743dc8aaa2f822445a71"}
Jul 15 19:39:05.548116 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:05.547755    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vtsr" event={"ID":"67fc290d-d259-4697-b316-63f352ccfe05","Type":"ContainerStarted","Data":"806ca658a45b46c498a721104097d8412faef2a3e5bca37aafe638f77ccbf446"}
Jul 15 19:39:05.548116 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:05.547893    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:39:05.566424 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:05.566371    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9vtsr" podStartSLOduration=9.256996422 podStartE2EDuration="11.566354805s" totalImagesPullingTime="2.309358383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:05.566087861 +0000 UTC m=+46.647282241" watchObservedRunningTime="2026-07-15 19:39:05.566354805 +0000 UTC m=+46.647549198"
Jul 15 19:39:10.717438 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:10.717397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:39:10.719684 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:10.719665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800dff05-96b8-4243-85ac-6305f7e82630-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ss47p\" (UID: \"800dff05-96b8-4243-85ac-6305f7e82630\") " pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:39:10.729684 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:10.729661    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ss47p"
Jul 15 19:39:10.899786 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:10.899753    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ss47p"]
Jul 15 19:39:10.903008 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:10.902983    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800dff05_96b8_4243_85ac_6305f7e82630.slice/crio-7669fbdb1b1f8a296f84b781eea37a48e70bd6f2511a817470632e2c95b7b945 WatchSource:0}: Error finding container 7669fbdb1b1f8a296f84b781eea37a48e70bd6f2511a817470632e2c95b7b945: Status 404 returned error can't find the container with id 7669fbdb1b1f8a296f84b781eea37a48e70bd6f2511a817470632e2c95b7b945
Jul 15 19:39:11.565145 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:11.565059    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ss47p" event={"ID":"800dff05-96b8-4243-85ac-6305f7e82630","Type":"ContainerStarted","Data":"7669fbdb1b1f8a296f84b781eea37a48e70bd6f2511a817470632e2c95b7b945"}
Jul 15 19:39:15.552796 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:15.552766    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9vtsr"
Jul 15 19:39:16.580584 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:16.580552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ss47p" event={"ID":"800dff05-96b8-4243-85ac-6305f7e82630","Type":"ContainerStarted","Data":"8ccefa83e970884db429fae16341f091f9978831a5c5c3320d058b378acfc7d6"}
Jul 15 19:39:17.231101 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.231069    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"]
Jul 15 19:39:17.235997 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.235963    2576 patch_prober.go:28] interesting pod/image-registry-5f9c6fdcd7-qdl8d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 19:39:17.236157 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.236022    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d" podUID="3a36aff9-4c6f-4097-be5d-fed220e0608d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:39:17.243123 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.243095    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-wpxdd"]
Jul 15 19:39:17.246080 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.246059    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-wpxdd"
Jul 15 19:39:17.249123 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.249025    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 19:39:17.249354 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.249331    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rfs48\""
Jul 15 19:39:17.249636 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.249341    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 19:39:17.262848 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.262820    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-wpxdd"]
Jul 15 19:39:17.351764 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.351734    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7b69fc78bd-58gq7"]
Jul 15 19:39:17.354589 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.354572    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.373270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.373237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vb4k\" (UniqueName: \"kubernetes.io/projected/1260b666-810e-4d01-8fa3-a6eb043af249-kube-api-access-4vb4k\") pod \"downloads-68c9cbb497-wpxdd\" (UID: \"1260b666-810e-4d01-8fa3-a6eb043af249\") " pod="openshift-console/downloads-68c9cbb497-wpxdd"
Jul 15 19:39:17.374439 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.374404    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b69fc78bd-58gq7"]
Jul 15 19:39:17.474399 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-ca-trust-extracted\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.474582 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-bound-sa-token\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.474582 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-registry-tls\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.474582 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-installation-pull-secrets\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.474747 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474591    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tbgs\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-kube-api-access-8tbgs\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.474747 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474630    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-registry-certificates\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.474747 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474681    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vb4k\" (UniqueName: \"kubernetes.io/projected/1260b666-810e-4d01-8fa3-a6eb043af249-kube-api-access-4vb4k\") pod \"downloads-68c9cbb497-wpxdd\" (UID: \"1260b666-810e-4d01-8fa3-a6eb043af249\") " pod="openshift-console/downloads-68c9cbb497-wpxdd"
Jul 15 19:39:17.474747 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-trusted-ca\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.474944 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.474762    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-image-registry-private-configuration\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.483294 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.483234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vb4k\" (UniqueName: \"kubernetes.io/projected/1260b666-810e-4d01-8fa3-a6eb043af249-kube-api-access-4vb4k\") pod \"downloads-68c9cbb497-wpxdd\" (UID: \"1260b666-810e-4d01-8fa3-a6eb043af249\") " pod="openshift-console/downloads-68c9cbb497-wpxdd"
Jul 15 19:39:17.557356 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.557316    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-wpxdd"
Jul 15 19:39:17.575541 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.575506    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-registry-tls\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.575705 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.575551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-installation-pull-secrets\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.575786 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.575758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tbgs\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-kube-api-access-8tbgs\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.575844 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.575824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-registry-certificates\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.575901 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.575863    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-trusted-ca\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.575953 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.575895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-image-registry-private-configuration\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.575953 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.575937    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-ca-trust-extracted\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.576040 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.575978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-bound-sa-token\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.576738 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.576708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-ca-trust-extracted\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.577242 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.577210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-trusted-ca\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.577242 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.577210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-registry-certificates\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.578827 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.578805    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-installation-pull-secrets\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.578930 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.578809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-image-registry-private-configuration\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.579103 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.579078    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-registry-tls\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.599303 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.599272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tbgs\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-kube-api-access-8tbgs\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.599701 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.599600    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00c089b1-d001-4b70-a79a-c5d1d68b7cb3-bound-sa-token\") pod \"image-registry-7b69fc78bd-58gq7\" (UID: \"00c089b1-d001-4b70-a79a-c5d1d68b7cb3\") " pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:17.664411 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:17.664374    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:19.808967 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:19.808936    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-wpxdd"]
Jul 15 19:39:19.813458 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:19.813428    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1260b666_810e_4d01_8fa3_a6eb043af249.slice/crio-15079ec44200677c0a1943274de2786ac6d398c94fe3c7acabf95a547a348016 WatchSource:0}: Error finding container 15079ec44200677c0a1943274de2786ac6d398c94fe3c7acabf95a547a348016: Status 404 returned error can't find the container with id 15079ec44200677c0a1943274de2786ac6d398c94fe3c7acabf95a547a348016
Jul 15 19:39:19.834407 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:19.834381    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7b69fc78bd-58gq7"]
Jul 15 19:39:19.837761 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:19.837735    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c089b1_d001_4b70_a79a_c5d1d68b7cb3.slice/crio-2b93ffc7a357242693264ebc2bdfc62b1c8969ddd388e628fcceffd7f9f075d6 WatchSource:0}: Error finding container 2b93ffc7a357242693264ebc2bdfc62b1c8969ddd388e628fcceffd7f9f075d6: Status 404 returned error can't find the container with id 2b93ffc7a357242693264ebc2bdfc62b1c8969ddd388e628fcceffd7f9f075d6
Jul 15 19:39:20.594309 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:20.594272    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7" event={"ID":"00c089b1-d001-4b70-a79a-c5d1d68b7cb3","Type":"ContainerStarted","Data":"5b10449954c8de07c70e5304e50f9728c1b817427337ab344586c2e9cd12f441"}
Jul 15 19:39:20.594502 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:20.594334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7" event={"ID":"00c089b1-d001-4b70-a79a-c5d1d68b7cb3","Type":"ContainerStarted","Data":"2b93ffc7a357242693264ebc2bdfc62b1c8969ddd388e628fcceffd7f9f075d6"}
Jul 15 19:39:20.594502 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:20.594374    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:20.596583 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:20.596553    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ss47p" event={"ID":"800dff05-96b8-4243-85ac-6305f7e82630","Type":"ContainerStarted","Data":"5e3f5775cfc6f080ac83045f8a1f815f75d210a0447524215b928349bb10c7c5"}
Jul 15 19:39:20.597805 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:20.597779    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-wpxdd" event={"ID":"1260b666-810e-4d01-8fa3-a6eb043af249","Type":"ContainerStarted","Data":"15079ec44200677c0a1943274de2786ac6d398c94fe3c7acabf95a547a348016"}
Jul 15 19:39:20.616231 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:20.616173    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7" podStartSLOduration=3.616143127 podStartE2EDuration="3.616143127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:20.615696891 +0000 UTC m=+61.696891254" watchObservedRunningTime="2026-07-15 19:39:20.616143127 +0000 UTC m=+61.697337519"
Jul 15 19:39:21.500853 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:21.500792    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lvkp6"
Jul 15 19:39:22.103528 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.103489    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b959c499-d7qz4"]
Jul 15 19:39:22.106963 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.106932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.110844 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.110688    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 19:39:22.110844 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.110785    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9w5w4\""
Jul 15 19:39:22.112247 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.112073    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 19:39:22.112247 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.112158    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 19:39:22.112426 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.112268    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 19:39:22.112426 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.112324    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 19:39:22.122137 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.122074    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b959c499-d7qz4"]
Jul 15 19:39:22.217117 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.217078    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whhmh\" (UniqueName: \"kubernetes.io/projected/32970640-fcef-45af-95d3-ae46eee20357-kube-api-access-whhmh\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.217306 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.217128    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-oauth-serving-cert\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.217306 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.217201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-serving-cert\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.217306 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.217238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-console-config\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.217306 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.217287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-oauth-config\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.217527 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.217319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-service-ca\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.317813 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.317774    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whhmh\" (UniqueName: \"kubernetes.io/projected/32970640-fcef-45af-95d3-ae46eee20357-kube-api-access-whhmh\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.317996 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.317837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-oauth-serving-cert\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.317996 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.317890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-serving-cert\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.317996 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.317926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-console-config\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.317996 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.317972    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-oauth-config\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.318245 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.318007    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-service-ca\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.318852 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.318693    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-oauth-serving-cert\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.318852 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.318695    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-service-ca\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.318852 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.318786    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-console-config\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.320866 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.320828    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-serving-cert\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.321227 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.321199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-oauth-config\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.326926 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.326873    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whhmh\" (UniqueName: \"kubernetes.io/projected/32970640-fcef-45af-95d3-ae46eee20357-kube-api-access-whhmh\") pod \"console-86b959c499-d7qz4\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") " pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:22.420648 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:22.420568    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:24.400209 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:24.400111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b959c499-d7qz4"]
Jul 15 19:39:24.405459 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:24.405431    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32970640_fcef_45af_95d3_ae46eee20357.slice/crio-7864f0c421f35ccbad3b13d9e76344e1747cf6ce7d45924941c88b4a2e6cb9ce WatchSource:0}: Error finding container 7864f0c421f35ccbad3b13d9e76344e1747cf6ce7d45924941c88b4a2e6cb9ce: Status 404 returned error can't find the container with id 7864f0c421f35ccbad3b13d9e76344e1747cf6ce7d45924941c88b4a2e6cb9ce
Jul 15 19:39:24.613978 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:24.613940    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b959c499-d7qz4" event={"ID":"32970640-fcef-45af-95d3-ae46eee20357","Type":"ContainerStarted","Data":"7864f0c421f35ccbad3b13d9e76344e1747cf6ce7d45924941c88b4a2e6cb9ce"}
Jul 15 19:39:24.616344 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:24.616304    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ss47p" event={"ID":"800dff05-96b8-4243-85ac-6305f7e82630","Type":"ContainerStarted","Data":"3cd4de5ad2127d70f13c4025f2f3ea8c4ccc43d0489e3b0c5bb7eec9fa0cba73"}
Jul 15 19:39:24.634746 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:24.634693    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ss47p" podStartSLOduration=17.342065651 podStartE2EDuration="30.634677082s" totalImagesPullingTime="13.292611431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:24.633400589 +0000 UTC m=+65.714594950" watchObservedRunningTime="2026-07-15 19:39:24.634677082 +0000 UTC m=+65.715871437"
Jul 15 19:39:25.045938 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.045848    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:39:25.048446 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.048420    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 19:39:25.058464 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.058438    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b633058a-84da-4566-98b1-4e124a4b55ab-metrics-certs\") pod \"network-metrics-daemon-ffdd6\" (UID: \"b633058a-84da-4566-98b1-4e124a4b55ab\") " pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:39:25.147221 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.147181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:39:25.149952 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.149920    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 19:39:25.154387 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.154363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vqmsl\""
Jul 15 19:39:25.159934 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.159911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0af40cba-63c1-44af-929b-cccdcdeb732d-original-pull-secret\") pod \"global-pull-secret-syncer-fmcqm\" (UID: \"0af40cba-63c1-44af-929b-cccdcdeb732d\") " pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:39:25.162857 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.162811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffdd6"
Jul 15 19:39:25.248812 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.248709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:39:25.252317 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.252062    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 19:39:25.262269 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.262047    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 19:39:25.276035 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.276006    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwnkj\" (UniqueName: \"kubernetes.io/projected/22d63025-972c-4239-b212-4ee5b2b815da-kube-api-access-gwnkj\") pod \"network-check-target-ft2wd\" (UID: \"22d63025-972c-4239-b212-4ee5b2b815da\") " pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:39:25.315574 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.315541    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ffdd6"]
Jul 15 19:39:25.319447 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:25.319359    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb633058a_84da_4566_98b1_4e124a4b55ab.slice/crio-4b76b7b8c6ed7336dbfac567c786f6c7001e7e1895a50c46dc9817439ba83df3 WatchSource:0}: Error finding container 4b76b7b8c6ed7336dbfac567c786f6c7001e7e1895a50c46dc9817439ba83df3: Status 404 returned error can't find the container with id 4b76b7b8c6ed7336dbfac567c786f6c7001e7e1895a50c46dc9817439ba83df3
Jul 15 19:39:25.438389 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.438355    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fmcqm"
Jul 15 19:39:25.448072 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.448037    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lw97b\""
Jul 15 19:39:25.456382 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.456341    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:39:25.625287 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.625230    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffdd6" event={"ID":"b633058a-84da-4566-98b1-4e124a4b55ab","Type":"ContainerStarted","Data":"4b76b7b8c6ed7336dbfac567c786f6c7001e7e1895a50c46dc9817439ba83df3"}
Jul 15 19:39:25.631091 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.631058    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fmcqm"]
Jul 15 19:39:25.636225 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:25.636194    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0af40cba_63c1_44af_929b_cccdcdeb732d.slice/crio-c16de024c348d99380e452803cb6f0ac69651af8f0a989e2010bcd419b5e0b40 WatchSource:0}: Error finding container c16de024c348d99380e452803cb6f0ac69651af8f0a989e2010bcd419b5e0b40: Status 404 returned error can't find the container with id c16de024c348d99380e452803cb6f0ac69651af8f0a989e2010bcd419b5e0b40
Jul 15 19:39:25.652233 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:25.652197    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ft2wd"]
Jul 15 19:39:25.655675 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:25.655646    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22d63025_972c_4239_b212_4ee5b2b815da.slice/crio-33566253d1522636b43f2f9c4b9f6415165c4e8f7b0f798468c38c22a3b600e8 WatchSource:0}: Error finding container 33566253d1522636b43f2f9c4b9f6415165c4e8f7b0f798468c38c22a3b600e8: Status 404 returned error can't find the container with id 33566253d1522636b43f2f9c4b9f6415165c4e8f7b0f798468c38c22a3b600e8
Jul 15 19:39:26.635828 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:26.635781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ft2wd" event={"ID":"22d63025-972c-4239-b212-4ee5b2b815da","Type":"ContainerStarted","Data":"33566253d1522636b43f2f9c4b9f6415165c4e8f7b0f798468c38c22a3b600e8"}
Jul 15 19:39:26.637883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:26.637853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fmcqm" event={"ID":"0af40cba-63c1-44af-929b-cccdcdeb732d","Type":"ContainerStarted","Data":"c16de024c348d99380e452803cb6f0ac69651af8f0a989e2010bcd419b5e0b40"}
Jul 15 19:39:27.237631 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:27.237514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:39:27.647080 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:27.646971    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffdd6" event={"ID":"b633058a-84da-4566-98b1-4e124a4b55ab","Type":"ContainerStarted","Data":"a69fcea9031527b8394d371a613c6efd18d08a028718c0e318f78232f4c58ac0"}
Jul 15 19:39:27.647650 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:27.647616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffdd6" event={"ID":"b633058a-84da-4566-98b1-4e124a4b55ab","Type":"ContainerStarted","Data":"a9f494b5ba8a95cd74f8c889c348092ae94441c339d80e45b4cc5ed6571eafc0"}
Jul 15 19:39:27.667854 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:27.667778    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ffdd6" podStartSLOduration=67.222330747 podStartE2EDuration="1m8.667756062s" totalImagesPullingTime="1.445425315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:27.666600686 +0000 UTC m=+68.747795072" watchObservedRunningTime="2026-07-15 19:39:27.667756062 +0000 UTC m=+68.748950425"
Jul 15 19:39:38.452053 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:38.452016    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b959c499-d7qz4"]
Jul 15 19:39:39.442750 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.442658    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-p8drt"]
Jul 15 19:39:39.445717 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.445692    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.448602 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.448566    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 19:39:39.448602 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.448591    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 19:39:39.449248 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.449226    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 19:39:39.449248 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.449245    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 19:39:39.449473 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.449455    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 19:39:39.449580 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.449564    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fjfgc\""
Jul 15 19:39:39.449639 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.449609    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 19:39:39.570459 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-accelerators-collector-config\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.570905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbmsn\" (UniqueName: \"kubernetes.io/projected/81f0582a-05fe-439c-a3d1-2081f0d5903d-kube-api-access-fbmsn\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.570905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.570905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570590    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81f0582a-05fe-439c-a3d1-2081f0d5903d-metrics-client-ca\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.570905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-tls\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.570905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-root\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.570905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570687    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-wtmp\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.570905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-sys\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.570905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.570733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-textfile\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672091 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672052    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-tls\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672307 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-root\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672307 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672203    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-wtmp\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672307 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672233    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-sys\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672307 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-textfile\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672503 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-accelerators-collector-config\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672503 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbmsn\" (UniqueName: \"kubernetes.io/projected/81f0582a-05fe-439c-a3d1-2081f0d5903d-kube-api-access-fbmsn\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672503 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672407    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672503 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672433    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81f0582a-05fe-439c-a3d1-2081f0d5903d-metrics-client-ca\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.672882 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-textfile\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.673013 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672930    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-root\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.673013 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.672992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-sys\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.673125 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.673032    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81f0582a-05fe-439c-a3d1-2081f0d5903d-metrics-client-ca\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.673125 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.673109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-wtmp\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.673530 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.673509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-accelerators-collector-config\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.674943 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.674919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-tls\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.675605 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.675582    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81f0582a-05fe-439c-a3d1-2081f0d5903d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.682002 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.681983    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbmsn\" (UniqueName: \"kubernetes.io/projected/81f0582a-05fe-439c-a3d1-2081f0d5903d-kube-api-access-fbmsn\") pod \"node-exporter-p8drt\" (UID: \"81f0582a-05fe-439c-a3d1-2081f0d5903d\") " pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.700881 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.700804    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ft2wd" event={"ID":"22d63025-972c-4239-b212-4ee5b2b815da","Type":"ContainerStarted","Data":"47e896fa80fab81766f5e093705cda6f9ef5887e278e49032c8a6e946f0d037d"}
Jul 15 19:39:39.701020 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.700898    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:39:39.702901 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.702865    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b959c499-d7qz4" event={"ID":"32970640-fcef-45af-95d3-ae46eee20357","Type":"ContainerStarted","Data":"dbfa131c598d18492350b3d700c8c439b490b1f1035e54f4cf14d34adcb95002"}
Jul 15 19:39:39.704837 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.704810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-wpxdd" event={"ID":"1260b666-810e-4d01-8fa3-a6eb043af249","Type":"ContainerStarted","Data":"30983149e301680da6aec40ff528accb8d0480d6d67e093f358f38a0b1b414bd"}
Jul 15 19:39:39.705055 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.705004    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-wpxdd"
Jul 15 19:39:39.707118 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.706870    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fmcqm" event={"ID":"0af40cba-63c1-44af-929b-cccdcdeb732d","Type":"ContainerStarted","Data":"5651a5f777c30b33a3be25737f945325cfe3b76e8a58373f171617fba49353ea"}
Jul 15 19:39:39.717719 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.717671    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ft2wd" podStartSLOduration=67.588699448 podStartE2EDuration="1m20.717655172s" totalImagesPullingTime="13.128955724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:39.71651834 +0000 UTC m=+80.797712727" watchObservedRunningTime="2026-07-15 19:39:39.717655172 +0000 UTC m=+80.798849582"
Jul 15 19:39:39.718017 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.717995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-wpxdd"
Jul 15 19:39:39.734793 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.734740    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-wpxdd" podStartSLOduration=3.429443053 podStartE2EDuration="22.734722827s" totalImagesPullingTime="19.305279774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:39.733931523 +0000 UTC m=+80.815125885" watchObservedRunningTime="2026-07-15 19:39:39.734722827 +0000 UTC m=+80.815917188"
Jul 15 19:39:39.757137 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.757106    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-p8drt"
Jul 15 19:39:39.772116 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.772063    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fmcqm" podStartSLOduration=67.612191495 podStartE2EDuration="1m20.772045554s" totalImagesPullingTime="13.159854059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 19:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:39.751579064 +0000 UTC m=+80.832773425" watchObservedRunningTime="2026-07-15 19:39:39.772045554 +0000 UTC m=+80.853239916"
Jul 15 19:39:39.772625 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:39.772582    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86b959c499-d7qz4" podStartSLOduration=3.394992748 podStartE2EDuration="17.772566429s" totalImagesPullingTime="14.377573681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:39.769673726 +0000 UTC m=+80.850868089" watchObservedRunningTime="2026-07-15 19:39:39.772566429 +0000 UTC m=+80.853760792"
Jul 15 19:39:39.794979 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:39.794841    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f0582a_05fe_439c_a3d1_2081f0d5903d.slice/crio-c66e38d10edc05b6bd69998cc57c5f665d5fe239aab89700fd371039e90b1b6d WatchSource:0}: Error finding container c66e38d10edc05b6bd69998cc57c5f665d5fe239aab89700fd371039e90b1b6d: Status 404 returned error can't find the container with id c66e38d10edc05b6bd69998cc57c5f665d5fe239aab89700fd371039e90b1b6d
Jul 15 19:39:40.510265 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.510228    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:39:40.533379 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.533237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:39:40.533379 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.533357    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.536134 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.535883    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 19:39:40.536134 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.535908    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 19:39:40.536335 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.536246    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 19:39:40.536335 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.536295    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 19:39:40.536426 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.536350    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 19:39:40.536562 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.536488    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 19:39:40.536822 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.536698    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 19:39:40.536822 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.536714    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 19:39:40.536954 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.536823    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 19:39:40.537264 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.537092    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-76btz\""
Jul 15 19:39:40.681197 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681126    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681362    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-config-volume\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681527    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-web-config\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.681641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-config-out\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.682148 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681708    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn9zg\" (UniqueName: \"kubernetes.io/projected/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-kube-api-access-rn9zg\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.682148 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.681757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.712721 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.712673    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p8drt" event={"ID":"81f0582a-05fe-439c-a3d1-2081f0d5903d","Type":"ContainerStarted","Data":"c66e38d10edc05b6bd69998cc57c5f665d5fe239aab89700fd371039e90b1b6d"}
Jul 15 19:39:40.782959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.782565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.782959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.782618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.782959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.782651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.782959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.782674    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.782959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.782703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-web-config\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.782959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.782752    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-config-out\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.782959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.782790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn9zg\" (UniqueName: \"kubernetes.io/projected/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-kube-api-access-rn9zg\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.783432 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.783309    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.784324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.783665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.784324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.783717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.784324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.783753    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.784324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.783784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.784324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.783814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.784324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.783854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-config-volume\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.784895 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.784870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.785009 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.784982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.787723 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.787482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.792874 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.792627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-web-config\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.792874 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.792706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.792874 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.792833    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-config-out\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.793069 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.793035    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.793336 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.793311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.794622 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.794435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.794723 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.794602    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-config-volume\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.796047 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.795995    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn9zg\" (UniqueName: \"kubernetes.io/projected/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-kube-api-access-rn9zg\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.796707 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.796684    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a13be694-e5a9-44e0-8521-a0ab8ae6b7da-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a13be694-e5a9-44e0-8521-a0ab8ae6b7da\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:40.848877 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:40.848751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 19:39:41.145178 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:41.145126    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 19:39:41.148722 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:41.148680    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13be694_e5a9_44e0_8521_a0ab8ae6b7da.slice/crio-ac77a1485955a38f55bcc2c48a367f9132b7b92132a3352892a1a9f754220d56 WatchSource:0}: Error finding container ac77a1485955a38f55bcc2c48a367f9132b7b92132a3352892a1a9f754220d56: Status 404 returned error can't find the container with id ac77a1485955a38f55bcc2c48a367f9132b7b92132a3352892a1a9f754220d56
Jul 15 19:39:41.607322 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:41.607291    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7b69fc78bd-58gq7"
Jul 15 19:39:41.719017 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:41.718979    2576 generic.go:356] "Generic (PLEG): container finished" podID="81f0582a-05fe-439c-a3d1-2081f0d5903d" containerID="ed393631517f5320db8f073954797d82d23d2900eb86a56fb510010893a69cf7" exitCode=0
Jul 15 19:39:41.719541 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:41.719068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p8drt" event={"ID":"81f0582a-05fe-439c-a3d1-2081f0d5903d","Type":"ContainerDied","Data":"ed393631517f5320db8f073954797d82d23d2900eb86a56fb510010893a69cf7"}
Jul 15 19:39:41.720624 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:41.720594    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a13be694-e5a9-44e0-8521-a0ab8ae6b7da","Type":"ContainerStarted","Data":"ac77a1485955a38f55bcc2c48a367f9132b7b92132a3352892a1a9f754220d56"}
Jul 15 19:39:42.260243 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.260149    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d" podUID="3a36aff9-4c6f-4097-be5d-fed220e0608d" containerName="registry" containerID="cri-o://1aafa18281cd4a217623bc4fee3003241e65fa48121c77b6fba598352de91b4c" gracePeriod=30
Jul 15 19:39:42.416441 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.415276    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59b587786-vn2tz"]
Jul 15 19:39:42.455201 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.449429    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59b587786-vn2tz"]
Jul 15 19:39:42.455201 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.449503    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:39:42.455201 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.449641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.455201 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.454522    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fxwmz\""
Jul 15 19:39:42.455201 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.454847    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 15 19:39:42.455201 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.455053    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 15 19:39:42.455608 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.455282    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 15 19:39:42.456067 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.455959    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 15 19:39:42.456210 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.456192    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2cqp1nlgr3jdl\""
Jul 15 19:39:42.456971 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.456953    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 15 19:39:42.600248 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.600213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-grpc-tls\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.600248 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.600256    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-tls\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.600479 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.600379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.600479 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.600423    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.600479 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.600458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e832cb-56b4-4bd8-af4e-6125616b76f4-metrics-client-ca\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.600600 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.600509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.600600 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.600559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqszw\" (UniqueName: \"kubernetes.io/projected/18e832cb-56b4-4bd8-af4e-6125616b76f4-kube-api-access-nqszw\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.600706 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.600601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.701468 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.701423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.701645 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.701490    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e832cb-56b4-4bd8-af4e-6125616b76f4-metrics-client-ca\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.701645 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.701557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.701645 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.701589    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqszw\" (UniqueName: \"kubernetes.io/projected/18e832cb-56b4-4bd8-af4e-6125616b76f4-kube-api-access-nqszw\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.701645 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.701619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.701851 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.701666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-grpc-tls\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.701851 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.701695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-tls\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.701851 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.701750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.702738 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.702705    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18e832cb-56b4-4bd8-af4e-6125616b76f4-metrics-client-ca\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.704976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.704922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.707084 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.707054    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.707230 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.707210    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.708269 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.707841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-grpc-tls\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.708269 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.708225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.708959 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.708933    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18e832cb-56b4-4bd8-af4e-6125616b76f4-secret-thanos-querier-tls\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.710291 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.710245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqszw\" (UniqueName: \"kubernetes.io/projected/18e832cb-56b4-4bd8-af4e-6125616b76f4-kube-api-access-nqszw\") pod \"thanos-querier-59b587786-vn2tz\" (UID: \"18e832cb-56b4-4bd8-af4e-6125616b76f4\") " pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.727775 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.727739    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p8drt" event={"ID":"81f0582a-05fe-439c-a3d1-2081f0d5903d","Type":"ContainerStarted","Data":"f31c1a5a9f7d853b641121fa363848a3ce32e75f24835c8b70fdfac3e8561f1a"}
Jul 15 19:39:42.728196 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.727816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-p8drt" event={"ID":"81f0582a-05fe-439c-a3d1-2081f0d5903d","Type":"ContainerStarted","Data":"a9c5d715e9fedb3b757dab285c1719b1a24bb49df27ff7645899a86e5d443340"}
Jul 15 19:39:42.730130 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.730103    2576 generic.go:356] "Generic (PLEG): container finished" podID="3a36aff9-4c6f-4097-be5d-fed220e0608d" containerID="1aafa18281cd4a217623bc4fee3003241e65fa48121c77b6fba598352de91b4c" exitCode=0
Jul 15 19:39:42.730255 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.730157    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d" event={"ID":"3a36aff9-4c6f-4097-be5d-fed220e0608d","Type":"ContainerDied","Data":"1aafa18281cd4a217623bc4fee3003241e65fa48121c77b6fba598352de91b4c"}
Jul 15 19:39:42.754507 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.754435    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-p8drt" podStartSLOduration=2.055131029 podStartE2EDuration="3.754410339s" totalImagesPullingTime="1.600417097s" totalInitContainerRuntime="98.862213ms" isStatefulPod=true podCreationTimestamp="2026-07-15 19:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:42.752993539 +0000 UTC m=+83.834187929" watchObservedRunningTime="2026-07-15 19:39:42.754410339 +0000 UTC m=+83.835604700"
Jul 15 19:39:42.767385 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.767343    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:42.941574 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:42.941541    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59b587786-vn2tz"]
Jul 15 19:39:43.027174 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:39:43.027125    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e832cb_56b4_4bd8_af4e_6125616b76f4.slice/crio-c7ccbf0009cb161072c114331adda60e5ed1fad1e26632ae6586ee2ed376eb39 WatchSource:0}: Error finding container c7ccbf0009cb161072c114331adda60e5ed1fad1e26632ae6586ee2ed376eb39: Status 404 returned error can't find the container with id c7ccbf0009cb161072c114331adda60e5ed1fad1e26632ae6586ee2ed376eb39
Jul 15 19:39:43.064767 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.064744    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:39:43.206816 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.206785    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-certificates\") pod \"3a36aff9-4c6f-4097-be5d-fed220e0608d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") "
Jul 15 19:39:43.206982 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.206855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-trusted-ca\") pod \"3a36aff9-4c6f-4097-be5d-fed220e0608d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") "
Jul 15 19:39:43.206982 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.206890    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-image-registry-private-configuration\") pod \"3a36aff9-4c6f-4097-be5d-fed220e0608d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") "
Jul 15 19:39:43.206982 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.206925    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffdn7\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-kube-api-access-ffdn7\") pod \"3a36aff9-4c6f-4097-be5d-fed220e0608d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") "
Jul 15 19:39:43.206982 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.206959    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") pod \"3a36aff9-4c6f-4097-be5d-fed220e0608d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") "
Jul 15 19:39:43.207203 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.206995    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-installation-pull-secrets\") pod \"3a36aff9-4c6f-4097-be5d-fed220e0608d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") "
Jul 15 19:39:43.207203 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.207045    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-bound-sa-token\") pod \"3a36aff9-4c6f-4097-be5d-fed220e0608d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") "
Jul 15 19:39:43.207203 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.207073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a36aff9-4c6f-4097-be5d-fed220e0608d-ca-trust-extracted\") pod \"3a36aff9-4c6f-4097-be5d-fed220e0608d\" (UID: \"3a36aff9-4c6f-4097-be5d-fed220e0608d\") "
Jul 15 19:39:43.207361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.207227    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3a36aff9-4c6f-4097-be5d-fed220e0608d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:39:43.207361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.207292    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3a36aff9-4c6f-4097-be5d-fed220e0608d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:39:43.207361 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.207344    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-certificates\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:39:43.210821 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.210357    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3a36aff9-4c6f-4097-be5d-fed220e0608d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:39:43.210821 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.210754    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3a36aff9-4c6f-4097-be5d-fed220e0608d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:39:43.210821 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.210700    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3a36aff9-4c6f-4097-be5d-fed220e0608d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:39:43.211534 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.211418    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-kube-api-access-ffdn7" (OuterVolumeSpecName: "kube-api-access-ffdn7") pod "3a36aff9-4c6f-4097-be5d-fed220e0608d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d"). InnerVolumeSpecName "kube-api-access-ffdn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:39:43.211534 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.211488    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3a36aff9-4c6f-4097-be5d-fed220e0608d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:39:43.221144 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.221111    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a36aff9-4c6f-4097-be5d-fed220e0608d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3a36aff9-4c6f-4097-be5d-fed220e0608d" (UID: "3a36aff9-4c6f-4097-be5d-fed220e0608d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:39:43.308026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.307858    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3a36aff9-4c6f-4097-be5d-fed220e0608d-trusted-ca\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:39:43.308026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.307894    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-image-registry-private-configuration\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:39:43.308026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.307909    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffdn7\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-kube-api-access-ffdn7\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:39:43.308026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.307923    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-registry-tls\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:39:43.308026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.307935    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3a36aff9-4c6f-4097-be5d-fed220e0608d-installation-pull-secrets\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:39:43.308026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.307946    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3a36aff9-4c6f-4097-be5d-fed220e0608d-bound-sa-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:39:43.308026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.307958    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3a36aff9-4c6f-4097-be5d-fed220e0608d-ca-trust-extracted\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:39:43.736485 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.736448    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"
Jul 15 19:39:43.736485 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.736476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d" event={"ID":"3a36aff9-4c6f-4097-be5d-fed220e0608d","Type":"ContainerDied","Data":"61976dcfaf20a2dde6106ca43f512348fa0ec7df5c1fabd95af59a35ccc4d9e5"}
Jul 15 19:39:43.736994 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.736549    2576 scope.go:117] "RemoveContainer" containerID="1aafa18281cd4a217623bc4fee3003241e65fa48121c77b6fba598352de91b4c"
Jul 15 19:39:43.739037 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.738953    2576 generic.go:356] "Generic (PLEG): container finished" podID="a13be694-e5a9-44e0-8521-a0ab8ae6b7da" containerID="6b144aa9867a2fb1701cf359280c45da5bd39c4d2e4cf005d8c8994464a7f301" exitCode=0
Jul 15 19:39:43.739180 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.739036    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a13be694-e5a9-44e0-8521-a0ab8ae6b7da","Type":"ContainerDied","Data":"6b144aa9867a2fb1701cf359280c45da5bd39c4d2e4cf005d8c8994464a7f301"}
Jul 15 19:39:43.741710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.741647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz" event={"ID":"18e832cb-56b4-4bd8-af4e-6125616b76f4","Type":"ContainerStarted","Data":"c7ccbf0009cb161072c114331adda60e5ed1fad1e26632ae6586ee2ed376eb39"}
Jul 15 19:39:43.769446 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.769411    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"]
Jul 15 19:39:43.776724 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:43.776700    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f9c6fdcd7-qdl8d"]
Jul 15 19:39:45.335679 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:45.335640    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a36aff9-4c6f-4097-be5d-fed220e0608d" path="/var/lib/kubelet/pods/3a36aff9-4c6f-4097-be5d-fed220e0608d/volumes"
Jul 15 19:39:46.758496 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:46.758406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a13be694-e5a9-44e0-8521-a0ab8ae6b7da","Type":"ContainerStarted","Data":"b06cbde548c4fc70df4a61359a7fe44c6f46c64d7384a1f7c02b9252ba3b5a16"}
Jul 15 19:39:46.760640 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:46.760582    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz" event={"ID":"18e832cb-56b4-4bd8-af4e-6125616b76f4","Type":"ContainerStarted","Data":"cf44be6c8d565113b9de1ac36a5674b586bdea509009b06e34146fee5af9c808"}
Jul 15 19:39:47.775812 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:47.775748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a13be694-e5a9-44e0-8521-a0ab8ae6b7da","Type":"ContainerStarted","Data":"d72b8d4f6aa2bfce90d19ebb983dfed0f784121eff2e300c85d412bc59e33f03"}
Jul 15 19:39:47.776336 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:47.775874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a13be694-e5a9-44e0-8521-a0ab8ae6b7da","Type":"ContainerStarted","Data":"f9852d30603188a63887fcab978700b423547c13bd7dc0b11f8e85ab4f7acdb0"}
Jul 15 19:39:47.776336 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:47.775918    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a13be694-e5a9-44e0-8521-a0ab8ae6b7da","Type":"ContainerStarted","Data":"dc8d44cd47ea3a0651faba8620f38337f546d1669d67592e34bd8e17ec28b033"}
Jul 15 19:39:47.776336 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:47.775960    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a13be694-e5a9-44e0-8521-a0ab8ae6b7da","Type":"ContainerStarted","Data":"73eac88c195e0aded679c6d6e96ca37b28cdfb36e998339602cfb3530c4f1c1b"}
Jul 15 19:39:47.780677 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:47.780638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz" event={"ID":"18e832cb-56b4-4bd8-af4e-6125616b76f4","Type":"ContainerStarted","Data":"3793ba23a0b4978c882203768f4f5e8dbcc517f417ca5cd79d8532992fabf73e"}
Jul 15 19:39:47.780923 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:47.780730    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz" event={"ID":"18e832cb-56b4-4bd8-af4e-6125616b76f4","Type":"ContainerStarted","Data":"b1624b541c0746284c6de0b3c9ed970d0c532eebc555b95eaa31b1388ce0eace"}
Jul 15 19:39:48.786654 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:48.786624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a13be694-e5a9-44e0-8521-a0ab8ae6b7da","Type":"ContainerStarted","Data":"e559778e5be158ca5cea61b047366d6bfaa70298a10b7e763edf730cc1032677"}
Jul 15 19:39:48.788882 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:48.788859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz" event={"ID":"18e832cb-56b4-4bd8-af4e-6125616b76f4","Type":"ContainerStarted","Data":"7e50b0b7dd073ca7845c4653c0096c598b54e9f610484804b4b0f07989bd421d"}
Jul 15 19:39:49.795433 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:49.795398    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz" event={"ID":"18e832cb-56b4-4bd8-af4e-6125616b76f4","Type":"ContainerStarted","Data":"73ec3bb49c285825da4f67112585f18ca09a7d138fddd8709d3be318b466c953"}
Jul 15 19:39:49.796011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:49.795463    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz" event={"ID":"18e832cb-56b4-4bd8-af4e-6125616b76f4","Type":"ContainerStarted","Data":"f82ce1ffd5726d000e4e8a5500592c83ecaae99b243540bd6c54ecba6cac580e"}
Jul 15 19:39:49.796011 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:49.795697    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:39:49.823370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:49.823319    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.676995811 podStartE2EDuration="9.82329923s" totalImagesPullingTime="6.124365592s" totalInitContainerRuntime="21.937827ms" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:49.821557085 +0000 UTC m=+90.902751468" watchObservedRunningTime="2026-07-15 19:39:49.82329923 +0000 UTC m=+90.904493647"
Jul 15 19:39:49.848352 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:49.848304    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz" podStartSLOduration=2.667565792 podStartE2EDuration="7.848288047s" totalImagesPullingTime="5.180722255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:39:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:39:49.846967481 +0000 UTC m=+90.928161841" watchObservedRunningTime="2026-07-15 19:39:49.848288047 +0000 UTC m=+90.929482407"
Jul 15 19:39:55.806527 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:39:55.806501    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59b587786-vn2tz"
Jul 15 19:40:04.727595 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:04.727547    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86b959c499-d7qz4" podUID="32970640-fcef-45af-95d3-ae46eee20357" containerName="console" containerID="cri-o://dbfa131c598d18492350b3d700c8c439b490b1f1035e54f4cf14d34adcb95002" gracePeriod=15
Jul 15 19:40:04.849555 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:04.849524    2576 generic.go:356] "Generic (PLEG): container finished" podID="32970640-fcef-45af-95d3-ae46eee20357" containerID="dbfa131c598d18492350b3d700c8c439b490b1f1035e54f4cf14d34adcb95002" exitCode=0
Jul 15 19:40:04.849703 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:04.849593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b959c499-d7qz4" event={"ID":"32970640-fcef-45af-95d3-ae46eee20357","Type":"ContainerDied","Data":"dbfa131c598d18492350b3d700c8c439b490b1f1035e54f4cf14d34adcb95002"}
Jul 15 19:40:05.017429 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.017392    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:40:05.072341 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072305    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-oauth-config\") pod \"32970640-fcef-45af-95d3-ae46eee20357\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") "
Jul 15 19:40:05.072513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072350    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whhmh\" (UniqueName: \"kubernetes.io/projected/32970640-fcef-45af-95d3-ae46eee20357-kube-api-access-whhmh\") pod \"32970640-fcef-45af-95d3-ae46eee20357\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") "
Jul 15 19:40:05.072513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-serving-cert\") pod \"32970640-fcef-45af-95d3-ae46eee20357\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") "
Jul 15 19:40:05.072513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072425    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-oauth-serving-cert\") pod \"32970640-fcef-45af-95d3-ae46eee20357\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") "
Jul 15 19:40:05.072513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072461    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-service-ca\") pod \"32970640-fcef-45af-95d3-ae46eee20357\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") "
Jul 15 19:40:05.072513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072500    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-console-config\") pod \"32970640-fcef-45af-95d3-ae46eee20357\" (UID: \"32970640-fcef-45af-95d3-ae46eee20357\") "
Jul 15 19:40:05.072878 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072847    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "32970640-fcef-45af-95d3-ae46eee20357" (UID: "32970640-fcef-45af-95d3-ae46eee20357"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:05.072878 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072866    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-service-ca" (OuterVolumeSpecName: "service-ca") pod "32970640-fcef-45af-95d3-ae46eee20357" (UID: "32970640-fcef-45af-95d3-ae46eee20357"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:05.073013 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.072959    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-console-config" (OuterVolumeSpecName: "console-config") pod "32970640-fcef-45af-95d3-ae46eee20357" (UID: "32970640-fcef-45af-95d3-ae46eee20357"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:40:05.074763 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.074732    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "32970640-fcef-45af-95d3-ae46eee20357" (UID: "32970640-fcef-45af-95d3-ae46eee20357"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:40:05.074852 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.074763    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32970640-fcef-45af-95d3-ae46eee20357-kube-api-access-whhmh" (OuterVolumeSpecName: "kube-api-access-whhmh") pod "32970640-fcef-45af-95d3-ae46eee20357" (UID: "32970640-fcef-45af-95d3-ae46eee20357"). InnerVolumeSpecName "kube-api-access-whhmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:40:05.074852 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.074784    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "32970640-fcef-45af-95d3-ae46eee20357" (UID: "32970640-fcef-45af-95d3-ae46eee20357"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:40:05.174019 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.173985    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-oauth-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:40:05.174019 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.174012    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whhmh\" (UniqueName: \"kubernetes.io/projected/32970640-fcef-45af-95d3-ae46eee20357-kube-api-access-whhmh\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:40:05.174019 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.174022    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/32970640-fcef-45af-95d3-ae46eee20357-console-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:40:05.174019 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.174030    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-oauth-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:40:05.174306 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.174038    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-service-ca\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:40:05.174306 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.174046    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/32970640-fcef-45af-95d3-ae46eee20357-console-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:40:05.854142 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.854104    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b959c499-d7qz4"
Jul 15 19:40:05.854142 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.854116    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b959c499-d7qz4" event={"ID":"32970640-fcef-45af-95d3-ae46eee20357","Type":"ContainerDied","Data":"7864f0c421f35ccbad3b13d9e76344e1747cf6ce7d45924941c88b4a2e6cb9ce"}
Jul 15 19:40:05.854730 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.854220    2576 scope.go:117] "RemoveContainer" containerID="dbfa131c598d18492350b3d700c8c439b490b1f1035e54f4cf14d34adcb95002"
Jul 15 19:40:05.871041 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.871018    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86b959c499-d7qz4"]
Jul 15 19:40:05.875354 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:05.875336    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86b959c499-d7qz4"]
Jul 15 19:40:07.330120 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:07.330083    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32970640-fcef-45af-95d3-ae46eee20357" path="/var/lib/kubelet/pods/32970640-fcef-45af-95d3-ae46eee20357/volumes"
Jul 15 19:40:10.716040 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:40:10.716012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ft2wd"
Jul 15 19:41:03.802356 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.802319    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-86b58984df-hsxlx"]
Jul 15 19:41:03.802758 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.802614    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a36aff9-4c6f-4097-be5d-fed220e0608d" containerName="registry"
Jul 15 19:41:03.802758 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.802627    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a36aff9-4c6f-4097-be5d-fed220e0608d" containerName="registry"
Jul 15 19:41:03.802758 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.802635    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32970640-fcef-45af-95d3-ae46eee20357" containerName="console"
Jul 15 19:41:03.802758 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.802641    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32970640-fcef-45af-95d3-ae46eee20357" containerName="console"
Jul 15 19:41:03.802758 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.802682    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="32970640-fcef-45af-95d3-ae46eee20357" containerName="console"
Jul 15 19:41:03.802758 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.802690    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a36aff9-4c6f-4097-be5d-fed220e0608d" containerName="registry"
Jul 15 19:41:03.806803 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.806785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:03.809585 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.809560    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 19:41:03.810117 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.810100    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-srqsr\""
Jul 15 19:41:03.810298 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.810283    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 19:41:03.810371 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.810310    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 19:41:03.810371 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.810316    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 19:41:03.810371 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.810345    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 19:41:03.815876 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.815858    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 19:41:03.822829 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.822810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86b58984df-hsxlx"]
Jul 15 19:41:03.918591 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.918560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:03.918777 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.918600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-metrics-client-ca\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:03.918777 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.918622    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:03.918777 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.918730    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-serving-certs-ca-bundle\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:03.918777 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.918763    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-secret-telemeter-client\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:03.918907 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.918833    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-telemeter-client-tls\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:03.918907 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.918874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbvw\" (UniqueName: \"kubernetes.io/projected/fc3746ab-f186-4138-aeb8-f534bb06d94b-kube-api-access-ntbvw\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:03.918907 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:03.918899    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-federate-client-tls\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.019475 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.019426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbvw\" (UniqueName: \"kubernetes.io/projected/fc3746ab-f186-4138-aeb8-f534bb06d94b-kube-api-access-ntbvw\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.019575 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.019489    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-federate-client-tls\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.019575 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.019523    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.019575 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.019556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-metrics-client-ca\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.019672 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.019586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.019672 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.019629    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-serving-certs-ca-bundle\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.019672 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.019656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-secret-telemeter-client\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.019777 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.019733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-telemeter-client-tls\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.020439 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.020413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-metrics-client-ca\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.020629 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.020457    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-serving-certs-ca-bundle\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.020758 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.020629    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc3746ab-f186-4138-aeb8-f534bb06d94b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.022204 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.022177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.022312 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.022293    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-secret-telemeter-client\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.022479 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.022464    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-telemeter-client-tls\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.022515 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.022495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/fc3746ab-f186-4138-aeb8-f534bb06d94b-federate-client-tls\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.027844 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.027822    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbvw\" (UniqueName: \"kubernetes.io/projected/fc3746ab-f186-4138-aeb8-f534bb06d94b-kube-api-access-ntbvw\") pod \"telemeter-client-86b58984df-hsxlx\" (UID: \"fc3746ab-f186-4138-aeb8-f534bb06d94b\") " pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.115950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.115916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx"
Jul 15 19:41:04.248078 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:04.248050    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-86b58984df-hsxlx"]
Jul 15 19:41:04.251290 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:41:04.251264    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3746ab_f186_4138_aeb8_f534bb06d94b.slice/crio-17b577fa487584130b7a46020510f2e3f91eda995e1eaeb7c9c586009ed133d3 WatchSource:0}: Error finding container 17b577fa487584130b7a46020510f2e3f91eda995e1eaeb7c9c586009ed133d3: Status 404 returned error can't find the container with id 17b577fa487584130b7a46020510f2e3f91eda995e1eaeb7c9c586009ed133d3
Jul 15 19:41:05.059289 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:05.059252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx" event={"ID":"fc3746ab-f186-4138-aeb8-f534bb06d94b","Type":"ContainerStarted","Data":"17b577fa487584130b7a46020510f2e3f91eda995e1eaeb7c9c586009ed133d3"}
Jul 15 19:41:07.068681 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.068646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx" event={"ID":"fc3746ab-f186-4138-aeb8-f534bb06d94b","Type":"ContainerStarted","Data":"1f8d9087010ef98b9213fc421458c9667357fdc5a7bf6a4507725ebda223f724"}
Jul 15 19:41:07.069115 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.068747    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx" event={"ID":"fc3746ab-f186-4138-aeb8-f534bb06d94b","Type":"ContainerStarted","Data":"af4d3930e12c243affc6a3ec70d0f6448df7b80768bfd25907da6e8f88b99b03"}
Jul 15 19:41:07.069115 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.068778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx" event={"ID":"fc3746ab-f186-4138-aeb8-f534bb06d94b","Type":"ContainerStarted","Data":"5970d5677272930ff87aa972eaaf221f7add5e68421277f97c24b1e861d30db1"}
Jul 15 19:41:07.093419 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.093364    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-86b58984df-hsxlx" podStartSLOduration=2.003893371 podStartE2EDuration="4.093346293s" totalImagesPullingTime="2.089452922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:41:07.092820763 +0000 UTC m=+168.174015124" watchObservedRunningTime="2026-07-15 19:41:07.093346293 +0000 UTC m=+168.174540654"
Jul 15 19:41:07.755718 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.755684    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbc6bcf66-fcl84"]
Jul 15 19:41:07.758899 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.758881    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.761185 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.761146    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 19:41:07.761308 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.761213    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 19:41:07.761819 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.761802    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 19:41:07.762287 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.762271    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 19:41:07.762772 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.762756    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 19:41:07.763054 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.763037    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9w5w4\""
Jul 15 19:41:07.766851 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.766833    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 19:41:07.770302 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.770280    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbc6bcf66-fcl84"]
Jul 15 19:41:07.855270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.855232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-oauth-config\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.855270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.855270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-trusted-ca-bundle\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.855488 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.855325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-serving-cert\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.855488 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.855359    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-oauth-serving-cert\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.855488 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.855416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-config\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.855488 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.855440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4khq4\" (UniqueName: \"kubernetes.io/projected/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-kube-api-access-4khq4\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.855488 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.855476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-service-ca\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956006 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.955971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-service-ca\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956196 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-oauth-config\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956196 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-trusted-ca-bundle\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956196 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-serving-cert\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956196 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956097    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-oauth-serving-cert\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956196 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-config\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956196 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4khq4\" (UniqueName: \"kubernetes.io/projected/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-kube-api-access-4khq4\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956865 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-service-ca\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.956865 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956816    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-config\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.957044 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.956952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-trusted-ca-bundle\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.957500 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.957478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-oauth-serving-cert\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.958655 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.958625    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-oauth-config\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.958784 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.958765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-serving-cert\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:07.963634 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:07.963615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4khq4\" (UniqueName: \"kubernetes.io/projected/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-kube-api-access-4khq4\") pod \"console-5cbc6bcf66-fcl84\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") " pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:08.068414 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:08.068377    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:08.193058 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:08.193003    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbc6bcf66-fcl84"]
Jul 15 19:41:08.195554 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:41:08.195514    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d0ad43_27bb_4f26_8bd2_cf8e5dd36ae5.slice/crio-3f88e211d9581e05fb8a56d27b42f9483193625502d3435eb5aaba83d2bc908a WatchSource:0}: Error finding container 3f88e211d9581e05fb8a56d27b42f9483193625502d3435eb5aaba83d2bc908a: Status 404 returned error can't find the container with id 3f88e211d9581e05fb8a56d27b42f9483193625502d3435eb5aaba83d2bc908a
Jul 15 19:41:09.077583 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:09.077552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbc6bcf66-fcl84" event={"ID":"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5","Type":"ContainerStarted","Data":"09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a"}
Jul 15 19:41:09.077757 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:09.077599    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbc6bcf66-fcl84" event={"ID":"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5","Type":"ContainerStarted","Data":"3f88e211d9581e05fb8a56d27b42f9483193625502d3435eb5aaba83d2bc908a"}
Jul 15 19:41:09.095597 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:09.095551    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbc6bcf66-fcl84" podStartSLOduration=2.095536129 podStartE2EDuration="2.095536129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:41:09.09478869 +0000 UTC m=+170.175983074" watchObservedRunningTime="2026-07-15 19:41:09.095536129 +0000 UTC m=+170.176730489"
Jul 15 19:41:18.069009 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.068911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:18.069009 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.068990    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:18.073761 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.073737    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:18.112939 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.112914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:18.285521 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.285490    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cfdf79b95-dg52n"]
Jul 15 19:41:18.290200 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.290183    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.298245 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.298146    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfdf79b95-dg52n"]
Jul 15 19:41:18.330724 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.330639    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-oauth-config\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.330724 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.330686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-oauth-serving-cert\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.330724 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.330723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-trusted-ca-bundle\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.330950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.330753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-service-ca\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.330950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.330781    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-console-config\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.330950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.330857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdmgn\" (UniqueName: \"kubernetes.io/projected/aa7c5568-0461-42ac-8654-73fbca0d077f-kube-api-access-mdmgn\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.330950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.330904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-serving-cert\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.431300 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.431263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdmgn\" (UniqueName: \"kubernetes.io/projected/aa7c5568-0461-42ac-8654-73fbca0d077f-kube-api-access-mdmgn\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.431495 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.431321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-serving-cert\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.431495 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.431340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-oauth-config\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.431495 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.431376    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-oauth-serving-cert\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.431495 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.431412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-trusted-ca-bundle\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.431495 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.431443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-service-ca\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.431495 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.431474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-console-config\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.432218 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.432190    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-oauth-serving-cert\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.432218 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.432209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-console-config\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.432407 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.432291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-service-ca\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.432407 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.432291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-trusted-ca-bundle\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.433810 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.433783    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-oauth-config\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.433900 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.433888    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-serving-cert\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.440649 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.440628    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdmgn\" (UniqueName: \"kubernetes.io/projected/aa7c5568-0461-42ac-8654-73fbca0d077f-kube-api-access-mdmgn\") pod \"console-cfdf79b95-dg52n\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") " pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.599729 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.599636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:18.732934 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:18.732908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cfdf79b95-dg52n"]
Jul 15 19:41:18.735336 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:41:18.735293    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7c5568_0461_42ac_8654_73fbca0d077f.slice/crio-185b258b94ccf42d267b7693931fcf56c33943af9e84a1553648bc6f3af0354a WatchSource:0}: Error finding container 185b258b94ccf42d267b7693931fcf56c33943af9e84a1553648bc6f3af0354a: Status 404 returned error can't find the container with id 185b258b94ccf42d267b7693931fcf56c33943af9e84a1553648bc6f3af0354a
Jul 15 19:41:19.114936 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:19.114900    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfdf79b95-dg52n" event={"ID":"aa7c5568-0461-42ac-8654-73fbca0d077f","Type":"ContainerStarted","Data":"4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f"}
Jul 15 19:41:19.115343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:19.114959    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfdf79b95-dg52n" event={"ID":"aa7c5568-0461-42ac-8654-73fbca0d077f","Type":"ContainerStarted","Data":"185b258b94ccf42d267b7693931fcf56c33943af9e84a1553648bc6f3af0354a"}
Jul 15 19:41:19.133950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:19.133896    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cfdf79b95-dg52n" podStartSLOduration=1.133879055 podStartE2EDuration="1.133879055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:41:19.131980965 +0000 UTC m=+180.213175325" watchObservedRunningTime="2026-07-15 19:41:19.133879055 +0000 UTC m=+180.215073416"
Jul 15 19:41:28.600358 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:28.600317    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:28.600779 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:28.600494    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:28.605192 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:28.605150    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:29.155186 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:29.155146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:41:29.209820 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:29.209783    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbc6bcf66-fcl84"]
Jul 15 19:41:54.230715 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.230661    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cbc6bcf66-fcl84" podUID="e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" containerName="console" containerID="cri-o://09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a" gracePeriod=15
Jul 15 19:41:54.468139 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.468115    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:54.633801 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.633768    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-trusted-ca-bundle\") pod \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") "
Jul 15 19:41:54.633976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.633826    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-service-ca\") pod \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") "
Jul 15 19:41:54.633976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.633866    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-oauth-config\") pod \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") "
Jul 15 19:41:54.633976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.633889    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-serving-cert\") pod \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") "
Jul 15 19:41:54.633976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.633914    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-config\") pod \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") "
Jul 15 19:41:54.633976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.633970    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4khq4\" (UniqueName: \"kubernetes.io/projected/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-kube-api-access-4khq4\") pod \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") "
Jul 15 19:41:54.634264 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.634009    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-oauth-serving-cert\") pod \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\" (UID: \"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5\") "
Jul 15 19:41:54.634402 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.634277    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" (UID: "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:54.634489 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.634377    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" (UID: "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:54.634489 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.634448    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-config" (OuterVolumeSpecName: "console-config") pod "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" (UID: "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:54.634565 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.634489    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" (UID: "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:41:54.636146 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.636128    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" (UID: "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:41:54.636233 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.636206    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" (UID: "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:41:54.636273 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.636208    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-kube-api-access-4khq4" (OuterVolumeSpecName: "kube-api-access-4khq4") pod "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" (UID: "e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5"). InnerVolumeSpecName "kube-api-access-4khq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:41:54.735505 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.735463    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4khq4\" (UniqueName: \"kubernetes.io/projected/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-kube-api-access-4khq4\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:41:54.735505 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.735495    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-oauth-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:41:54.735505 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.735510    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-trusted-ca-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:41:54.735734 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.735523    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-service-ca\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:41:54.735734 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.735536    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-oauth-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:41:54.735734 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.735548    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:41:54.735734 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:54.735559    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5-console-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:41:55.245599 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.245566    2576 generic.go:356] "Generic (PLEG): container finished" podID="e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" containerID="09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a" exitCode=0
Jul 15 19:41:55.246008 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.245609    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbc6bcf66-fcl84"
Jul 15 19:41:55.246008 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.245637    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbc6bcf66-fcl84" event={"ID":"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5","Type":"ContainerDied","Data":"09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a"}
Jul 15 19:41:55.246008 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.245677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbc6bcf66-fcl84" event={"ID":"e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5","Type":"ContainerDied","Data":"3f88e211d9581e05fb8a56d27b42f9483193625502d3435eb5aaba83d2bc908a"}
Jul 15 19:41:55.246008 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.245695    2576 scope.go:117] "RemoveContainer" containerID="09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a"
Jul 15 19:41:55.254270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.254252    2576 scope.go:117] "RemoveContainer" containerID="09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a"
Jul 15 19:41:55.254549 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:41:55.254529    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a\": container with ID starting with 09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a not found: ID does not exist" containerID="09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a"
Jul 15 19:41:55.254599 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.254558    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a"} err="failed to get container status \"09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a\": rpc error: code = NotFound desc = could not find container \"09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a\": container with ID starting with 09a49f7b22486287bd4ef133bcd4eb9efc344b30959b4102b0d280adea66f79a not found: ID does not exist"
Jul 15 19:41:55.266102 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.266078    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbc6bcf66-fcl84"]
Jul 15 19:41:55.270550 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.270531    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbc6bcf66-fcl84"]
Jul 15 19:41:55.330744 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:41:55.330718    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" path="/var/lib/kubelet/pods/e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5/volumes"
Jul 15 19:42:21.954236 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.954197    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"]
Jul 15 19:42:21.954724 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.954489    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" containerName="console"
Jul 15 19:42:21.954724 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.954499    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" containerName="console"
Jul 15 19:42:21.954724 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.954547    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d0ad43-27bb-4f26-8bd2-cf8e5dd36ae5" containerName="console"
Jul 15 19:42:21.958446 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.958430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"
Jul 15 19:42:21.961917 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.961889    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 19:42:21.961917 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.961914    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 19:42:21.962122 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.961951    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 19:42:21.962122 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.961959    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 19:42:21.962122 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.962003    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rdrq8\""
Jul 15 19:42:21.968495 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:21.968474    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"]
Jul 15 19:42:22.033534 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.033501    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"]
Jul 15 19:42:22.036608 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.036592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.039303 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.039287    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 19:42:22.048270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.048248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"]
Jul 15 19:42:22.048492 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.048476    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d03a4ce-7207-448c-b9a1-ce3141ec2f56-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dbbb989d8-czp2d\" (UID: \"6d03a4ce-7207-448c-b9a1-ce3141ec2f56\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"
Jul 15 19:42:22.048545 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.048529    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2cr7\" (UniqueName: \"kubernetes.io/projected/6d03a4ce-7207-448c-b9a1-ce3141ec2f56-kube-api-access-g2cr7\") pod \"managed-serviceaccount-addon-agent-dbbb989d8-czp2d\" (UID: \"6d03a4ce-7207-448c-b9a1-ce3141ec2f56\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"
Jul 15 19:42:22.149155 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.149119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/374e91f6-48ec-4aa4-8c8c-d9f17804e298-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.149366 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.149191    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2cr7\" (UniqueName: \"kubernetes.io/projected/6d03a4ce-7207-448c-b9a1-ce3141ec2f56-kube-api-access-g2cr7\") pod \"managed-serviceaccount-addon-agent-dbbb989d8-czp2d\" (UID: \"6d03a4ce-7207-448c-b9a1-ce3141ec2f56\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"
Jul 15 19:42:22.149366 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.149241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/374e91f6-48ec-4aa4-8c8c-d9f17804e298-tmp\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.149366 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.149289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d03a4ce-7207-448c-b9a1-ce3141ec2f56-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dbbb989d8-czp2d\" (UID: \"6d03a4ce-7207-448c-b9a1-ce3141ec2f56\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"
Jul 15 19:42:22.149366 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.149313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjgx9\" (UniqueName: \"kubernetes.io/projected/374e91f6-48ec-4aa4-8c8c-d9f17804e298-kube-api-access-jjgx9\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.151704 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.151672    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6d03a4ce-7207-448c-b9a1-ce3141ec2f56-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dbbb989d8-czp2d\" (UID: \"6d03a4ce-7207-448c-b9a1-ce3141ec2f56\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"
Jul 15 19:42:22.158046 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.158022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2cr7\" (UniqueName: \"kubernetes.io/projected/6d03a4ce-7207-448c-b9a1-ce3141ec2f56-kube-api-access-g2cr7\") pod \"managed-serviceaccount-addon-agent-dbbb989d8-czp2d\" (UID: \"6d03a4ce-7207-448c-b9a1-ce3141ec2f56\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"
Jul 15 19:42:22.176654 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.176623    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"]
Jul 15 19:42:22.179970 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.179955    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.182498 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.182471    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 19:42:22.182620 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.182513    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 19:42:22.182620 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.182525    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 19:42:22.182620 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.182603    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 19:42:22.190252 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.190231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"]
Jul 15 19:42:22.249872 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.249776    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/374e91f6-48ec-4aa4-8c8c-d9f17804e298-tmp\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.249872 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.249824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdhsm\" (UniqueName: \"kubernetes.io/projected/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-kube-api-access-zdhsm\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.249872 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.249856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-hub\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.250126 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.249881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.250126 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.249915    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjgx9\" (UniqueName: \"kubernetes.io/projected/374e91f6-48ec-4aa4-8c8c-d9f17804e298-kube-api-access-jjgx9\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.250126 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.249971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.250126 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.250006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/374e91f6-48ec-4aa4-8c8c-d9f17804e298-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.250126 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.250035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.250381 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.250119    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-ca\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.250381 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.250199    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/374e91f6-48ec-4aa4-8c8c-d9f17804e298-tmp\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.252441 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.252415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/374e91f6-48ec-4aa4-8c8c-d9f17804e298-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.259771 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.259742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjgx9\" (UniqueName: \"kubernetes.io/projected/374e91f6-48ec-4aa4-8c8c-d9f17804e298-kube-api-access-jjgx9\") pod \"klusterlet-addon-workmgr-8b7d4c67-tv6zf\" (UID: \"374e91f6-48ec-4aa4-8c8c-d9f17804e298\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.280614 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.280593    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"
Jul 15 19:42:22.345909 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.345883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:22.351338 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.351315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.351439 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.351362    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-ca\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.351439 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.351398    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdhsm\" (UniqueName: \"kubernetes.io/projected/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-kube-api-access-zdhsm\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.351439 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.351418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-hub\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.351536 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.351439    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.351572 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.351544    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.352082 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.352056    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.354468 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.354419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.354590 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.354572    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-hub\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.354657 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.354599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.354703 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.354648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-ca\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.363686 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.363665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdhsm\" (UniqueName: \"kubernetes.io/projected/94b6cc7c-dfba-4973-8d32-03e8a33c29d8-kube-api-access-zdhsm\") pod \"cluster-proxy-proxy-agent-84747697fd-bmmrl\" (UID: \"94b6cc7c-dfba-4973-8d32-03e8a33c29d8\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.422893 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.422862    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d"]
Jul 15 19:42:22.425773 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:42:22.425739    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d03a4ce_7207_448c_b9a1_ce3141ec2f56.slice/crio-7755f4ce3a002d7c246a66f09b36263b9a486cb22525f35cd025b38a01708fba WatchSource:0}: Error finding container 7755f4ce3a002d7c246a66f09b36263b9a486cb22525f35cd025b38a01708fba: Status 404 returned error can't find the container with id 7755f4ce3a002d7c246a66f09b36263b9a486cb22525f35cd025b38a01708fba
Jul 15 19:42:22.484273 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.484196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"]
Jul 15 19:42:22.486306 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:42:22.486277    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod374e91f6_48ec_4aa4_8c8c_d9f17804e298.slice/crio-480f1253a39af32471a339c6692340d9528bdf2a33956c8b5cdd257a3dab62e5 WatchSource:0}: Error finding container 480f1253a39af32471a339c6692340d9528bdf2a33956c8b5cdd257a3dab62e5: Status 404 returned error can't find the container with id 480f1253a39af32471a339c6692340d9528bdf2a33956c8b5cdd257a3dab62e5
Jul 15 19:42:22.489782 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.489764    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"
Jul 15 19:42:22.620831 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:22.620802    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl"]
Jul 15 19:42:22.623487 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:42:22.623465    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94b6cc7c_dfba_4973_8d32_03e8a33c29d8.slice/crio-3d4dbfddad645bc5fb3b14d03b70d477498a86c1dba826db4999bca4bcf6d6ac WatchSource:0}: Error finding container 3d4dbfddad645bc5fb3b14d03b70d477498a86c1dba826db4999bca4bcf6d6ac: Status 404 returned error can't find the container with id 3d4dbfddad645bc5fb3b14d03b70d477498a86c1dba826db4999bca4bcf6d6ac
Jul 15 19:42:23.347887 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:23.347796    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl" event={"ID":"94b6cc7c-dfba-4973-8d32-03e8a33c29d8","Type":"ContainerStarted","Data":"3d4dbfddad645bc5fb3b14d03b70d477498a86c1dba826db4999bca4bcf6d6ac"}
Jul 15 19:42:23.350643 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:23.350521    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf" event={"ID":"374e91f6-48ec-4aa4-8c8c-d9f17804e298","Type":"ContainerStarted","Data":"480f1253a39af32471a339c6692340d9528bdf2a33956c8b5cdd257a3dab62e5"}
Jul 15 19:42:23.352872 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:23.352813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d" event={"ID":"6d03a4ce-7207-448c-b9a1-ce3141ec2f56","Type":"ContainerStarted","Data":"7755f4ce3a002d7c246a66f09b36263b9a486cb22525f35cd025b38a01708fba"}
Jul 15 19:42:27.372012 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:27.371974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf" event={"ID":"374e91f6-48ec-4aa4-8c8c-d9f17804e298","Type":"ContainerStarted","Data":"d9b520fd6f15b4b2b5c9dfedd07ba49e4b27b9928dd53b389e834a3b3e578144"}
Jul 15 19:42:27.372505 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:27.372195    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:27.373889 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:27.373820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d" event={"ID":"6d03a4ce-7207-448c-b9a1-ce3141ec2f56","Type":"ContainerStarted","Data":"f4fc3a47c4a93ffd256e98b8695e0cabb7fb6ff3fa1edf4b3983c528830608b9"}
Jul 15 19:42:27.374338 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:27.374315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf"
Jul 15 19:42:27.389790 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:27.389736    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b7d4c67-tv6zf" podStartSLOduration=1.29811882 podStartE2EDuration="5.389718004s" totalImagesPullingTime="4.091599184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:42:27.387822003 +0000 UTC m=+248.469016365" watchObservedRunningTime="2026-07-15 19:42:27.389718004 +0000 UTC m=+248.470912367"
Jul 15 19:42:27.402718 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:27.402642    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dbbb989d8-czp2d" podStartSLOduration=2.262111609 podStartE2EDuration="6.402622912s" totalImagesPullingTime="4.140511303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:42:27.401713444 +0000 UTC m=+248.482907821" watchObservedRunningTime="2026-07-15 19:42:27.402622912 +0000 UTC m=+248.483817275"
Jul 15 19:42:29.386041 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:29.386005    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl" event={"ID":"94b6cc7c-dfba-4973-8d32-03e8a33c29d8","Type":"ContainerStarted","Data":"ab044e9059b0e574d8e327aabb0bafed2e5b68de7359c8c9e5d75b9cdb0b6448"}
Jul 15 19:42:29.386435 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:29.386061    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl" event={"ID":"94b6cc7c-dfba-4973-8d32-03e8a33c29d8","Type":"ContainerStarted","Data":"993774ed38aa5f8849511ba57e9d8ca5047eb97766fc6a8c95654caf1c28fcc1"}
Jul 15 19:42:30.391410 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:30.391372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl" event={"ID":"94b6cc7c-dfba-4973-8d32-03e8a33c29d8","Type":"ContainerStarted","Data":"b36baad3c0d1390eecd0332bdb6109ef768251e93e5e218759b6c760464cae47"}
Jul 15 19:42:30.442029 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:42:30.441975    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84747697fd-bmmrl" podStartSLOduration=1.8159987210000001 podStartE2EDuration="8.441958097s" totalImagesPullingTime="6.625959376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:42:30.440849003 +0000 UTC m=+251.522043363" watchObservedRunningTime="2026-07-15 19:42:30.441958097 +0000 UTC m=+251.523152458"
Jul 15 19:43:19.208876 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:43:19.208846    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 19:44:43.729449 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.729400    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"]
Jul 15 19:44:43.732614 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.732598    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.736883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.736861    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 19:44:43.737022 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.736865    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8svbl\""
Jul 15 19:44:43.739731 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.739708    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 19:44:43.739937 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.739754    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 19:44:43.740027 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.739987    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 19:44:43.764029 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.763999    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"]
Jul 15 19:44:43.834030 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.833989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81641268-c6a7-40b9-8194-c7fe47f43542-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.834238 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.834047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81641268-c6a7-40b9-8194-c7fe47f43542-manifests\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.834238 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.834101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81641268-c6a7-40b9-8194-c7fe47f43542-tmp\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.834238 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.834131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqznl\" (UniqueName: \"kubernetes.io/projected/81641268-c6a7-40b9-8194-c7fe47f43542-kube-api-access-sqznl\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.834353 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.834230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81641268-c6a7-40b9-8194-c7fe47f43542-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.935205 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.935140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81641268-c6a7-40b9-8194-c7fe47f43542-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.935383 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.935328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81641268-c6a7-40b9-8194-c7fe47f43542-manifests\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.935383 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.935365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81641268-c6a7-40b9-8194-c7fe47f43542-tmp\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.935532 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.935511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqznl\" (UniqueName: \"kubernetes.io/projected/81641268-c6a7-40b9-8194-c7fe47f43542-kube-api-access-sqznl\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.935607 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.935557    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81641268-c6a7-40b9-8194-c7fe47f43542-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.935743 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.935715    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/81641268-c6a7-40b9-8194-c7fe47f43542-manifests\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.937839 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.937814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/81641268-c6a7-40b9-8194-c7fe47f43542-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.937970 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.937823    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81641268-c6a7-40b9-8194-c7fe47f43542-tmp\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.937970 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.937864    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/81641268-c6a7-40b9-8194-c7fe47f43542-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:43.954178 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:43.954138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqznl\" (UniqueName: \"kubernetes.io/projected/81641268-c6a7-40b9-8194-c7fe47f43542-kube-api-access-sqznl\") pod \"opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p\" (UID: \"81641268-c6a7-40b9-8194-c7fe47f43542\") " pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:44.043023 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:44.042932    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:44.181596 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:44.181557    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"]
Jul 15 19:44:44.188462 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:44:44.188429    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81641268_c6a7_40b9_8194_c7fe47f43542.slice/crio-c190e5229602d4828af6e031c25729539ace8f37663440d887d288029ef5c65f WatchSource:0}: Error finding container c190e5229602d4828af6e031c25729539ace8f37663440d887d288029ef5c65f: Status 404 returned error can't find the container with id c190e5229602d4828af6e031c25729539ace8f37663440d887d288029ef5c65f
Jul 15 19:44:44.190117 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:44.190097    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:44:44.891327 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:44.891283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p" event={"ID":"81641268-c6a7-40b9-8194-c7fe47f43542","Type":"ContainerStarted","Data":"c190e5229602d4828af6e031c25729539ace8f37663440d887d288029ef5c65f"}
Jul 15 19:44:47.905817 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:47.905779    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p" event={"ID":"81641268-c6a7-40b9-8194-c7fe47f43542","Type":"ContainerStarted","Data":"ada98a204c111533bd1d4bc49ef56e77f1ba0e637f383cfb2bfbb19a4d95fa60"}
Jul 15 19:44:48.911288 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:48.911250    2576 generic.go:356] "Generic (PLEG): container finished" podID="81641268-c6a7-40b9-8194-c7fe47f43542" containerID="ada98a204c111533bd1d4bc49ef56e77f1ba0e637f383cfb2bfbb19a4d95fa60" exitCode=0
Jul 15 19:44:48.911288 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:48.911292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p" event={"ID":"81641268-c6a7-40b9-8194-c7fe47f43542","Type":"ContainerDied","Data":"ada98a204c111533bd1d4bc49ef56e77f1ba0e637f383cfb2bfbb19a4d95fa60"}
Jul 15 19:44:49.917322 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:49.917284    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p" event={"ID":"81641268-c6a7-40b9-8194-c7fe47f43542","Type":"ContainerStarted","Data":"6e775839bf95c7bfee6b4cc1e665c4d9fb3203a13d902e362f6068a4e11e928e"}
Jul 15 19:44:49.917704 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:49.917388    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:44:49.940503 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:44:49.940453    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p" podStartSLOduration=2.526499459 podStartE2EDuration="6.940428853s" totalImagesPullingTime="3.398190203s" totalInitContainerRuntime="1.015739191s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:44:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:44:49.93943318 +0000 UTC m=+391.020627541" watchObservedRunningTime="2026-07-15 19:44:49.940428853 +0000 UTC m=+391.021623195"
Jul 15 19:45:00.923654 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:00.923620    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p"
Jul 15 19:45:08.950109 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:08.950070    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"]
Jul 15 19:45:08.963326 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:08.963301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:08.968732 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:08.968703    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 19:45:08.968921 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:08.968797    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 19:45:08.968921 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:08.968819    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7ltqp\""
Jul 15 19:45:08.969054 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:08.969039    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 19:45:08.969403 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:08.969380    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"]
Jul 15 19:45:08.969549 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:08.969533    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 19:45:09.053937 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.053895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3078edef-a1c5-4581-9a02-dfebf9d94aed-tls-certs\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.054107 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.053952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8cw9\" (UniqueName: \"kubernetes.io/projected/3078edef-a1c5-4581-9a02-dfebf9d94aed-kube-api-access-r8cw9\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.054107 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.054035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3078edef-a1c5-4581-9a02-dfebf9d94aed-tmp\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.122109 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.122072    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l52dk"]
Jul 15 19:45:09.125458 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.125443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:09.128012 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.127994    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-thz4n\""
Jul 15 19:45:09.128089 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.127998    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 15 19:45:09.136979 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.136951    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l52dk"]
Jul 15 19:45:09.155048 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.155021    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3078edef-a1c5-4581-9a02-dfebf9d94aed-tmp\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.155198 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.155068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3078edef-a1c5-4581-9a02-dfebf9d94aed-tls-certs\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.155198 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.155098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8cw9\" (UniqueName: \"kubernetes.io/projected/3078edef-a1c5-4581-9a02-dfebf9d94aed-kube-api-access-r8cw9\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.157276 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.157244    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3078edef-a1c5-4581-9a02-dfebf9d94aed-tmp\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.157421 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.157399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3078edef-a1c5-4581-9a02-dfebf9d94aed-tls-certs\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.164253 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.164226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8cw9\" (UniqueName: \"kubernetes.io/projected/3078edef-a1c5-4581-9a02-dfebf9d94aed-kube-api-access-r8cw9\") pod \"kube-auth-proxy-5fd996b5bf-92brs\" (UID: \"3078edef-a1c5-4581-9a02-dfebf9d94aed\") " pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.256437 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.256357    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw7mm\" (UniqueName: \"kubernetes.io/projected/3bfe5307-67ec-461e-8256-796db969aec3-kube-api-access-fw7mm\") pod \"odh-model-controller-7998c67dc4-l52dk\" (UID: \"3bfe5307-67ec-461e-8256-796db969aec3\") " pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:09.256576 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.256465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bfe5307-67ec-461e-8256-796db969aec3-cert\") pod \"odh-model-controller-7998c67dc4-l52dk\" (UID: \"3bfe5307-67ec-461e-8256-796db969aec3\") " pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:09.275286 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.275256    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"
Jul 15 19:45:09.356828 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.356803    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bfe5307-67ec-461e-8256-796db969aec3-cert\") pod \"odh-model-controller-7998c67dc4-l52dk\" (UID: \"3bfe5307-67ec-461e-8256-796db969aec3\") " pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:09.357007 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.356852    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw7mm\" (UniqueName: \"kubernetes.io/projected/3bfe5307-67ec-461e-8256-796db969aec3-kube-api-access-fw7mm\") pod \"odh-model-controller-7998c67dc4-l52dk\" (UID: \"3bfe5307-67ec-461e-8256-796db969aec3\") " pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:09.359529 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.359507    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bfe5307-67ec-461e-8256-796db969aec3-cert\") pod \"odh-model-controller-7998c67dc4-l52dk\" (UID: \"3bfe5307-67ec-461e-8256-796db969aec3\") " pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:09.367673 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.367408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw7mm\" (UniqueName: \"kubernetes.io/projected/3bfe5307-67ec-461e-8256-796db969aec3-kube-api-access-fw7mm\") pod \"odh-model-controller-7998c67dc4-l52dk\" (UID: \"3bfe5307-67ec-461e-8256-796db969aec3\") " pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:09.412756 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.412723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs"]
Jul 15 19:45:09.415640 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:45:09.415608    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3078edef_a1c5_4581_9a02_dfebf9d94aed.slice/crio-1428de58276455ffcc2ffa76600d4857a48f210ac9dff830843dec10ec3cfa93 WatchSource:0}: Error finding container 1428de58276455ffcc2ffa76600d4857a48f210ac9dff830843dec10ec3cfa93: Status 404 returned error can't find the container with id 1428de58276455ffcc2ffa76600d4857a48f210ac9dff830843dec10ec3cfa93
Jul 15 19:45:09.436037 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.436006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:09.569292 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.569266    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l52dk"]
Jul 15 19:45:09.571633 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:45:09.571609    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bfe5307_67ec_461e_8256_796db969aec3.slice/crio-3e6af0ab91789220d9bd8fceefe33903f15945224f104f703ad05cb682cba504 WatchSource:0}: Error finding container 3e6af0ab91789220d9bd8fceefe33903f15945224f104f703ad05cb682cba504: Status 404 returned error can't find the container with id 3e6af0ab91789220d9bd8fceefe33903f15945224f104f703ad05cb682cba504
Jul 15 19:45:09.848156 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.848119    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cdlpv"]
Jul 15 19:45:09.852743 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.852724    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:09.855765 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.855736    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 15 19:45:09.855902 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.855834    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2jv5c\""
Jul 15 19:45:09.863332 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.863308    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cdlpv"]
Jul 15 19:45:09.962017 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.961978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/148062f5-fb58-469d-a289-1499c829d2d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-cdlpv\" (UID: \"148062f5-fb58-469d-a289-1499c829d2d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:09.962407 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.962041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d84gg\" (UniqueName: \"kubernetes.io/projected/148062f5-fb58-469d-a289-1499c829d2d9-kube-api-access-d84gg\") pod \"model-serving-api-54d89bd5fc-cdlpv\" (UID: \"148062f5-fb58-469d-a289-1499c829d2d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:09.992934 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.992898    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs" event={"ID":"3078edef-a1c5-4581-9a02-dfebf9d94aed","Type":"ContainerStarted","Data":"1428de58276455ffcc2ffa76600d4857a48f210ac9dff830843dec10ec3cfa93"}
Jul 15 19:45:09.993937 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:09.993906    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l52dk" event={"ID":"3bfe5307-67ec-461e-8256-796db969aec3","Type":"ContainerStarted","Data":"3e6af0ab91789220d9bd8fceefe33903f15945224f104f703ad05cb682cba504"}
Jul 15 19:45:10.063402 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.063360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d84gg\" (UniqueName: \"kubernetes.io/projected/148062f5-fb58-469d-a289-1499c829d2d9-kube-api-access-d84gg\") pod \"model-serving-api-54d89bd5fc-cdlpv\" (UID: \"148062f5-fb58-469d-a289-1499c829d2d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:10.063566 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.063448    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/148062f5-fb58-469d-a289-1499c829d2d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-cdlpv\" (UID: \"148062f5-fb58-469d-a289-1499c829d2d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:10.065834 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.065806    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/148062f5-fb58-469d-a289-1499c829d2d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-cdlpv\" (UID: \"148062f5-fb58-469d-a289-1499c829d2d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:10.072662 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.072642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d84gg\" (UniqueName: \"kubernetes.io/projected/148062f5-fb58-469d-a289-1499c829d2d9-kube-api-access-d84gg\") pod \"model-serving-api-54d89bd5fc-cdlpv\" (UID: \"148062f5-fb58-469d-a289-1499c829d2d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:10.163612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.163521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:10.292422 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.292385    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"]
Jul 15 19:45:10.297151 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.297125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.300363 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.300334    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pqcqt\""
Jul 15 19:45:10.300559 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.300539    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 19:45:10.300645 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.300560    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 19:45:10.300700 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.300545    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 19:45:10.300782 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.300766    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 19:45:10.316557 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.316494    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"]
Jul 15 19:45:10.325717 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.325472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cdlpv"]
Jul 15 19:45:10.328314 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:45:10.328280    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148062f5_fb58_469d_a289_1499c829d2d9.slice/crio-2569555e847964d2f7358a2c9f653b47cb4f99969acef5ccb175455e2de523d8 WatchSource:0}: Error finding container 2569555e847964d2f7358a2c9f653b47cb4f99969acef5ccb175455e2de523d8: Status 404 returned error can't find the container with id 2569555e847964d2f7358a2c9f653b47cb4f99969acef5ccb175455e2de523d8
Jul 15 19:45:10.467824 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.467726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.467824 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.467801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f9951e2-3cfc-4c02-b232-db96fb692c51-local-certs\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.468050 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.467831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.468050 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.467880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-cacerts\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.468050 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.467950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-token\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.468050 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.467981    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.468050 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.468022    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mq9b\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-kube-api-access-6mq9b\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.569044 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.568998    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mq9b\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-kube-api-access-6mq9b\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.569256 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.569105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.569256 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.569211    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f9951e2-3cfc-4c02-b232-db96fb692c51-local-certs\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.569256 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.569238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.569430 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.569284    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-cacerts\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.569430 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.569344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-token\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.569430 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.569372    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.570412 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.570384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.572812 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.572765    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f9951e2-3cfc-4c02-b232-db96fb692c51-local-certs\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.573215 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.573108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.573344 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.573231    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.573849 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.573824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-cacerts\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.580900 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.580862    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mq9b\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-kube-api-access-6mq9b\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.583375 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.583349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-token\") pod \"istiod-openshift-gateway-7574459656-vkj5q\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.609419 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.609373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:10.785846 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:10.785672    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"]
Jul 15 19:45:10.789362 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:45:10.789326    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9951e2_3cfc_4c02_b232_db96fb692c51.slice/crio-6ef8599a888cad1a32736768b613a96cc7d327e43e581645163e7ffe480bd107 WatchSource:0}: Error finding container 6ef8599a888cad1a32736768b613a96cc7d327e43e581645163e7ffe480bd107: Status 404 returned error can't find the container with id 6ef8599a888cad1a32736768b613a96cc7d327e43e581645163e7ffe480bd107
Jul 15 19:45:11.002695 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:11.002615    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv" event={"ID":"148062f5-fb58-469d-a289-1499c829d2d9","Type":"ContainerStarted","Data":"2569555e847964d2f7358a2c9f653b47cb4f99969acef5ccb175455e2de523d8"}
Jul 15 19:45:11.004772 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:11.004702    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q" event={"ID":"8f9951e2-3cfc-4c02-b232-db96fb692c51","Type":"ContainerStarted","Data":"6ef8599a888cad1a32736768b613a96cc7d327e43e581645163e7ffe480bd107"}
Jul 15 19:45:14.843118 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:14.843076    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:45:14.843516 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:14.843173    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:45:15.026928 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.026895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv" event={"ID":"148062f5-fb58-469d-a289-1499c829d2d9","Type":"ContainerStarted","Data":"df5cccc0b788d623b7785e91eb8711cf6b208347089403290e106ed75e89ad60"}
Jul 15 19:45:15.027108 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.026993    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:15.028554 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.028532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs" event={"ID":"3078edef-a1c5-4581-9a02-dfebf9d94aed","Type":"ContainerStarted","Data":"30dcd549f7596e1044d61cfd9a8c9f6ead69c20cbf8a6589a709b07de30a21cf"}
Jul 15 19:45:15.030105 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.030086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l52dk" event={"ID":"3bfe5307-67ec-461e-8256-796db969aec3","Type":"ContainerStarted","Data":"a7c20dd700e9f773a4b56eeeca386f0a4d862bad2e73107ea8022a8420d73b79"}
Jul 15 19:45:15.030218 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.030144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:15.031664 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.031612    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q" event={"ID":"8f9951e2-3cfc-4c02-b232-db96fb692c51","Type":"ContainerStarted","Data":"32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5"}
Jul 15 19:45:15.031831 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.031813    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:15.033314 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.033292    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vkj5q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:45:15.033394 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.033336    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q" podUID="8f9951e2-3cfc-4c02-b232-db96fb692c51" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:45:15.044459 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.044399    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv" podStartSLOduration=1.594376863 podStartE2EDuration="6.044384435s" totalImagesPullingTime="4.450007572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:15.043690475 +0000 UTC m=+416.124884837" watchObservedRunningTime="2026-07-15 19:45:15.044384435 +0000 UTC m=+416.125578799"
Jul 15 19:45:15.061651 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.061603    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-l52dk" podStartSLOduration=0.839322364 podStartE2EDuration="6.061586855s" totalImagesPullingTime="5.222264491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:15.061016052 +0000 UTC m=+416.142210432" watchObservedRunningTime="2026-07-15 19:45:15.061586855 +0000 UTC m=+416.142781215"
Jul 15 19:45:15.080565 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.080521    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q" podStartSLOduration=1.030148213 podStartE2EDuration="5.080505649s" totalImagesPullingTime="4.050357436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:15.079669238 +0000 UTC m=+416.160863616" watchObservedRunningTime="2026-07-15 19:45:15.080505649 +0000 UTC m=+416.161700011"
Jul 15 19:45:15.098410 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:15.098367    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5fd996b5bf-92brs" podStartSLOduration=2.61646233 podStartE2EDuration="7.098355278s" totalImagesPullingTime="4.481892948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:15.096271686 +0000 UTC m=+416.177466050" watchObservedRunningTime="2026-07-15 19:45:15.098355278 +0000 UTC m=+416.179549639"
Jul 15 19:45:16.036109 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.036067    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vkj5q container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 19:45:16.036545 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.036117    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q" podUID="8f9951e2-3cfc-4c02-b232-db96fb692c51" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 19:45:16.534434 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.534398    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"]
Jul 15 19:45:16.538134 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.538116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.541105 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.541086    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-68pfx\""
Jul 15 19:45:16.553051 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.553027    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"]
Jul 15 19:45:16.731939 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.731902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.731939 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.731941    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lph5n\" (UniqueName: \"kubernetes.io/projected/30814c3c-a750-40fd-b94b-f6105b6054a3-kube-api-access-lph5n\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.732138 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.732001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.732138 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.732027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.732138 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.732043    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30814c3c-a750-40fd-b94b-f6105b6054a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.732138 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.732068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.732138 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.732083    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.732311 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.732159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.732311 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.732215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.832784 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.832745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.832784 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.832784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lph5n\" (UniqueName: \"kubernetes.io/projected/30814c3c-a750-40fd-b94b-f6105b6054a3-kube-api-access-lph5n\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833018 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.832829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833018 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.832846    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833018 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.832862    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30814c3c-a750-40fd-b94b-f6105b6054a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833018 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.832889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833018 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.832907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833018 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.832948    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833356 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.833047    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833404 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.833387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833479 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.833458    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833536 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.833512    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833581 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.833552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.833713 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.833696    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30814c3c-a750-40fd-b94b-f6105b6054a3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.835204 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.835184    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.835294 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.835280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.850948 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.850924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30814c3c-a750-40fd-b94b-f6105b6054a3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:16.868555 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:16.868528    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lph5n\" (UniqueName: \"kubernetes.io/projected/30814c3c-a750-40fd-b94b-f6105b6054a3-kube-api-access-lph5n\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d65f7\" (UID: \"30814c3c-a750-40fd-b94b-f6105b6054a3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:17.148425 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:17.148337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:17.314954 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:17.314920    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"]
Jul 15 19:45:17.318038 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:45:17.318017    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30814c3c_a750_40fd_b94b_f6105b6054a3.slice/crio-3f30888913c69ddd237f750b1431b9b7cc6b5888fcd95956421490d0262d5801 WatchSource:0}: Error finding container 3f30888913c69ddd237f750b1431b9b7cc6b5888fcd95956421490d0262d5801: Status 404 returned error can't find the container with id 3f30888913c69ddd237f750b1431b9b7cc6b5888fcd95956421490d0262d5801
Jul 15 19:45:18.046002 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:18.045968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7" event={"ID":"30814c3c-a750-40fd-b94b-f6105b6054a3","Type":"ContainerStarted","Data":"3f30888913c69ddd237f750b1431b9b7cc6b5888fcd95956421490d0262d5801"}
Jul 15 19:45:19.036881 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.036847    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:19.786903 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.786864    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"]
Jul 15 19:45:19.791741 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.791718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:19.804331 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.804312    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 15 19:45:19.804931 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.804915    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rlsmx\""
Jul 15 19:45:19.821954 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.821922    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"]
Jul 15 19:45:19.860445 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.860412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk4fr\" (UniqueName: \"kubernetes.io/projected/5a95a6d4-6127-448b-99b4-b8c080b0b955-kube-api-access-fk4fr\") pod \"kserve-controller-manager-d6f4b65b8-px9mh\" (UID: \"5a95a6d4-6127-448b-99b4-b8c080b0b955\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:19.860604 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.860464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a95a6d4-6127-448b-99b4-b8c080b0b955-cert\") pod \"kserve-controller-manager-d6f4b65b8-px9mh\" (UID: \"5a95a6d4-6127-448b-99b4-b8c080b0b955\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:19.961187 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.961137    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk4fr\" (UniqueName: \"kubernetes.io/projected/5a95a6d4-6127-448b-99b4-b8c080b0b955-kube-api-access-fk4fr\") pod \"kserve-controller-manager-d6f4b65b8-px9mh\" (UID: \"5a95a6d4-6127-448b-99b4-b8c080b0b955\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:19.961352 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.961231    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a95a6d4-6127-448b-99b4-b8c080b0b955-cert\") pod \"kserve-controller-manager-d6f4b65b8-px9mh\" (UID: \"5a95a6d4-6127-448b-99b4-b8c080b0b955\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:19.961408 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:45:19.961389    2576 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 15 19:45:19.961463 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:45:19.961453    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a95a6d4-6127-448b-99b4-b8c080b0b955-cert podName:5a95a6d4-6127-448b-99b4-b8c080b0b955 nodeName:}" failed. No retries permitted until 2026-07-15 19:45:20.46143641 +0000 UTC m=+421.542630762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5a95a6d4-6127-448b-99b4-b8c080b0b955-cert") pod "kserve-controller-manager-d6f4b65b8-px9mh" (UID: "5a95a6d4-6127-448b-99b4-b8c080b0b955") : secret "kserve-webhook-server-cert" not found
Jul 15 19:45:19.974771 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:19.974736    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk4fr\" (UniqueName: \"kubernetes.io/projected/5a95a6d4-6127-448b-99b4-b8c080b0b955-kube-api-access-fk4fr\") pod \"kserve-controller-manager-d6f4b65b8-px9mh\" (UID: \"5a95a6d4-6127-448b-99b4-b8c080b0b955\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:20.465222 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:20.465182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a95a6d4-6127-448b-99b4-b8c080b0b955-cert\") pod \"kserve-controller-manager-d6f4b65b8-px9mh\" (UID: \"5a95a6d4-6127-448b-99b4-b8c080b0b955\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:20.467498 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:20.467479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5a95a6d4-6127-448b-99b4-b8c080b0b955-cert\") pod \"kserve-controller-manager-d6f4b65b8-px9mh\" (UID: \"5a95a6d4-6127-448b-99b4-b8c080b0b955\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:20.701756 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:20.701720    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:20.842636 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:20.842600    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"]
Jul 15 19:45:20.845473 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:45:20.845444    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a95a6d4_6127_448b_99b4_b8c080b0b955.slice/crio-6c86aee30c83501a407a79ced50df2bb2dc696d493d2eb685ebd95743727df6b WatchSource:0}: Error finding container 6c86aee30c83501a407a79ced50df2bb2dc696d493d2eb685ebd95743727df6b: Status 404 returned error can't find the container with id 6c86aee30c83501a407a79ced50df2bb2dc696d493d2eb685ebd95743727df6b
Jul 15 19:45:21.059767 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:21.059733    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh" event={"ID":"5a95a6d4-6127-448b-99b4-b8c080b0b955","Type":"ContainerStarted","Data":"6c86aee30c83501a407a79ced50df2bb2dc696d493d2eb685ebd95743727df6b"}
Jul 15 19:45:22.245181 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.245128    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"]
Jul 15 19:45:22.245575 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.245345    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q" podUID="8f9951e2-3cfc-4c02-b232-db96fb692c51" containerName="discovery" containerID="cri-o://32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5" gracePeriod=30
Jul 15 19:45:22.492087 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.492065    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:22.589263 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f9951e2-3cfc-4c02-b232-db96fb692c51-local-certs\") pod \"8f9951e2-3cfc-4c02-b232-db96fb692c51\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") "
Jul 15 19:45:22.589263 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589271    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-dns-cert\") pod \"8f9951e2-3cfc-4c02-b232-db96fb692c51\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") "
Jul 15 19:45:22.589531 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589327    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-ca-configmap\") pod \"8f9951e2-3cfc-4c02-b232-db96fb692c51\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") "
Jul 15 19:45:22.589531 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589344    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-token\") pod \"8f9951e2-3cfc-4c02-b232-db96fb692c51\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") "
Jul 15 19:45:22.589531 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589368    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-kubeconfig\") pod \"8f9951e2-3cfc-4c02-b232-db96fb692c51\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") "
Jul 15 19:45:22.589685 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589562    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mq9b\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-kube-api-access-6mq9b\") pod \"8f9951e2-3cfc-4c02-b232-db96fb692c51\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") "
Jul 15 19:45:22.589685 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589650    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-cacerts\") pod \"8f9951e2-3cfc-4c02-b232-db96fb692c51\" (UID: \"8f9951e2-3cfc-4c02-b232-db96fb692c51\") "
Jul 15 19:45:22.589806 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589768    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "8f9951e2-3cfc-4c02-b232-db96fb692c51" (UID: "8f9951e2-3cfc-4c02-b232-db96fb692c51"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:45:22.590006 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.589973    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-ca-configmap\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:45:22.592038 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.591962    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "8f9951e2-3cfc-4c02-b232-db96fb692c51" (UID: "8f9951e2-3cfc-4c02-b232-db96fb692c51"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:45:22.592150 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.592082    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f9951e2-3cfc-4c02-b232-db96fb692c51-local-certs" (OuterVolumeSpecName: "local-certs") pod "8f9951e2-3cfc-4c02-b232-db96fb692c51" (UID: "8f9951e2-3cfc-4c02-b232-db96fb692c51"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:45:22.592346 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.592308    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-cacerts" (OuterVolumeSpecName: "cacerts") pod "8f9951e2-3cfc-4c02-b232-db96fb692c51" (UID: "8f9951e2-3cfc-4c02-b232-db96fb692c51"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:45:22.592606 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.592571    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-kube-api-access-6mq9b" (OuterVolumeSpecName: "kube-api-access-6mq9b") pod "8f9951e2-3cfc-4c02-b232-db96fb692c51" (UID: "8f9951e2-3cfc-4c02-b232-db96fb692c51"). InnerVolumeSpecName "kube-api-access-6mq9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:45:22.592702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.592644    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "8f9951e2-3cfc-4c02-b232-db96fb692c51" (UID: "8f9951e2-3cfc-4c02-b232-db96fb692c51"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:45:22.592936 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.592918    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f9951e2-3cfc-4c02-b232-db96fb692c51" (UID: "8f9951e2-3cfc-4c02-b232-db96fb692c51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:45:22.691288 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.691249    2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f9951e2-3cfc-4c02-b232-db96fb692c51-local-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:45:22.691288 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.691278    2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-csr-dns-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:45:22.691288 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.691288    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:45:22.691288 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.691298    2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-istio-kubeconfig\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:45:22.691555 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.691306    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mq9b\" (UniqueName: \"kubernetes.io/projected/8f9951e2-3cfc-4c02-b232-db96fb692c51-kube-api-access-6mq9b\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:45:22.691555 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:22.691315    2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8f9951e2-3cfc-4c02-b232-db96fb692c51-cacerts\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:45:23.070014 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.069977    2576 generic.go:356] "Generic (PLEG): container finished" podID="8f9951e2-3cfc-4c02-b232-db96fb692c51" containerID="32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5" exitCode=0
Jul 15 19:45:23.070227 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.070035    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"
Jul 15 19:45:23.070227 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.070052    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q" event={"ID":"8f9951e2-3cfc-4c02-b232-db96fb692c51","Type":"ContainerDied","Data":"32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5"}
Jul 15 19:45:23.070227 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.070101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q" event={"ID":"8f9951e2-3cfc-4c02-b232-db96fb692c51","Type":"ContainerDied","Data":"6ef8599a888cad1a32736768b613a96cc7d327e43e581645163e7ffe480bd107"}
Jul 15 19:45:23.070227 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.070129    2576 scope.go:117] "RemoveContainer" containerID="32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5"
Jul 15 19:45:23.093330 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.093304    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"]
Jul 15 19:45:23.098636 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.098606    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vkj5q"]
Jul 15 19:45:23.333040 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.332964    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f9951e2-3cfc-4c02-b232-db96fb692c51" path="/var/lib/kubelet/pods/8f9951e2-3cfc-4c02-b232-db96fb692c51/volumes"
Jul 15 19:45:23.385019 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.384847    2576 scope.go:117] "RemoveContainer" containerID="32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5"
Jul 15 19:45:23.385255 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:45:23.385231    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5\": container with ID starting with 32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5 not found: ID does not exist" containerID="32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5"
Jul 15 19:45:23.385325 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:23.385264    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5"} err="failed to get container status \"32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5\": rpc error: code = NotFound desc = could not find container \"32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5\": container with ID starting with 32329dc05860c4b8095577d001bca94c3c1b0698d343e77a51cf24fe6270eda5 not found: ID does not exist"
Jul 15 19:45:24.076461 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:24.076426    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh" event={"ID":"5a95a6d4-6127-448b-99b4-b8c080b0b955","Type":"ContainerStarted","Data":"dc4a0422bfc12f79b5ff2ce737f2f7fb0d31e1226537974a75a73d650f898743"}
Jul 15 19:45:24.076677 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:24.076577    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:45:24.101225 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:24.101145    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh" podStartSLOduration=2.515797379 podStartE2EDuration="5.101126398s" totalImagesPullingTime="2.585329019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:24.09992724 +0000 UTC m=+425.181121615" watchObservedRunningTime="2026-07-15 19:45:24.101126398 +0000 UTC m=+425.182320759"
Jul 15 19:45:26.037904 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:26.037876    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-l52dk"
Jul 15 19:45:26.039757 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:26.039735    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cdlpv"
Jul 15 19:45:33.091424 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:33.091385    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:45:33.091704 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:33.091456    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:45:33.091704 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:33.091483    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:45:34.123819 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:34.123774    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7" event={"ID":"30814c3c-a750-40fd-b94b-f6105b6054a3","Type":"ContainerStarted","Data":"d053026f52d7c5ff927867effc848c8ebbaa3df97d0925bc402733ca4786c801"}
Jul 15 19:45:34.146601 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:34.146548    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7" podStartSLOduration=2.375499124 podStartE2EDuration="18.146532216s" totalImagesPullingTime="15.771033092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:45:34.144482914 +0000 UTC m=+435.225677275" watchObservedRunningTime="2026-07-15 19:45:34.146532216 +0000 UTC m=+435.227726633"
Jul 15 19:45:34.149095 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:34.149074    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:34.153521 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:34.153499    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:35.128636 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:35.128607    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:35.129730 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:35.129711    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d65f7"
Jul 15 19:45:55.088761 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:45:55.088684    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-px9mh"
Jul 15 19:46:04.483616 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.483581    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k26g2"]
Jul 15 19:46:04.483993 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.483905    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9951e2-3cfc-4c02-b232-db96fb692c51" containerName="discovery"
Jul 15 19:46:04.483993 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.483915    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9951e2-3cfc-4c02-b232-db96fb692c51" containerName="discovery"
Jul 15 19:46:04.483993 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.483981    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f9951e2-3cfc-4c02-b232-db96fb692c51" containerName="discovery"
Jul 15 19:46:04.495944 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.495916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k26g2"
Jul 15 19:46:04.499458 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.499432    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 19:46:04.499615 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.499431    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 19:46:04.499615 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.499589    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ppx8q\""
Jul 15 19:46:04.505307 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.504719    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k26g2"]
Jul 15 19:46:04.559563 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.559531    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsqh7\" (UniqueName: \"kubernetes.io/projected/5cb47d8f-50c3-4400-a1e3-66dc52ece0fe-kube-api-access-rsqh7\") pod \"kuadrant-operator-catalog-k26g2\" (UID: \"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe\") " pod="kuadrant-system/kuadrant-operator-catalog-k26g2"
Jul 15 19:46:04.661012 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.660975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsqh7\" (UniqueName: \"kubernetes.io/projected/5cb47d8f-50c3-4400-a1e3-66dc52ece0fe-kube-api-access-rsqh7\") pod \"kuadrant-operator-catalog-k26g2\" (UID: \"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe\") " pod="kuadrant-system/kuadrant-operator-catalog-k26g2"
Jul 15 19:46:04.670329 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.670299    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsqh7\" (UniqueName: \"kubernetes.io/projected/5cb47d8f-50c3-4400-a1e3-66dc52ece0fe-kube-api-access-rsqh7\") pod \"kuadrant-operator-catalog-k26g2\" (UID: \"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe\") " pod="kuadrant-system/kuadrant-operator-catalog-k26g2"
Jul 15 19:46:04.787022 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.786930    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k26g2"]
Jul 15 19:46:04.787287 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.787270    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k26g2"
Jul 15 19:46:04.917822 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.917661    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k26g2"]
Jul 15 19:46:04.920538 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:46:04.920517    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb47d8f_50c3_4400_a1e3_66dc52ece0fe.slice/crio-70496588451e12882d874cb7d25bcec2aa5b6d58e0f2b67443b559ffe8bc18a7 WatchSource:0}: Error finding container 70496588451e12882d874cb7d25bcec2aa5b6d58e0f2b67443b559ffe8bc18a7: Status 404 returned error can't find the container with id 70496588451e12882d874cb7d25bcec2aa5b6d58e0f2b67443b559ffe8bc18a7
Jul 15 19:46:04.998796 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:04.998762    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rwtvq"]
Jul 15 19:46:05.003682 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:05.003665    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:05.010511 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:05.010478    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rwtvq"]
Jul 15 19:46:05.063153 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:05.063125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgfp5\" (UniqueName: \"kubernetes.io/projected/73cee52f-a093-41d2-bcdd-172ae098d242-kube-api-access-fgfp5\") pod \"kuadrant-operator-catalog-rwtvq\" (UID: \"73cee52f-a093-41d2-bcdd-172ae098d242\") " pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:05.163618 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:05.163580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgfp5\" (UniqueName: \"kubernetes.io/projected/73cee52f-a093-41d2-bcdd-172ae098d242-kube-api-access-fgfp5\") pod \"kuadrant-operator-catalog-rwtvq\" (UID: \"73cee52f-a093-41d2-bcdd-172ae098d242\") " pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:05.172626 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:05.172595    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgfp5\" (UniqueName: \"kubernetes.io/projected/73cee52f-a093-41d2-bcdd-172ae098d242-kube-api-access-fgfp5\") pod \"kuadrant-operator-catalog-rwtvq\" (UID: \"73cee52f-a093-41d2-bcdd-172ae098d242\") " pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:05.260773 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:05.260742    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k26g2" event={"ID":"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe","Type":"ContainerStarted","Data":"70496588451e12882d874cb7d25bcec2aa5b6d58e0f2b67443b559ffe8bc18a7"}
Jul 15 19:46:05.314856 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:05.314773    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:05.451810 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:05.451782    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rwtvq"]
Jul 15 19:46:05.454312 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:46:05.454281    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cee52f_a093_41d2_bcdd_172ae098d242.slice/crio-4ba8b6d001f8bcd8fca5e4229d1933cf4e660f9a20a916ec31fe8d57d21babb0 WatchSource:0}: Error finding container 4ba8b6d001f8bcd8fca5e4229d1933cf4e660f9a20a916ec31fe8d57d21babb0: Status 404 returned error can't find the container with id 4ba8b6d001f8bcd8fca5e4229d1933cf4e660f9a20a916ec31fe8d57d21babb0
Jul 15 19:46:06.268326 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:06.268283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq" event={"ID":"73cee52f-a093-41d2-bcdd-172ae098d242","Type":"ContainerStarted","Data":"4ba8b6d001f8bcd8fca5e4229d1933cf4e660f9a20a916ec31fe8d57d21babb0"}
Jul 15 19:46:08.279435 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.279400    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k26g2" event={"ID":"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe","Type":"ContainerStarted","Data":"857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9"}
Jul 15 19:46:08.279874 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.279410    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-k26g2" podUID="5cb47d8f-50c3-4400-a1e3-66dc52ece0fe" containerName="registry-server" containerID="cri-o://857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9" gracePeriod=2
Jul 15 19:46:08.281040 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.281011    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq" event={"ID":"73cee52f-a093-41d2-bcdd-172ae098d242","Type":"ContainerStarted","Data":"1121105dae7780a2f607ca4451b61f56e957675b00424a7b5f1e531c3635753d"}
Jul 15 19:46:08.295771 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.295728    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-k26g2" podStartSLOduration=1.9654625019999998 podStartE2EDuration="4.295710062s" totalImagesPullingTime="2.33024756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:08.295618528 +0000 UTC m=+469.376812910" watchObservedRunningTime="2026-07-15 19:46:08.295710062 +0000 UTC m=+469.376904423"
Jul 15 19:46:08.312924 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.312876    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq" podStartSLOduration=2.513511919 podStartE2EDuration="4.312861319s" totalImagesPullingTime="1.7993494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:08.312024972 +0000 UTC m=+469.393219338" watchObservedRunningTime="2026-07-15 19:46:08.312861319 +0000 UTC m=+469.394055680"
Jul 15 19:46:08.533319 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.533263    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k26g2"
Jul 15 19:46:08.541477 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.541451    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cb79bcc77-7x9gm"]
Jul 15 19:46:08.541791 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.541779    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cb47d8f-50c3-4400-a1e3-66dc52ece0fe" containerName="registry-server"
Jul 15 19:46:08.541840 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.541793    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cb47d8f-50c3-4400-a1e3-66dc52ece0fe" containerName="registry-server"
Jul 15 19:46:08.541874 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.541846    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cb47d8f-50c3-4400-a1e3-66dc52ece0fe" containerName="registry-server"
Jul 15 19:46:08.544677 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.544662    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.560550 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.560516    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb79bcc77-7x9gm"]
Jul 15 19:46:08.586658 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.586626    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsqh7\" (UniqueName: \"kubernetes.io/projected/5cb47d8f-50c3-4400-a1e3-66dc52ece0fe-kube-api-access-rsqh7\") pod \"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe\" (UID: \"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe\") "
Jul 15 19:46:08.586806 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.586714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-oauth-serving-cert\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.586806 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.586733    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-trusted-ca-bundle\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.586806 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.586768    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-service-ca\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.586806 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.586791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a90616-ab68-4911-b381-8a356fd979e0-console-serving-cert\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.586938 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.586816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrc4l\" (UniqueName: \"kubernetes.io/projected/d9a90616-ab68-4911-b381-8a356fd979e0-kube-api-access-xrc4l\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.586938 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.586851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9a90616-ab68-4911-b381-8a356fd979e0-console-oauth-config\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.586938 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.586904    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-console-config\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.588852 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.588830    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cb47d8f-50c3-4400-a1e3-66dc52ece0fe-kube-api-access-rsqh7" (OuterVolumeSpecName: "kube-api-access-rsqh7") pod "5cb47d8f-50c3-4400-a1e3-66dc52ece0fe" (UID: "5cb47d8f-50c3-4400-a1e3-66dc52ece0fe"). InnerVolumeSpecName "kube-api-access-rsqh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:46:08.687419 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.687377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-oauth-serving-cert\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.687593 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.687434    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-trusted-ca-bundle\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.687593 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.687496    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-service-ca\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.687593 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.687536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a90616-ab68-4911-b381-8a356fd979e0-console-serving-cert\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.687593 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.687567    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrc4l\" (UniqueName: \"kubernetes.io/projected/d9a90616-ab68-4911-b381-8a356fd979e0-kube-api-access-xrc4l\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.687802 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.687606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9a90616-ab68-4911-b381-8a356fd979e0-console-oauth-config\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.687802 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.687675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-console-config\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.687802 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.687750    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsqh7\" (UniqueName: \"kubernetes.io/projected/5cb47d8f-50c3-4400-a1e3-66dc52ece0fe-kube-api-access-rsqh7\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:46:08.688332 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.688305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-oauth-serving-cert\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.688459 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.688435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-console-config\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.688513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.688384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-trusted-ca-bundle\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.688513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.688315    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d9a90616-ab68-4911-b381-8a356fd979e0-service-ca\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.689993 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.689965    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d9a90616-ab68-4911-b381-8a356fd979e0-console-oauth-config\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.690174 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.690139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a90616-ab68-4911-b381-8a356fd979e0-console-serving-cert\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.698417 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.698396    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrc4l\" (UniqueName: \"kubernetes.io/projected/d9a90616-ab68-4911-b381-8a356fd979e0-kube-api-access-xrc4l\") pod \"console-6cb79bcc77-7x9gm\" (UID: \"d9a90616-ab68-4911-b381-8a356fd979e0\") " pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.853630 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.853573    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:08.983042 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:08.983017    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb79bcc77-7x9gm"]
Jul 15 19:46:08.984953 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:46:08.984931    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a90616_ab68_4911_b381_8a356fd979e0.slice/crio-5fdd85a9fdfcd877b81e1edfa2e9a5ae90cc7c71e5f574ef0cd05aa852157ab8 WatchSource:0}: Error finding container 5fdd85a9fdfcd877b81e1edfa2e9a5ae90cc7c71e5f574ef0cd05aa852157ab8: Status 404 returned error can't find the container with id 5fdd85a9fdfcd877b81e1edfa2e9a5ae90cc7c71e5f574ef0cd05aa852157ab8
Jul 15 19:46:09.287366 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.287271    2576 generic.go:356] "Generic (PLEG): container finished" podID="5cb47d8f-50c3-4400-a1e3-66dc52ece0fe" containerID="857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9" exitCode=0
Jul 15 19:46:09.287366 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.287319    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-k26g2"
Jul 15 19:46:09.287366 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.287354    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k26g2" event={"ID":"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe","Type":"ContainerDied","Data":"857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9"}
Jul 15 19:46:09.287909 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.287404    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-k26g2" event={"ID":"5cb47d8f-50c3-4400-a1e3-66dc52ece0fe","Type":"ContainerDied","Data":"70496588451e12882d874cb7d25bcec2aa5b6d58e0f2b67443b559ffe8bc18a7"}
Jul 15 19:46:09.288207 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.287433    2576 scope.go:117] "RemoveContainer" containerID="857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9"
Jul 15 19:46:09.289350 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.289200    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb79bcc77-7x9gm" event={"ID":"d9a90616-ab68-4911-b381-8a356fd979e0","Type":"ContainerStarted","Data":"e902a9daa32fa7cc662c538d79e9b41ebc2bdcff696b0145767ee55483dece53"}
Jul 15 19:46:09.289350 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.289242    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb79bcc77-7x9gm" event={"ID":"d9a90616-ab68-4911-b381-8a356fd979e0","Type":"ContainerStarted","Data":"5fdd85a9fdfcd877b81e1edfa2e9a5ae90cc7c71e5f574ef0cd05aa852157ab8"}
Jul 15 19:46:09.303995 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.303976    2576 scope.go:117] "RemoveContainer" containerID="857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9"
Jul 15 19:46:09.304316 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:46:09.304290    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9\": container with ID starting with 857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9 not found: ID does not exist" containerID="857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9"
Jul 15 19:46:09.304377 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.304326    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9"} err="failed to get container status \"857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9\": rpc error: code = NotFound desc = could not find container \"857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9\": container with ID starting with 857b5937d2bc4581ab03874e162dede6ae65b816ccee60f5559133e93cd898a9 not found: ID does not exist"
Jul 15 19:46:09.311513 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.311461    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6cb79bcc77-7x9gm" podStartSLOduration=1.311446987 podStartE2EDuration="1.311446987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:09.311060331 +0000 UTC m=+470.392254684" watchObservedRunningTime="2026-07-15 19:46:09.311446987 +0000 UTC m=+470.392641349"
Jul 15 19:46:09.324411 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.324379    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k26g2"]
Jul 15 19:46:09.331982 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:09.331959    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-k26g2"]
Jul 15 19:46:11.332324 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:11.332294    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cb47d8f-50c3-4400-a1e3-66dc52ece0fe" path="/var/lib/kubelet/pods/5cb47d8f-50c3-4400-a1e3-66dc52ece0fe/volumes"
Jul 15 19:46:15.315591 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:15.315560    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:15.315997 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:15.315627    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:15.338395 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:15.338369    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:16.344401 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:16.344373    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rwtvq"
Jul 15 19:46:18.853937 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:18.853839    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:18.854367 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:18.853967    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:18.858866 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:18.858837    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:19.337272 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:19.337239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cb79bcc77-7x9gm"
Jul 15 19:46:19.383439 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:19.383412    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfdf79b95-dg52n"]
Jul 15 19:46:42.537203 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.537155    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"]
Jul 15 19:46:42.540402 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.540385    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"
Jul 15 19:46:42.543152 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.543127    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zvgxj\""
Jul 15 19:46:42.543943 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.543926    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 19:46:42.552457 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.552433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"]
Jul 15 19:46:42.695536 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.695499    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bppf9\" (UniqueName: \"kubernetes.io/projected/78e09e43-7b90-44ee-8e4f-a9ae234aa580-kube-api-access-bppf9\") pod \"dns-operator-controller-manager-864dd78c4c-2wnc6\" (UID: \"78e09e43-7b90-44ee-8e4f-a9ae234aa580\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"
Jul 15 19:46:42.796669 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.796556    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bppf9\" (UniqueName: \"kubernetes.io/projected/78e09e43-7b90-44ee-8e4f-a9ae234aa580-kube-api-access-bppf9\") pod \"dns-operator-controller-manager-864dd78c4c-2wnc6\" (UID: \"78e09e43-7b90-44ee-8e4f-a9ae234aa580\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"
Jul 15 19:46:42.808523 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.808488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bppf9\" (UniqueName: \"kubernetes.io/projected/78e09e43-7b90-44ee-8e4f-a9ae234aa580-kube-api-access-bppf9\") pod \"dns-operator-controller-manager-864dd78c4c-2wnc6\" (UID: \"78e09e43-7b90-44ee-8e4f-a9ae234aa580\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"
Jul 15 19:46:42.850301 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.850263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"
Jul 15 19:46:42.983812 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:42.983784    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"]
Jul 15 19:46:42.985582 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:46:42.985555    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e09e43_7b90_44ee_8e4f_a9ae234aa580.slice/crio-ed3ec90ba6002e1f9a132be1101819cac99332bad1d889215d75f5f6463f4528 WatchSource:0}: Error finding container ed3ec90ba6002e1f9a132be1101819cac99332bad1d889215d75f5f6463f4528: Status 404 returned error can't find the container with id ed3ec90ba6002e1f9a132be1101819cac99332bad1d889215d75f5f6463f4528
Jul 15 19:46:43.439442 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:43.439411    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6" event={"ID":"78e09e43-7b90-44ee-8e4f-a9ae234aa580","Type":"ContainerStarted","Data":"ed3ec90ba6002e1f9a132be1101819cac99332bad1d889215d75f5f6463f4528"}
Jul 15 19:46:44.407104 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.407040    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-cfdf79b95-dg52n" podUID="aa7c5568-0461-42ac-8654-73fbca0d077f" containerName="console" containerID="cri-o://4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f" gracePeriod=15
Jul 15 19:46:44.675641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.675617    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:46:44.816427 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816395    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-oauth-serving-cert\") pod \"aa7c5568-0461-42ac-8654-73fbca0d077f\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") "
Jul 15 19:46:44.816612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816436    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-service-ca\") pod \"aa7c5568-0461-42ac-8654-73fbca0d077f\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") "
Jul 15 19:46:44.816612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816477    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-trusted-ca-bundle\") pod \"aa7c5568-0461-42ac-8654-73fbca0d077f\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") "
Jul 15 19:46:44.816612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816497    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-console-config\") pod \"aa7c5568-0461-42ac-8654-73fbca0d077f\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") "
Jul 15 19:46:44.816612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816532    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdmgn\" (UniqueName: \"kubernetes.io/projected/aa7c5568-0461-42ac-8654-73fbca0d077f-kube-api-access-mdmgn\") pod \"aa7c5568-0461-42ac-8654-73fbca0d077f\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") "
Jul 15 19:46:44.816612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816570    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-oauth-config\") pod \"aa7c5568-0461-42ac-8654-73fbca0d077f\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") "
Jul 15 19:46:44.816612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816599    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-serving-cert\") pod \"aa7c5568-0461-42ac-8654-73fbca0d077f\" (UID: \"aa7c5568-0461-42ac-8654-73fbca0d077f\") "
Jul 15 19:46:44.816933 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816809    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa7c5568-0461-42ac-8654-73fbca0d077f" (UID: "aa7c5568-0461-42ac-8654-73fbca0d077f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:46:44.816991 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816961    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-console-config" (OuterVolumeSpecName: "console-config") pod "aa7c5568-0461-42ac-8654-73fbca0d077f" (UID: "aa7c5568-0461-42ac-8654-73fbca0d077f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:46:44.816991 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.816970    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa7c5568-0461-42ac-8654-73fbca0d077f" (UID: "aa7c5568-0461-42ac-8654-73fbca0d077f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:46:44.817071 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.817007    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aa7c5568-0461-42ac-8654-73fbca0d077f" (UID: "aa7c5568-0461-42ac-8654-73fbca0d077f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:46:44.818931 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.818899    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa7c5568-0461-42ac-8654-73fbca0d077f" (UID: "aa7c5568-0461-42ac-8654-73fbca0d077f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:46:44.818931 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.818910    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7c5568-0461-42ac-8654-73fbca0d077f-kube-api-access-mdmgn" (OuterVolumeSpecName: "kube-api-access-mdmgn") pod "aa7c5568-0461-42ac-8654-73fbca0d077f" (UID: "aa7c5568-0461-42ac-8654-73fbca0d077f"). InnerVolumeSpecName "kube-api-access-mdmgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:46:44.819075 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.818915    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa7c5568-0461-42ac-8654-73fbca0d077f" (UID: "aa7c5568-0461-42ac-8654-73fbca0d077f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:46:44.917612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.917530    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-oauth-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:46:44.917612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.917560    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-service-ca\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:46:44.917612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.917571    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-trusted-ca-bundle\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:46:44.917612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.917580    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa7c5568-0461-42ac-8654-73fbca0d077f-console-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:46:44.917612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.917588    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdmgn\" (UniqueName: \"kubernetes.io/projected/aa7c5568-0461-42ac-8654-73fbca0d077f-kube-api-access-mdmgn\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:46:44.917612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.917597    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-oauth-config\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:46:44.917612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:44.917606    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa7c5568-0461-42ac-8654-73fbca0d077f-console-serving-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:46:45.450380 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.450340    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6" event={"ID":"78e09e43-7b90-44ee-8e4f-a9ae234aa580","Type":"ContainerStarted","Data":"6ab11226304c3b0df8af190508d40439cdd9341fb296cb5f23a931e99d28907b"}
Jul 15 19:46:45.450817 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.450399    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"
Jul 15 19:46:45.451599 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.451579    2576 generic.go:356] "Generic (PLEG): container finished" podID="aa7c5568-0461-42ac-8654-73fbca0d077f" containerID="4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f" exitCode=0
Jul 15 19:46:45.451702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.451615    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cfdf79b95-dg52n"
Jul 15 19:46:45.451702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.451638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfdf79b95-dg52n" event={"ID":"aa7c5568-0461-42ac-8654-73fbca0d077f","Type":"ContainerDied","Data":"4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f"}
Jul 15 19:46:45.451702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.451671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cfdf79b95-dg52n" event={"ID":"aa7c5568-0461-42ac-8654-73fbca0d077f","Type":"ContainerDied","Data":"185b258b94ccf42d267b7693931fcf56c33943af9e84a1553648bc6f3af0354a"}
Jul 15 19:46:45.451702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.451697    2576 scope.go:117] "RemoveContainer" containerID="4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f"
Jul 15 19:46:45.459920 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.459897    2576 scope.go:117] "RemoveContainer" containerID="4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f"
Jul 15 19:46:45.460180 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:46:45.460146    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f\": container with ID starting with 4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f not found: ID does not exist" containerID="4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f"
Jul 15 19:46:45.460265 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.460183    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f"} err="failed to get container status \"4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f\": rpc error: code = NotFound desc = could not find container \"4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f\": container with ID starting with 4b1d33d9c309b6b517a9169301ccab9f7e68153025d9211d5ccc614309e3740f not found: ID does not exist"
Jul 15 19:46:45.472344 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.472302    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6" podStartSLOduration=1.157465194 podStartE2EDuration="3.472287181s" totalImagesPullingTime="2.314821987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:45.470938057 +0000 UTC m=+506.552132421" watchObservedRunningTime="2026-07-15 19:46:45.472287181 +0000 UTC m=+506.553481600"
Jul 15 19:46:45.488518 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.488493    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cfdf79b95-dg52n"]
Jul 15 19:46:45.498486 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:45.498467    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cfdf79b95-dg52n"]
Jul 15 19:46:47.335440 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.335408    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa7c5568-0461-42ac-8654-73fbca0d077f" path="/var/lib/kubelet/pods/aa7c5568-0461-42ac-8654-73fbca0d077f/volumes"
Jul 15 19:46:47.616313 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.616223    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"]
Jul 15 19:46:47.616652 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.616635    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7c5568-0461-42ac-8654-73fbca0d077f" containerName="console"
Jul 15 19:46:47.616738 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.616655    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7c5568-0461-42ac-8654-73fbca0d077f" containerName="console"
Jul 15 19:46:47.616789 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.616766    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7c5568-0461-42ac-8654-73fbca0d077f" containerName="console"
Jul 15 19:46:47.621023 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.620999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:47.623805 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.623785    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-442lt\""
Jul 15 19:46:47.634569 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.634547    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"]
Jul 15 19:46:47.743265 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.743223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw85v\" (UniqueName: \"kubernetes.io/projected/7ef61be8-6220-482a-8468-ff1f8901a71d-kube-api-access-sw85v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" (UID: \"7ef61be8-6220-482a-8468-ff1f8901a71d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:47.743446 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.743373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef61be8-6220-482a-8468-ff1f8901a71d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" (UID: \"7ef61be8-6220-482a-8468-ff1f8901a71d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:47.843975 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.843935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef61be8-6220-482a-8468-ff1f8901a71d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" (UID: \"7ef61be8-6220-482a-8468-ff1f8901a71d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:47.844218 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.844002    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw85v\" (UniqueName: \"kubernetes.io/projected/7ef61be8-6220-482a-8468-ff1f8901a71d-kube-api-access-sw85v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" (UID: \"7ef61be8-6220-482a-8468-ff1f8901a71d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:47.844358 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.844336    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef61be8-6220-482a-8468-ff1f8901a71d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" (UID: \"7ef61be8-6220-482a-8468-ff1f8901a71d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:47.857091 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.857064    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw85v\" (UniqueName: \"kubernetes.io/projected/7ef61be8-6220-482a-8468-ff1f8901a71d-kube-api-access-sw85v\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" (UID: \"7ef61be8-6220-482a-8468-ff1f8901a71d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:47.931088 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:47.931003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:48.072156 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:48.072123    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"]
Jul 15 19:46:48.075227 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:46:48.075201    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef61be8_6220_482a_8468_ff1f8901a71d.slice/crio-253023f46dfa076b9aa6a87cdf26ac8041a0e24a2b29d27b5066d86d9d01674f WatchSource:0}: Error finding container 253023f46dfa076b9aa6a87cdf26ac8041a0e24a2b29d27b5066d86d9d01674f: Status 404 returned error can't find the container with id 253023f46dfa076b9aa6a87cdf26ac8041a0e24a2b29d27b5066d86d9d01674f
Jul 15 19:46:48.467853 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:48.467819    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m" event={"ID":"7ef61be8-6220-482a-8468-ff1f8901a71d","Type":"ContainerStarted","Data":"253023f46dfa076b9aa6a87cdf26ac8041a0e24a2b29d27b5066d86d9d01674f"}
Jul 15 19:46:51.472755 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.472713    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"]
Jul 15 19:46:51.476456 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.476431    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"
Jul 15 19:46:51.476938 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.476917    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6klq\" (UniqueName: \"kubernetes.io/projected/310096d2-6388-4254-90c1-9b29465a024b-kube-api-access-b6klq\") pod \"authorino-operator-75cc8d5cb7-ksq4h\" (UID: \"310096d2-6388-4254-90c1-9b29465a024b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"
Jul 15 19:46:51.479422 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.479403    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-v4zjr\""
Jul 15 19:46:51.493797 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.493768    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"]
Jul 15 19:46:51.577524 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.577474    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6klq\" (UniqueName: \"kubernetes.io/projected/310096d2-6388-4254-90c1-9b29465a024b-kube-api-access-b6klq\") pod \"authorino-operator-75cc8d5cb7-ksq4h\" (UID: \"310096d2-6388-4254-90c1-9b29465a024b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"
Jul 15 19:46:51.585990 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.585961    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6klq\" (UniqueName: \"kubernetes.io/projected/310096d2-6388-4254-90c1-9b29465a024b-kube-api-access-b6klq\") pod \"authorino-operator-75cc8d5cb7-ksq4h\" (UID: \"310096d2-6388-4254-90c1-9b29465a024b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"
Jul 15 19:46:51.788956 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.788878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"
Jul 15 19:46:51.938968 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:51.938942    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"]
Jul 15 19:46:51.941357 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:46:51.941319    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310096d2_6388_4254_90c1_9b29465a024b.slice/crio-2ccb264ab00d34bfa27ef5b69b22e7924204faff3c4bb4addefd91522477ad01 WatchSource:0}: Error finding container 2ccb264ab00d34bfa27ef5b69b22e7924204faff3c4bb4addefd91522477ad01: Status 404 returned error can't find the container with id 2ccb264ab00d34bfa27ef5b69b22e7924204faff3c4bb4addefd91522477ad01
Jul 15 19:46:52.491230 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:52.491130    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h" event={"ID":"310096d2-6388-4254-90c1-9b29465a024b","Type":"ContainerStarted","Data":"2ccb264ab00d34bfa27ef5b69b22e7924204faff3c4bb4addefd91522477ad01"}
Jul 15 19:46:54.341397 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:54.341363    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"]
Jul 15 19:46:54.345117 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:54.345099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:46:54.348312 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:54.348284    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-72mms\""
Jul 15 19:46:54.360690 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:54.360660    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"]
Jul 15 19:46:54.497735 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:54.497700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6kf\" (UniqueName: \"kubernetes.io/projected/56889e00-988d-4188-86b8-e060c2381758-kube-api-access-dr6kf\") pod \"limitador-operator-controller-manager-859d7b78bd-gbchv\" (UID: \"56889e00-988d-4188-86b8-e060c2381758\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:46:54.598387 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:54.598294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6kf\" (UniqueName: \"kubernetes.io/projected/56889e00-988d-4188-86b8-e060c2381758-kube-api-access-dr6kf\") pod \"limitador-operator-controller-manager-859d7b78bd-gbchv\" (UID: \"56889e00-988d-4188-86b8-e060c2381758\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:46:54.615024 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:54.614989    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6kf\" (UniqueName: \"kubernetes.io/projected/56889e00-988d-4188-86b8-e060c2381758-kube-api-access-dr6kf\") pod \"limitador-operator-controller-manager-859d7b78bd-gbchv\" (UID: \"56889e00-988d-4188-86b8-e060c2381758\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:46:54.657859 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:54.657821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:46:55.317622 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:55.317600    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"]
Jul 15 19:46:55.319698 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:46:55.319668    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56889e00_988d_4188_86b8_e060c2381758.slice/crio-9f2ed82f948079adbc5b1513b51f8736cb641e149cd42f112174ce791ab9e23f WatchSource:0}: Error finding container 9f2ed82f948079adbc5b1513b51f8736cb641e149cd42f112174ce791ab9e23f: Status 404 returned error can't find the container with id 9f2ed82f948079adbc5b1513b51f8736cb641e149cd42f112174ce791ab9e23f
Jul 15 19:46:55.509000 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:55.508908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m" event={"ID":"7ef61be8-6220-482a-8468-ff1f8901a71d","Type":"ContainerStarted","Data":"51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0"}
Jul 15 19:46:55.509432 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:55.509045    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:46:55.510642 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:55.510616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h" event={"ID":"310096d2-6388-4254-90c1-9b29465a024b","Type":"ContainerStarted","Data":"27966a87f62c9003672f68e7f81b2cffdfedade5cc960364977cf31cc936b8dd"}
Jul 15 19:46:55.510731 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:55.510673    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"
Jul 15 19:46:55.511799 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:55.511779    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv" event={"ID":"56889e00-988d-4188-86b8-e060c2381758","Type":"ContainerStarted","Data":"9f2ed82f948079adbc5b1513b51f8736cb641e149cd42f112174ce791ab9e23f"}
Jul 15 19:46:55.527658 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:55.527619    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m" podStartSLOduration=1.414290044 podStartE2EDuration="8.527605967s" totalImagesPullingTime="7.113315923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:55.525877287 +0000 UTC m=+516.607071698" watchObservedRunningTime="2026-07-15 19:46:55.527605967 +0000 UTC m=+516.608800400"
Jul 15 19:46:55.548265 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:55.548214    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h" podStartSLOduration=1.315884667 podStartE2EDuration="4.548200416s" totalImagesPullingTime="3.232315749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:55.546359348 +0000 UTC m=+516.627553708" watchObservedRunningTime="2026-07-15 19:46:55.548200416 +0000 UTC m=+516.629394777"
Jul 15 19:46:56.460182 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:56.460137    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2wnc6"
Jul 15 19:46:57.525546 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:57.525453    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv" event={"ID":"56889e00-988d-4188-86b8-e060c2381758","Type":"ContainerStarted","Data":"b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108"}
Jul 15 19:46:57.525976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:57.525595    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:46:57.544612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:57.544462    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv" podStartSLOduration=1.756565822 podStartE2EDuration="3.544443347s" totalImagesPullingTime="1.787877525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:46:57.542107267 +0000 UTC m=+518.623301628" watchObservedRunningTime="2026-07-15 19:46:57.544443347 +0000 UTC m=+518.625637709"
Jul 15 19:46:58.197846 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.197811    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"]
Jul 15 19:46:58.201280 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.201262    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.203672 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.203647    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7djq2\""
Jul 15 19:46:58.203779 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.203728    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 19:46:58.203950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.203929    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 19:46:58.210442 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.210422    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"]
Jul 15 19:46:58.235520 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.235490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9f65\" (UniqueName: \"kubernetes.io/projected/cc84284e-4c30-491d-b730-18dbb2b8b2a0-kube-api-access-h9f65\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.235698 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.235554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc84284e-4c30-491d-b730-18dbb2b8b2a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.235698 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.235615    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc84284e-4c30-491d-b730-18dbb2b8b2a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.336818 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.336784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc84284e-4c30-491d-b730-18dbb2b8b2a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.336980 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.336834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc84284e-4c30-491d-b730-18dbb2b8b2a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.336980 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.336887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9f65\" (UniqueName: \"kubernetes.io/projected/cc84284e-4c30-491d-b730-18dbb2b8b2a0-kube-api-access-h9f65\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.337626 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.337599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc84284e-4c30-491d-b730-18dbb2b8b2a0-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.339072 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.339053    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc84284e-4c30-491d-b730-18dbb2b8b2a0-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.345883 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.345852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9f65\" (UniqueName: \"kubernetes.io/projected/cc84284e-4c30-491d-b730-18dbb2b8b2a0-kube-api-access-h9f65\") pod \"kuadrant-console-plugin-66b5774985-9tkz9\" (UID: \"cc84284e-4c30-491d-b730-18dbb2b8b2a0\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.511459 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.511378    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"
Jul 15 19:46:58.651710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:58.651683    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9"]
Jul 15 19:46:58.653453 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:46:58.653426    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc84284e_4c30_491d_b730_18dbb2b8b2a0.slice/crio-49c236bf544f47dce520e0663b520d4c224d4e8cf6f13d3258ffe26774124afc WatchSource:0}: Error finding container 49c236bf544f47dce520e0663b520d4c224d4e8cf6f13d3258ffe26774124afc: Status 404 returned error can't find the container with id 49c236bf544f47dce520e0663b520d4c224d4e8cf6f13d3258ffe26774124afc
Jul 15 19:46:59.539288 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:46:59.539252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9" event={"ID":"cc84284e-4c30-491d-b730-18dbb2b8b2a0","Type":"ContainerStarted","Data":"49c236bf544f47dce520e0663b520d4c224d4e8cf6f13d3258ffe26774124afc"}
Jul 15 19:47:06.521444 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:06.521412    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ksq4h"
Jul 15 19:47:06.521837 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:06.521484    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:08.532673 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.532636    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"]
Jul 15 19:47:08.533107 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.532907    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" containerName="manager" containerID="cri-o://51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0" gracePeriod=2
Jul 15 19:47:08.533794 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.533765    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:08.547451 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.547422    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"]
Jul 15 19:47:08.565289 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:08.565251    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7ef61be8-6220-482a-8468-ff1f8901a71d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-qd45m\": pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:08.571346 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.571320    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"]
Jul 15 19:47:08.578330 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.578304    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"]
Jul 15 19:47:08.578797 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.578778    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" containerName="manager"
Jul 15 19:47:08.578899 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.578800    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" containerName="manager"
Jul 15 19:47:08.578899 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.578884    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" containerName="manager"
Jul 15 19:47:08.583376 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.583354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:08.588952 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.588920    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"]
Jul 15 19:47:08.589519 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.589427    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv" podUID="56889e00-988d-4188-86b8-e060c2381758" containerName="manager" containerID="cri-o://b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108" gracePeriod=2
Jul 15 19:47:08.612687 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:08.612636    2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"56889e00-988d-4188-86b8-e060c2381758\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-15T19:47:08Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-15T19:47:08Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108\\\",\\\"image\\\":\\\"quay.io/kuadrant/limitador-operator:v0.17.1\\\",\\\"imageID\\\":\\\"quay.io/kuadrant/limitador-operator@sha256:3707fe24c6052d5adf240e12d34110706f0ac0877373830b67daab7c9a5c380d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"limits\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-15T19:46:57Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000680000],\\\"uid\\\":1000680000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-dr6kf\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-gbchv\": pods \"limitador-operator-controller-manager-859d7b78bd-gbchv\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:08.616795 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:08.616749    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:08.617612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.617587    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"]
Jul 15 19:47:08.628669 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:08.628591    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbchv\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="56889e00-988d-4188-86b8-e060c2381758" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:08.634725 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:08.634538    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:08.637894 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.637844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9505f985-4e35-493f-bc59-10e0e1271c8c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6dvq\" (UID: \"9505f985-4e35-493f-bc59-10e0e1271c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:08.638046 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.637914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf27c\" (UniqueName: \"kubernetes.io/projected/9505f985-4e35-493f-bc59-10e0e1271c8c-kube-api-access-vf27c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6dvq\" (UID: \"9505f985-4e35-493f-bc59-10e0e1271c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:08.652424 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.652395    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"]
Jul 15 19:47:08.652950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.652931    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56889e00-988d-4188-86b8-e060c2381758" containerName="manager"
Jul 15 19:47:08.652950 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.652950    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="56889e00-988d-4188-86b8-e060c2381758" containerName="manager"
Jul 15 19:47:08.653140 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.653035    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="56889e00-988d-4188-86b8-e060c2381758" containerName="manager"
Jul 15 19:47:08.656648 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.656627    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"
Jul 15 19:47:08.679335 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:08.679305    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbchv\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="56889e00-988d-4188-86b8-e060c2381758" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:08.681257 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:08.681224    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:08.682210 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.682187    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"]
Jul 15 19:47:08.738922 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.738879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9505f985-4e35-493f-bc59-10e0e1271c8c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6dvq\" (UID: \"9505f985-4e35-493f-bc59-10e0e1271c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:08.739123 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.738949    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf27c\" (UniqueName: \"kubernetes.io/projected/9505f985-4e35-493f-bc59-10e0e1271c8c-kube-api-access-vf27c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6dvq\" (UID: \"9505f985-4e35-493f-bc59-10e0e1271c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:08.739123 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.738989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4pck\" (UniqueName: \"kubernetes.io/projected/21f9fee5-2047-477b-8878-b70cfd73a5e1-kube-api-access-b4pck\") pod \"limitador-operator-controller-manager-859d7b78bd-vlg7h\" (UID: \"21f9fee5-2047-477b-8878-b70cfd73a5e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"
Jul 15 19:47:08.739334 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.739311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9505f985-4e35-493f-bc59-10e0e1271c8c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6dvq\" (UID: \"9505f985-4e35-493f-bc59-10e0e1271c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:08.756332 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.756296    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf27c\" (UniqueName: \"kubernetes.io/projected/9505f985-4e35-493f-bc59-10e0e1271c8c-kube-api-access-vf27c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p6dvq\" (UID: \"9505f985-4e35-493f-bc59-10e0e1271c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:08.839790 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.839745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4pck\" (UniqueName: \"kubernetes.io/projected/21f9fee5-2047-477b-8878-b70cfd73a5e1-kube-api-access-b4pck\") pod \"limitador-operator-controller-manager-859d7b78bd-vlg7h\" (UID: \"21f9fee5-2047-477b-8878-b70cfd73a5e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"
Jul 15 19:47:08.852537 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.852507    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4pck\" (UniqueName: \"kubernetes.io/projected/21f9fee5-2047-477b-8878-b70cfd73a5e1-kube-api-access-b4pck\") pod \"limitador-operator-controller-manager-859d7b78bd-vlg7h\" (UID: \"21f9fee5-2047-477b-8878-b70cfd73a5e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"
Jul 15 19:47:08.945105 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.945047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:08.967405 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:08.967369    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"
Jul 15 19:47:09.330835 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:09.330799    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbchv\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="56889e00-988d-4188-86b8-e060c2381758" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:09.333361 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:09.333330    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:22.089828 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.089802    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"]
Jul 15 19:47:22.092941 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:47:22.092913    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f9fee5_2047_477b_8878_b70cfd73a5e1.slice/crio-aa60337980c7d96adb31a0a3f818d2e074056a1dcd4b57465ab05367fa5dc789 WatchSource:0}: Error finding container aa60337980c7d96adb31a0a3f818d2e074056a1dcd4b57465ab05367fa5dc789: Status 404 returned error can't find the container with id aa60337980c7d96adb31a0a3f818d2e074056a1dcd4b57465ab05367fa5dc789
Jul 15 19:47:22.094450 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.094434    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:22.096798 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.096766    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:22.099050 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.099030    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:22.101302 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.101279    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbchv\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="56889e00-988d-4188-86b8-e060c2381758" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:22.103054 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.103030    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:22.117345 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.117322    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"]
Jul 15 19:47:22.121464 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:47:22.121436    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9505f985_4e35_493f_bc59_10e0e1271c8c.slice/crio-a0dcfd3b18eae706b1bd85c4be96a796dc0d59863b7f5a03d73e153369dcad6c WatchSource:0}: Error finding container a0dcfd3b18eae706b1bd85c4be96a796dc0d59863b7f5a03d73e153369dcad6c: Status 404 returned error can't find the container with id a0dcfd3b18eae706b1bd85c4be96a796dc0d59863b7f5a03d73e153369dcad6c
Jul 15 19:47:22.275218 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.275155    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef61be8-6220-482a-8468-ff1f8901a71d-extensions-socket-volume\") pod \"7ef61be8-6220-482a-8468-ff1f8901a71d\" (UID: \"7ef61be8-6220-482a-8468-ff1f8901a71d\") "
Jul 15 19:47:22.275380 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.275276    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr6kf\" (UniqueName: \"kubernetes.io/projected/56889e00-988d-4188-86b8-e060c2381758-kube-api-access-dr6kf\") pod \"56889e00-988d-4188-86b8-e060c2381758\" (UID: \"56889e00-988d-4188-86b8-e060c2381758\") "
Jul 15 19:47:22.275380 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.275325    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sw85v\" (UniqueName: \"kubernetes.io/projected/7ef61be8-6220-482a-8468-ff1f8901a71d-kube-api-access-sw85v\") pod \"7ef61be8-6220-482a-8468-ff1f8901a71d\" (UID: \"7ef61be8-6220-482a-8468-ff1f8901a71d\") "
Jul 15 19:47:22.275746 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.275716    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef61be8-6220-482a-8468-ff1f8901a71d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ef61be8-6220-482a-8468-ff1f8901a71d" (UID: "7ef61be8-6220-482a-8468-ff1f8901a71d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:47:22.277397 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.277372    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56889e00-988d-4188-86b8-e060c2381758-kube-api-access-dr6kf" (OuterVolumeSpecName: "kube-api-access-dr6kf") pod "56889e00-988d-4188-86b8-e060c2381758" (UID: "56889e00-988d-4188-86b8-e060c2381758"). InnerVolumeSpecName "kube-api-access-dr6kf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:47:22.277488 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.277446    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef61be8-6220-482a-8468-ff1f8901a71d-kube-api-access-sw85v" (OuterVolumeSpecName: "kube-api-access-sw85v") pod "7ef61be8-6220-482a-8468-ff1f8901a71d" (UID: "7ef61be8-6220-482a-8468-ff1f8901a71d"). InnerVolumeSpecName "kube-api-access-sw85v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:47:22.376001 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.375966    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr6kf\" (UniqueName: \"kubernetes.io/projected/56889e00-988d-4188-86b8-e060c2381758-kube-api-access-dr6kf\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:47:22.376001 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.375995    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sw85v\" (UniqueName: \"kubernetes.io/projected/7ef61be8-6220-482a-8468-ff1f8901a71d-kube-api-access-sw85v\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:47:22.376001 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.376004    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef61be8-6220-482a-8468-ff1f8901a71d-extensions-socket-volume\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:47:22.669839 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.669807    2576 generic.go:356] "Generic (PLEG): container finished" podID="56889e00-988d-4188-86b8-e060c2381758" containerID="b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108" exitCode=0
Jul 15 19:47:22.670017 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.669854    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:22.670017 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.669890    2576 scope.go:117] "RemoveContainer" containerID="b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108"
Jul 15 19:47:22.671930 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.671897    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq" event={"ID":"9505f985-4e35-493f-bc59-10e0e1271c8c","Type":"ContainerStarted","Data":"be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81"}
Jul 15 19:47:22.672065 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.671962    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq" event={"ID":"9505f985-4e35-493f-bc59-10e0e1271c8c","Type":"ContainerStarted","Data":"a0dcfd3b18eae706b1bd85c4be96a796dc0d59863b7f5a03d73e153369dcad6c"}
Jul 15 19:47:22.672065 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.671994    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:22.672349 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.672317    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbchv\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="56889e00-988d-4188-86b8-e060c2381758" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:22.673710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.673683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h" event={"ID":"21f9fee5-2047-477b-8878-b70cfd73a5e1","Type":"ContainerStarted","Data":"fff1f6ea55070eb1b0672073f7dea1ecaad29de2d420007c710e2d08cd8c420d"}
Jul 15 19:47:22.673819 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.673735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h" event={"ID":"21f9fee5-2047-477b-8878-b70cfd73a5e1","Type":"ContainerStarted","Data":"aa60337980c7d96adb31a0a3f818d2e074056a1dcd4b57465ab05367fa5dc789"}
Jul 15 19:47:22.673819 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.673766    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"
Jul 15 19:47:22.674243 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.674219    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:22.675505 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.675478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9" event={"ID":"cc84284e-4c30-491d-b730-18dbb2b8b2a0","Type":"ContainerStarted","Data":"c68783743876608ab4a43aa2e811b7550e95c0cdd8f9b527926417bc6c1da9b8"}
Jul 15 19:47:22.676205 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.676182    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:22.676836 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.676818    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ef61be8-6220-482a-8468-ff1f8901a71d" containerID="51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0" exitCode=0
Jul 15 19:47:22.676912 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.676858    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:22.680260 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.679870    2576 scope.go:117] "RemoveContainer" containerID="b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108"
Jul 15 19:47:22.680533 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.680401    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108\": container with ID starting with b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108 not found: ID does not exist" containerID="b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108"
Jul 15 19:47:22.680646 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.680547    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108"} err="failed to get container status \"b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108\": rpc error: code = NotFound desc = could not find container \"b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108\": container with ID starting with b250ecf40854f9678c6819fc0ab59c4d5d6dbeb975c2027576fd417283da3108 not found: ID does not exist"
Jul 15 19:47:22.680705 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.680573    2576 scope.go:117] "RemoveContainer" containerID="51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0"
Jul 15 19:47:22.691195 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.691155    2576 scope.go:117] "RemoveContainer" containerID="51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0"
Jul 15 19:47:22.691434 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.691414    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0\": container with ID starting with 51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0 not found: ID does not exist" containerID="51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0"
Jul 15 19:47:22.691479 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.691441    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0"} err="failed to get container status \"51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0\": rpc error: code = NotFound desc = could not find container \"51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0\": container with ID starting with 51673dd422ab8e5a9c8469ceef00fe9565ee9b777267a1b81e03f16e4f957ee0 not found: ID does not exist"
Jul 15 19:47:22.696877 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.696836    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq" podStartSLOduration=14.696825077 podStartE2EDuration="14.696825077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:22.696467411 +0000 UTC m=+543.777661792" watchObservedRunningTime="2026-07-15 19:47:22.696825077 +0000 UTC m=+543.778019437"
Jul 15 19:47:22.714856 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.714814    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h" podStartSLOduration=14.714801916 podStartE2EDuration="14.714801916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:22.713107093 +0000 UTC m=+543.794301454" watchObservedRunningTime="2026-07-15 19:47:22.714801916 +0000 UTC m=+543.795996277"
Jul 15 19:47:22.715133 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.715111    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbchv\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="56889e00-988d-4188-86b8-e060c2381758" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:22.716832 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.716812    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gbchv\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="56889e00-988d-4188-86b8-e060c2381758" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gbchv"
Jul 15 19:47:22.733762 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:22.733730    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qd45m\" is forbidden: User \"system:node:ip-10-0-128-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-48.ec2.internal' and this object" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qd45m"
Jul 15 19:47:22.733762 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:22.733730    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9tkz9" podStartSLOduration=1.367265712 podStartE2EDuration="24.733716256s" totalImagesPullingTime="23.366450544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:22.731423567 +0000 UTC m=+543.812617929" watchObservedRunningTime="2026-07-15 19:47:22.733716256 +0000 UTC m=+543.814910616"
Jul 15 19:47:23.331917 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:23.331885    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56889e00-988d-4188-86b8-e060c2381758" path="/var/lib/kubelet/pods/56889e00-988d-4188-86b8-e060c2381758/volumes"
Jul 15 19:47:23.332296 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:23.332261    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef61be8-6220-482a-8468-ff1f8901a71d" path="/var/lib/kubelet/pods/7ef61be8-6220-482a-8468-ff1f8901a71d/volumes"
Jul 15 19:47:26.270541 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.270506    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"]
Jul 15 19:47:26.270975 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.270721    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq" podUID="9505f985-4e35-493f-bc59-10e0e1271c8c" containerName="manager" containerID="cri-o://be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81" gracePeriod=10
Jul 15 19:47:26.525835 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.525772    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:26.613843 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.613810    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9505f985-4e35-493f-bc59-10e0e1271c8c-extensions-socket-volume\") pod \"9505f985-4e35-493f-bc59-10e0e1271c8c\" (UID: \"9505f985-4e35-493f-bc59-10e0e1271c8c\") "
Jul 15 19:47:26.614039 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.613879    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf27c\" (UniqueName: \"kubernetes.io/projected/9505f985-4e35-493f-bc59-10e0e1271c8c-kube-api-access-vf27c\") pod \"9505f985-4e35-493f-bc59-10e0e1271c8c\" (UID: \"9505f985-4e35-493f-bc59-10e0e1271c8c\") "
Jul 15 19:47:26.614291 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.614267    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9505f985-4e35-493f-bc59-10e0e1271c8c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9505f985-4e35-493f-bc59-10e0e1271c8c" (UID: "9505f985-4e35-493f-bc59-10e0e1271c8c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 19:47:26.615900 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.615880    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9505f985-4e35-493f-bc59-10e0e1271c8c-kube-api-access-vf27c" (OuterVolumeSpecName: "kube-api-access-vf27c") pod "9505f985-4e35-493f-bc59-10e0e1271c8c" (UID: "9505f985-4e35-493f-bc59-10e0e1271c8c"). InnerVolumeSpecName "kube-api-access-vf27c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:47:26.698947 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.698917    2576 generic.go:356] "Generic (PLEG): container finished" podID="9505f985-4e35-493f-bc59-10e0e1271c8c" containerID="be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81" exitCode=0
Jul 15 19:47:26.699111 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.698964    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"
Jul 15 19:47:26.699111 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.699007    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq" event={"ID":"9505f985-4e35-493f-bc59-10e0e1271c8c","Type":"ContainerDied","Data":"be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81"}
Jul 15 19:47:26.699111 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.699065    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq" event={"ID":"9505f985-4e35-493f-bc59-10e0e1271c8c","Type":"ContainerDied","Data":"a0dcfd3b18eae706b1bd85c4be96a796dc0d59863b7f5a03d73e153369dcad6c"}
Jul 15 19:47:26.699111 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.699095    2576 scope.go:117] "RemoveContainer" containerID="be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81"
Jul 15 19:47:26.711001 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.710982    2576 scope.go:117] "RemoveContainer" containerID="be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81"
Jul 15 19:47:26.711282 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:47:26.711263    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81\": container with ID starting with be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81 not found: ID does not exist" containerID="be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81"
Jul 15 19:47:26.711362 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.711296    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81"} err="failed to get container status \"be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81\": rpc error: code = NotFound desc = could not find container \"be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81\": container with ID starting with be0781059ff405d1133e333306d6f3ed41917c00fa1cba6b9213e1d2386e9d81 not found: ID does not exist"
Jul 15 19:47:26.714696 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.714676    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9505f985-4e35-493f-bc59-10e0e1271c8c-extensions-socket-volume\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:47:26.714696 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.714697    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf27c\" (UniqueName: \"kubernetes.io/projected/9505f985-4e35-493f-bc59-10e0e1271c8c-kube-api-access-vf27c\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:47:26.730458 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.730420    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"]
Jul 15 19:47:26.743309 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:26.743285    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p6dvq"]
Jul 15 19:47:27.331664 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:27.331633    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9505f985-4e35-493f-bc59-10e0e1271c8c" path="/var/lib/kubelet/pods/9505f985-4e35-493f-bc59-10e0e1271c8c/volumes"
Jul 15 19:47:33.690420 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:33.690388    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vlg7h"
Jul 15 19:47:42.603988 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.603955    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"]
Jul 15 19:47:42.604374 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.604360    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9505f985-4e35-493f-bc59-10e0e1271c8c" containerName="manager"
Jul 15 19:47:42.604416 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.604376    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9505f985-4e35-493f-bc59-10e0e1271c8c" containerName="manager"
Jul 15 19:47:42.604464 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.604455    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9505f985-4e35-493f-bc59-10e0e1271c8c" containerName="manager"
Jul 15 19:47:42.609598 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.609575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.612155 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.612134    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dc56v\""
Jul 15 19:47:42.621116 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.621094    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"]
Jul 15 19:47:42.654915 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.654882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.655076 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.654923    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.655076 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.654944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.655076 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.654964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.655076 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.655006    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.655231 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.655115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.655231 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.655178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.655231 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.655213    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t5pq\" (UniqueName: \"kubernetes.io/projected/20ceeb54-89d4-4e26-838c-fe431b9df03a-kube-api-access-9t5pq\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.655337 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.655237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20ceeb54-89d4-4e26-838c-fe431b9df03a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.755973 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.755940    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756268 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.755982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756268 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756268 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756016    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756268 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756268 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756268 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756268 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t5pq\" (UniqueName: \"kubernetes.io/projected/20ceeb54-89d4-4e26-838c-fe431b9df03a-kube-api-access-9t5pq\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756268 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756205    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20ceeb54-89d4-4e26-838c-fe431b9df03a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756695 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756463    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756695 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756545    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756695 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756643    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756867 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756845    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.756915 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.756899    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20ceeb54-89d4-4e26-838c-fe431b9df03a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.758302 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.758279    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.758502 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.758485    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.765137 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.765110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20ceeb54-89d4-4e26-838c-fe431b9df03a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.765331 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.765313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t5pq\" (UniqueName: \"kubernetes.io/projected/20ceeb54-89d4-4e26-838c-fe431b9df03a-kube-api-access-9t5pq\") pod \"maas-default-gateway-openshift-default-56654dcf7-8bcgk\" (UID: \"20ceeb54-89d4-4e26-838c-fe431b9df03a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:42.921019 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:42.920936    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:43.073712 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:43.073681    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"]
Jul 15 19:47:43.076517 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:47:43.076485    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ceeb54_89d4_4e26_838c_fe431b9df03a.slice/crio-cb48778e54d5abe8c6c00b093cf89c686d6d88bc76b9585946e24f0a5125eea7 WatchSource:0}: Error finding container cb48778e54d5abe8c6c00b093cf89c686d6d88bc76b9585946e24f0a5125eea7: Status 404 returned error can't find the container with id cb48778e54d5abe8c6c00b093cf89c686d6d88bc76b9585946e24f0a5125eea7
Jul 15 19:47:43.078847 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:43.078816    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:47:43.078934 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:43.078883    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:47:43.078934 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:43.078909    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:47:43.779987 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:43.779954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" event={"ID":"20ceeb54-89d4-4e26-838c-fe431b9df03a","Type":"ContainerStarted","Data":"eef66ead237c43bcf5e450906c0a1d165fb52246369471cbab056719716b2c6d"}
Jul 15 19:47:43.780370 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:43.780004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" event={"ID":"20ceeb54-89d4-4e26-838c-fe431b9df03a","Type":"ContainerStarted","Data":"cb48778e54d5abe8c6c00b093cf89c686d6d88bc76b9585946e24f0a5125eea7"}
Jul 15 19:47:43.921478 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:43.921450    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:44.848330 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.848273    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" podStartSLOduration=2.848254159 podStartE2EDuration="2.848254159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:43.805917685 +0000 UTC m=+564.887112028" watchObservedRunningTime="2026-07-15 19:47:44.848254159 +0000 UTC m=+565.929448588"
Jul 15 19:47:44.849866 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.849849    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srf8j"]
Jul 15 19:47:44.895661 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.895627    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srf8j"]
Jul 15 19:47:44.895807 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.895740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:44.898323 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.898299    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 19:47:44.926026 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.926003    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:44.944003 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.943962    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srf8j"]
Jul 15 19:47:44.984005 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.983978    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z6z4\" (UniqueName: \"kubernetes.io/projected/b7d8edb9-d131-4797-b0d2-56d40344a838-kube-api-access-7z6z4\") pod \"limitador-limitador-64c94fd64f-srf8j\" (UID: \"b7d8edb9-d131-4797-b0d2-56d40344a838\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:44.984190 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:44.984021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7d8edb9-d131-4797-b0d2-56d40344a838-config-file\") pod \"limitador-limitador-64c94fd64f-srf8j\" (UID: \"b7d8edb9-d131-4797-b0d2-56d40344a838\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:45.084655 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.084619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z6z4\" (UniqueName: \"kubernetes.io/projected/b7d8edb9-d131-4797-b0d2-56d40344a838-kube-api-access-7z6z4\") pod \"limitador-limitador-64c94fd64f-srf8j\" (UID: \"b7d8edb9-d131-4797-b0d2-56d40344a838\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:45.084825 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.084673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7d8edb9-d131-4797-b0d2-56d40344a838-config-file\") pod \"limitador-limitador-64c94fd64f-srf8j\" (UID: \"b7d8edb9-d131-4797-b0d2-56d40344a838\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:45.085390 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.085371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7d8edb9-d131-4797-b0d2-56d40344a838-config-file\") pod \"limitador-limitador-64c94fd64f-srf8j\" (UID: \"b7d8edb9-d131-4797-b0d2-56d40344a838\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:45.093889 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.093860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z6z4\" (UniqueName: \"kubernetes.io/projected/b7d8edb9-d131-4797-b0d2-56d40344a838-kube-api-access-7z6z4\") pod \"limitador-limitador-64c94fd64f-srf8j\" (UID: \"b7d8edb9-d131-4797-b0d2-56d40344a838\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:45.207508 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.207431    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:45.377447 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.377423    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srf8j"]
Jul 15 19:47:45.379600 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:47:45.379575    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d8edb9_d131_4797_b0d2_56d40344a838.slice/crio-3d9862e741b7726fb871b43906264f8d8c56184759234ef83b3026f03d4ae5fd WatchSource:0}: Error finding container 3d9862e741b7726fb871b43906264f8d8c56184759234ef83b3026f03d4ae5fd: Status 404 returned error can't find the container with id 3d9862e741b7726fb871b43906264f8d8c56184759234ef83b3026f03d4ae5fd
Jul 15 19:47:45.791904 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.791874    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j" event={"ID":"b7d8edb9-d131-4797-b0d2-56d40344a838","Type":"ContainerStarted","Data":"3d9862e741b7726fb871b43906264f8d8c56184759234ef83b3026f03d4ae5fd"}
Jul 15 19:47:45.792181 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.792140    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:45.792932 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.792916    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:47:45.864715 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.864684    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-q99zk"]
Jul 15 19:47:45.937806 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.937774    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q99zk"]
Jul 15 19:47:45.937951 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.937874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q99zk"
Jul 15 19:47:45.941465 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.941446    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-78smg\""
Jul 15 19:47:45.994038 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:45.994002    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfkkk\" (UniqueName: \"kubernetes.io/projected/fdd01952-1a11-4153-834f-c2d647292e2e-kube-api-access-vfkkk\") pod \"authorino-75d556bd77-q99zk\" (UID: \"fdd01952-1a11-4153-834f-c2d647292e2e\") " pod="kuadrant-system/authorino-75d556bd77-q99zk"
Jul 15 19:47:46.095300 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:46.095259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfkkk\" (UniqueName: \"kubernetes.io/projected/fdd01952-1a11-4153-834f-c2d647292e2e-kube-api-access-vfkkk\") pod \"authorino-75d556bd77-q99zk\" (UID: \"fdd01952-1a11-4153-834f-c2d647292e2e\") " pod="kuadrant-system/authorino-75d556bd77-q99zk"
Jul 15 19:47:46.115043 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:46.114999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfkkk\" (UniqueName: \"kubernetes.io/projected/fdd01952-1a11-4153-834f-c2d647292e2e-kube-api-access-vfkkk\") pod \"authorino-75d556bd77-q99zk\" (UID: \"fdd01952-1a11-4153-834f-c2d647292e2e\") " pod="kuadrant-system/authorino-75d556bd77-q99zk"
Jul 15 19:47:46.247705 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:46.247659    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q99zk"
Jul 15 19:47:46.422628 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:46.422594    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q99zk"]
Jul 15 19:47:46.426221 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:47:46.426187    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdd01952_1a11_4153_834f_c2d647292e2e.slice/crio-9c94438141eb39c9496d6dab6d45b4a5d6087ab5512616d6faaf27c67f95957a WatchSource:0}: Error finding container 9c94438141eb39c9496d6dab6d45b4a5d6087ab5512616d6faaf27c67f95957a: Status 404 returned error can't find the container with id 9c94438141eb39c9496d6dab6d45b4a5d6087ab5512616d6faaf27c67f95957a
Jul 15 19:47:46.799702 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:46.799624    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q99zk" event={"ID":"fdd01952-1a11-4153-834f-c2d647292e2e","Type":"ContainerStarted","Data":"9c94438141eb39c9496d6dab6d45b4a5d6087ab5512616d6faaf27c67f95957a"}
Jul 15 19:47:52.835939 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:52.835897    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j" event={"ID":"b7d8edb9-d131-4797-b0d2-56d40344a838","Type":"ContainerStarted","Data":"fb787ae8fefa8003beabadd4590a39869efb116733c196df7a11bc6623a2542d"}
Jul 15 19:47:52.836400 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:52.836021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:47:52.837611 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:52.837586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q99zk" event={"ID":"fdd01952-1a11-4153-834f-c2d647292e2e","Type":"ContainerStarted","Data":"a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8"}
Jul 15 19:47:52.854343 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:52.854294    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j" podStartSLOduration=2.371052369 podStartE2EDuration="8.854279782s" totalImagesPullingTime="6.483227413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:52.853885157 +0000 UTC m=+573.935079541" watchObservedRunningTime="2026-07-15 19:47:52.854279782 +0000 UTC m=+573.935474143"
Jul 15 19:47:52.868053 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:47:52.867879    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-q99zk" podStartSLOduration=2.421211192 podStartE2EDuration="7.867865641s" totalImagesPullingTime="5.446654449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:47:52.867316189 +0000 UTC m=+573.948510540" watchObservedRunningTime="2026-07-15 19:47:52.867865641 +0000 UTC m=+573.949060006"
Jul 15 19:48:00.006159 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:00.006125    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srf8j"]
Jul 15 19:48:00.006555 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:00.006328    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j" podUID="b7d8edb9-d131-4797-b0d2-56d40344a838" containerName="limitador" containerID="cri-o://fb787ae8fefa8003beabadd4590a39869efb116733c196df7a11bc6623a2542d" gracePeriod=30
Jul 15 19:48:00.008579 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:00.008554    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:48:00.878271 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:00.878246    2576 generic.go:356] "Generic (PLEG): container finished" podID="b7d8edb9-d131-4797-b0d2-56d40344a838" containerID="fb787ae8fefa8003beabadd4590a39869efb116733c196df7a11bc6623a2542d" exitCode=0
Jul 15 19:48:00.878396 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:00.878317    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j" event={"ID":"b7d8edb9-d131-4797-b0d2-56d40344a838","Type":"ContainerDied","Data":"fb787ae8fefa8003beabadd4590a39869efb116733c196df7a11bc6623a2542d"}
Jul 15 19:48:00.960110 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:00.960085    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:48:01.139603 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.139509    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7d8edb9-d131-4797-b0d2-56d40344a838-config-file\") pod \"b7d8edb9-d131-4797-b0d2-56d40344a838\" (UID: \"b7d8edb9-d131-4797-b0d2-56d40344a838\") "
Jul 15 19:48:01.140049 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.139617    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7z6z4\" (UniqueName: \"kubernetes.io/projected/b7d8edb9-d131-4797-b0d2-56d40344a838-kube-api-access-7z6z4\") pod \"b7d8edb9-d131-4797-b0d2-56d40344a838\" (UID: \"b7d8edb9-d131-4797-b0d2-56d40344a838\") "
Jul 15 19:48:01.140049 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.139859    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7d8edb9-d131-4797-b0d2-56d40344a838-config-file" (OuterVolumeSpecName: "config-file") pod "b7d8edb9-d131-4797-b0d2-56d40344a838" (UID: "b7d8edb9-d131-4797-b0d2-56d40344a838"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 19:48:01.141686 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.141664    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d8edb9-d131-4797-b0d2-56d40344a838-kube-api-access-7z6z4" (OuterVolumeSpecName: "kube-api-access-7z6z4") pod "b7d8edb9-d131-4797-b0d2-56d40344a838" (UID: "b7d8edb9-d131-4797-b0d2-56d40344a838"). InnerVolumeSpecName "kube-api-access-7z6z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:48:01.240304 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.240266    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z6z4\" (UniqueName: \"kubernetes.io/projected/b7d8edb9-d131-4797-b0d2-56d40344a838-kube-api-access-7z6z4\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:48:01.240304 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.240305    2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b7d8edb9-d131-4797-b0d2-56d40344a838-config-file\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:48:01.884607 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.884578    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j"
Jul 15 19:48:01.884607 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.884593    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-srf8j" event={"ID":"b7d8edb9-d131-4797-b0d2-56d40344a838","Type":"ContainerDied","Data":"3d9862e741b7726fb871b43906264f8d8c56184759234ef83b3026f03d4ae5fd"}
Jul 15 19:48:01.884862 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.884651    2576 scope.go:117] "RemoveContainer" containerID="fb787ae8fefa8003beabadd4590a39869efb116733c196df7a11bc6623a2542d"
Jul 15 19:48:01.901673 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.901646    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srf8j"]
Jul 15 19:48:01.909264 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:01.909242    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-srf8j"]
Jul 15 19:48:03.332034 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:03.332002    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7d8edb9-d131-4797-b0d2-56d40344a838" path="/var/lib/kubelet/pods/b7d8edb9-d131-4797-b0d2-56d40344a838/volumes"
Jul 15 19:48:06.489411 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.489377    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"]
Jul 15 19:48:06.489962 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.489946    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d8edb9-d131-4797-b0d2-56d40344a838" containerName="limitador"
Jul 15 19:48:06.490009 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.489965    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d8edb9-d131-4797-b0d2-56d40344a838" containerName="limitador"
Jul 15 19:48:06.490067 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.490056    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d8edb9-d131-4797-b0d2-56d40344a838" containerName="limitador"
Jul 15 19:48:06.494628 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.494609    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:06.497326 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.497302    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 19:48:06.497463 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.497334    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 19:48:06.497463 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.497333    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 19:48:06.497981 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.497967    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-hhvrk\""
Jul 15 19:48:06.507458 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.507433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"]
Jul 15 19:48:06.597451 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.597415    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace-data\") pod \"postgres-69fb4594cf-tshmv\" (UID: \"aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:06.597648 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.597536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2mfz\" (UniqueName: \"kubernetes.io/projected/aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace-kube-api-access-s2mfz\") pod \"postgres-69fb4594cf-tshmv\" (UID: \"aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:06.698395 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.698359    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2mfz\" (UniqueName: \"kubernetes.io/projected/aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace-kube-api-access-s2mfz\") pod \"postgres-69fb4594cf-tshmv\" (UID: \"aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:06.698595 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.698424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace-data\") pod \"postgres-69fb4594cf-tshmv\" (UID: \"aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:06.698769 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.698752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace-data\") pod \"postgres-69fb4594cf-tshmv\" (UID: \"aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:06.707339 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.707312    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2mfz\" (UniqueName: \"kubernetes.io/projected/aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace-kube-api-access-s2mfz\") pod \"postgres-69fb4594cf-tshmv\" (UID: \"aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:06.805124 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.805100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:06.941298 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:06.941275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"]
Jul 15 19:48:06.943157 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:48:06.943127    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4b6bc6_5c96_4be8_bf4c_332a7eae4ace.slice/crio-38c2fe0fc90f8cd03b241118b2bc3d4705427c9334fa1e64c0a4cfed93960008 WatchSource:0}: Error finding container 38c2fe0fc90f8cd03b241118b2bc3d4705427c9334fa1e64c0a4cfed93960008: Status 404 returned error can't find the container with id 38c2fe0fc90f8cd03b241118b2bc3d4705427c9334fa1e64c0a4cfed93960008
Jul 15 19:48:07.917554 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:07.917519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv" event={"ID":"aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace","Type":"ContainerStarted","Data":"38c2fe0fc90f8cd03b241118b2bc3d4705427c9334fa1e64c0a4cfed93960008"}
Jul 15 19:48:14.956820 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:14.956767    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv" event={"ID":"aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace","Type":"ContainerStarted","Data":"30e56807760471d474324f303414f3d2da178b1a160f5a096e62f459e126f616"}
Jul 15 19:48:14.957198 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:14.956867    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:14.974062 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:14.974012    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv" podStartSLOduration=1.053539502 podStartE2EDuration="8.973995287s" totalImagesPullingTime="7.920455785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:48:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:48:14.972934675 +0000 UTC m=+596.054129057" watchObservedRunningTime="2026-07-15 19:48:14.973995287 +0000 UTC m=+596.055189648"
Jul 15 19:48:20.991912 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:20.991881    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tshmv"
Jul 15 19:48:21.586270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:21.586234    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6g7hj"]
Jul 15 19:48:21.653281 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:21.653237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6g7hj"]
Jul 15 19:48:21.653468 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:21.653363    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6g7hj"
Jul 15 19:48:21.739023 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:21.738989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjf6s\" (UniqueName: \"kubernetes.io/projected/c56e62f0-e91f-43dd-9b3c-96d5fd388ce4-kube-api-access-mjf6s\") pod \"authorino-5d4b67c446-6g7hj\" (UID: \"c56e62f0-e91f-43dd-9b3c-96d5fd388ce4\") " pod="kuadrant-system/authorino-5d4b67c446-6g7hj"
Jul 15 19:48:21.820694 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:21.820654    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6g7hj"]
Jul 15 19:48:21.820996 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:48:21.820974    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-mjf6s], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-6g7hj" podUID="c56e62f0-e91f-43dd-9b3c-96d5fd388ce4"
Jul 15 19:48:21.840253 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:21.840143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjf6s\" (UniqueName: \"kubernetes.io/projected/c56e62f0-e91f-43dd-9b3c-96d5fd388ce4-kube-api-access-mjf6s\") pod \"authorino-5d4b67c446-6g7hj\" (UID: \"c56e62f0-e91f-43dd-9b3c-96d5fd388ce4\") " pod="kuadrant-system/authorino-5d4b67c446-6g7hj"
Jul 15 19:48:21.851915 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:21.851887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjf6s\" (UniqueName: \"kubernetes.io/projected/c56e62f0-e91f-43dd-9b3c-96d5fd388ce4-kube-api-access-mjf6s\") pod \"authorino-5d4b67c446-6g7hj\" (UID: \"c56e62f0-e91f-43dd-9b3c-96d5fd388ce4\") " pod="kuadrant-system/authorino-5d4b67c446-6g7hj"
Jul 15 19:48:21.991688 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:21.991657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6g7hj"
Jul 15 19:48:22.034323 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:22.034287    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6g7hj"
Jul 15 19:48:22.142497 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:22.142422    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjf6s\" (UniqueName: \"kubernetes.io/projected/c56e62f0-e91f-43dd-9b3c-96d5fd388ce4-kube-api-access-mjf6s\") pod \"c56e62f0-e91f-43dd-9b3c-96d5fd388ce4\" (UID: \"c56e62f0-e91f-43dd-9b3c-96d5fd388ce4\") "
Jul 15 19:48:22.144472 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:22.144439    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56e62f0-e91f-43dd-9b3c-96d5fd388ce4-kube-api-access-mjf6s" (OuterVolumeSpecName: "kube-api-access-mjf6s") pod "c56e62f0-e91f-43dd-9b3c-96d5fd388ce4" (UID: "c56e62f0-e91f-43dd-9b3c-96d5fd388ce4"). InnerVolumeSpecName "kube-api-access-mjf6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:48:22.243523 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:22.243486    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjf6s\" (UniqueName: \"kubernetes.io/projected/c56e62f0-e91f-43dd-9b3c-96d5fd388ce4-kube-api-access-mjf6s\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:48:22.996870 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:22.996838    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-6g7hj"
Jul 15 19:48:23.027650 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:23.027622    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6g7hj"]
Jul 15 19:48:23.033298 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:23.033273    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-6g7hj"]
Jul 15 19:48:23.331903 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:23.331864    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56e62f0-e91f-43dd-9b3c-96d5fd388ce4" path="/var/lib/kubelet/pods/c56e62f0-e91f-43dd-9b3c-96d5fd388ce4/volumes"
Jul 15 19:48:23.632238 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:23.632134    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q99zk"]
Jul 15 19:48:23.632461 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:23.632359    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-q99zk" podUID="fdd01952-1a11-4153-834f-c2d647292e2e" containerName="authorino" containerID="cri-o://a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8" gracePeriod=30
Jul 15 19:48:23.885024 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:23.884959    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q99zk"
Jul 15 19:48:23.958726 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:23.958691    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfkkk\" (UniqueName: \"kubernetes.io/projected/fdd01952-1a11-4153-834f-c2d647292e2e-kube-api-access-vfkkk\") pod \"fdd01952-1a11-4153-834f-c2d647292e2e\" (UID: \"fdd01952-1a11-4153-834f-c2d647292e2e\") "
Jul 15 19:48:23.960758 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:23.960732    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdd01952-1a11-4153-834f-c2d647292e2e-kube-api-access-vfkkk" (OuterVolumeSpecName: "kube-api-access-vfkkk") pod "fdd01952-1a11-4153-834f-c2d647292e2e" (UID: "fdd01952-1a11-4153-834f-c2d647292e2e"). InnerVolumeSpecName "kube-api-access-vfkkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:48:24.003236 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.003202    2576 generic.go:356] "Generic (PLEG): container finished" podID="fdd01952-1a11-4153-834f-c2d647292e2e" containerID="a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8" exitCode=0
Jul 15 19:48:24.003388 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.003256    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q99zk" event={"ID":"fdd01952-1a11-4153-834f-c2d647292e2e","Type":"ContainerDied","Data":"a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8"}
Jul 15 19:48:24.003388 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.003294    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q99zk" event={"ID":"fdd01952-1a11-4153-834f-c2d647292e2e","Type":"ContainerDied","Data":"9c94438141eb39c9496d6dab6d45b4a5d6087ab5512616d6faaf27c67f95957a"}
Jul 15 19:48:24.003388 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.003307    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q99zk"
Jul 15 19:48:24.003388 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.003315    2576 scope.go:117] "RemoveContainer" containerID="a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8"
Jul 15 19:48:24.015978 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.015959    2576 scope.go:117] "RemoveContainer" containerID="a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8"
Jul 15 19:48:24.016355 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:48:24.016333    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8\": container with ID starting with a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8 not found: ID does not exist" containerID="a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8"
Jul 15 19:48:24.016421 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.016364    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8"} err="failed to get container status \"a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8\": rpc error: code = NotFound desc = could not find container \"a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8\": container with ID starting with a534ef328b243c91a3012956e4b1002b71b288cccdc99c30c2984063b5342bf8 not found: ID does not exist"
Jul 15 19:48:24.026937 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.026905    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q99zk"]
Jul 15 19:48:24.033864 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.033827    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q99zk"]
Jul 15 19:48:24.060047 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:24.060014    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfkkk\" (UniqueName: \"kubernetes.io/projected/fdd01952-1a11-4153-834f-c2d647292e2e-kube-api-access-vfkkk\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:48:25.331424 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:25.331393    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdd01952-1a11-4153-834f-c2d647292e2e" path="/var/lib/kubelet/pods/fdd01952-1a11-4153-834f-c2d647292e2e/volumes"
Jul 15 19:48:28.375621 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.375592    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54c6499cc5-cnkz5"]
Jul 15 19:48:28.376008 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.375994    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdd01952-1a11-4153-834f-c2d647292e2e" containerName="authorino"
Jul 15 19:48:28.376064 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.376009    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdd01952-1a11-4153-834f-c2d647292e2e" containerName="authorino"
Jul 15 19:48:28.376098 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.376071    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdd01952-1a11-4153-834f-c2d647292e2e" containerName="authorino"
Jul 15 19:48:28.380071 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.380052    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:28.384912 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.384888    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 19:48:28.385112 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.385097    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rq4np\""
Jul 15 19:48:28.386019 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.385999    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 19:48:28.396203 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.396153    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c6499cc5-cnkz5"]
Jul 15 19:48:28.501973 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.501940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert\") pod \"maas-controller-54c6499cc5-cnkz5\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") " pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:28.501973 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.501975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfjf4\" (UniqueName: \"kubernetes.io/projected/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-kube-api-access-tfjf4\") pod \"maas-controller-54c6499cc5-cnkz5\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") " pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:28.602588 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.602550    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert\") pod \"maas-controller-54c6499cc5-cnkz5\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") " pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:28.602588 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.602590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfjf4\" (UniqueName: \"kubernetes.io/projected/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-kube-api-access-tfjf4\") pod \"maas-controller-54c6499cc5-cnkz5\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") " pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:28.602780 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:48:28.602669    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 15 19:48:28.602780 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:48:28.602742    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert podName:32acf62e-dd4d-4b1e-ae67-20d5a744d36c nodeName:}" failed. No retries permitted until 2026-07-15 19:48:29.10272405 +0000 UTC m=+610.183918391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert") pod "maas-controller-54c6499cc5-cnkz5" (UID: "32acf62e-dd4d-4b1e-ae67-20d5a744d36c") : secret "maas-controller-webhook-cert" not found
Jul 15 19:48:28.625255 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.625230    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfjf4\" (UniqueName: \"kubernetes.io/projected/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-kube-api-access-tfjf4\") pod \"maas-controller-54c6499cc5-cnkz5\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") " pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:28.626284 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.626236    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-648dfbd599-nbqgl"]
Jul 15 19:48:28.630030 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.630013    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:28.648827 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.648799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-648dfbd599-nbqgl"]
Jul 15 19:48:28.703656 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.703620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx9xh\" (UniqueName: \"kubernetes.io/projected/1d16496f-9d4e-4300-8fcd-391dc25fd315-kube-api-access-nx9xh\") pod \"maas-controller-648dfbd599-nbqgl\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") " pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:28.703839 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.703683    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert\") pod \"maas-controller-648dfbd599-nbqgl\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") " pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:28.805042 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.805000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx9xh\" (UniqueName: \"kubernetes.io/projected/1d16496f-9d4e-4300-8fcd-391dc25fd315-kube-api-access-nx9xh\") pod \"maas-controller-648dfbd599-nbqgl\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") " pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:28.805230 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.805058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert\") pod \"maas-controller-648dfbd599-nbqgl\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") " pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:28.805230 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:48:28.805217    2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 15 19:48:28.805377 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:48:28.805287    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert podName:1d16496f-9d4e-4300-8fcd-391dc25fd315 nodeName:}" failed. No retries permitted until 2026-07-15 19:48:29.305266468 +0000 UTC m=+610.386460821 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert") pod "maas-controller-648dfbd599-nbqgl" (UID: "1d16496f-9d4e-4300-8fcd-391dc25fd315") : secret "maas-controller-webhook-cert" not found
Jul 15 19:48:28.816157 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:28.816131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx9xh\" (UniqueName: \"kubernetes.io/projected/1d16496f-9d4e-4300-8fcd-391dc25fd315-kube-api-access-nx9xh\") pod \"maas-controller-648dfbd599-nbqgl\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") " pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:29.107519 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:29.107475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert\") pod \"maas-controller-54c6499cc5-cnkz5\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") " pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:29.109999 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:29.109966    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert\") pod \"maas-controller-54c6499cc5-cnkz5\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") " pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:29.291229 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:29.291187    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:29.310580 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:29.310545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert\") pod \"maas-controller-648dfbd599-nbqgl\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") " pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:29.312992 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:29.312969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert\") pod \"maas-controller-648dfbd599-nbqgl\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") " pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:29.467414 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:29.467388    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c6499cc5-cnkz5"]
Jul 15 19:48:29.469049 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:48:29.469027    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32acf62e_dd4d_4b1e_ae67_20d5a744d36c.slice/crio-8c58cc3477e607073e2192d7a13147f87ab4bb8e341dd87b35b4678a24301c54 WatchSource:0}: Error finding container 8c58cc3477e607073e2192d7a13147f87ab4bb8e341dd87b35b4678a24301c54: Status 404 returned error can't find the container with id 8c58cc3477e607073e2192d7a13147f87ab4bb8e341dd87b35b4678a24301c54
Jul 15 19:48:29.544436 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:29.544400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:29.684683 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:29.684658    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-648dfbd599-nbqgl"]
Jul 15 19:48:29.686518 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:48:29.686488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d16496f_9d4e_4300_8fcd_391dc25fd315.slice/crio-d14b8bf62091f1fcc229591a8461adc0883f58e2f25a565ca1d0ca772f85ca3b WatchSource:0}: Error finding container d14b8bf62091f1fcc229591a8461adc0883f58e2f25a565ca1d0ca772f85ca3b: Status 404 returned error can't find the container with id d14b8bf62091f1fcc229591a8461adc0883f58e2f25a565ca1d0ca772f85ca3b
Jul 15 19:48:30.034887 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:30.034797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-648dfbd599-nbqgl" event={"ID":"1d16496f-9d4e-4300-8fcd-391dc25fd315","Type":"ContainerStarted","Data":"d14b8bf62091f1fcc229591a8461adc0883f58e2f25a565ca1d0ca772f85ca3b"}
Jul 15 19:48:30.036208 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:30.036176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c6499cc5-cnkz5" event={"ID":"32acf62e-dd4d-4b1e-ae67-20d5a744d36c","Type":"ContainerStarted","Data":"8c58cc3477e607073e2192d7a13147f87ab4bb8e341dd87b35b4678a24301c54"}
Jul 15 19:48:33.055128 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:33.055091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c6499cc5-cnkz5" event={"ID":"32acf62e-dd4d-4b1e-ae67-20d5a744d36c","Type":"ContainerStarted","Data":"b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6"}
Jul 15 19:48:33.055641 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:33.055214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:33.056488 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:33.056458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-648dfbd599-nbqgl" event={"ID":"1d16496f-9d4e-4300-8fcd-391dc25fd315","Type":"ContainerStarted","Data":"b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256"}
Jul 15 19:48:33.056583 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:33.056564    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:33.073786 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:33.073742    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54c6499cc5-cnkz5" podStartSLOduration=2.43397408 podStartE2EDuration="5.073728542s" totalImagesPullingTime="2.639754462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:48:33.072435032 +0000 UTC m=+614.153629418" watchObservedRunningTime="2026-07-15 19:48:33.073728542 +0000 UTC m=+614.154922902"
Jul 15 19:48:33.092081 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:33.092027    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-648dfbd599-nbqgl" podStartSLOduration=2.659234756 podStartE2EDuration="5.092013772s" totalImagesPullingTime="2.432779016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:48:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:48:33.089970297 +0000 UTC m=+614.171164673" watchObservedRunningTime="2026-07-15 19:48:33.092013772 +0000 UTC m=+614.173208133"
Jul 15 19:48:44.063639 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.063567    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:44.064140 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.063715    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:48:44.147048 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.147011    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54c6499cc5-cnkz5"]
Jul 15 19:48:44.147264 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.147217    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-54c6499cc5-cnkz5" podUID="32acf62e-dd4d-4b1e-ae67-20d5a744d36c" containerName="manager" containerID="cri-o://b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6" gracePeriod=30
Jul 15 19:48:44.434030 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.433993    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:44.454474 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.454439    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfjf4\" (UniqueName: \"kubernetes.io/projected/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-kube-api-access-tfjf4\") pod \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") "
Jul 15 19:48:44.454648 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.454483    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert\") pod \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\" (UID: \"32acf62e-dd4d-4b1e-ae67-20d5a744d36c\") "
Jul 15 19:48:44.456598 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.456571    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "32acf62e-dd4d-4b1e-ae67-20d5a744d36c" (UID: "32acf62e-dd4d-4b1e-ae67-20d5a744d36c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:48:44.456598 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.456572    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-kube-api-access-tfjf4" (OuterVolumeSpecName: "kube-api-access-tfjf4") pod "32acf62e-dd4d-4b1e-ae67-20d5a744d36c" (UID: "32acf62e-dd4d-4b1e-ae67-20d5a744d36c"). InnerVolumeSpecName "kube-api-access-tfjf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:48:44.555905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.555866    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfjf4\" (UniqueName: \"kubernetes.io/projected/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-kube-api-access-tfjf4\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:48:44.555905 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:44.555900    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/32acf62e-dd4d-4b1e-ae67-20d5a744d36c-webhook-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:48:45.114717 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.114677    2576 generic.go:356] "Generic (PLEG): container finished" podID="32acf62e-dd4d-4b1e-ae67-20d5a744d36c" containerID="b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6" exitCode=0
Jul 15 19:48:45.114717 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.114723    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c6499cc5-cnkz5"
Jul 15 19:48:45.115184 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.114764    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c6499cc5-cnkz5" event={"ID":"32acf62e-dd4d-4b1e-ae67-20d5a744d36c","Type":"ContainerDied","Data":"b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6"}
Jul 15 19:48:45.115184 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.114846    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c6499cc5-cnkz5" event={"ID":"32acf62e-dd4d-4b1e-ae67-20d5a744d36c","Type":"ContainerDied","Data":"8c58cc3477e607073e2192d7a13147f87ab4bb8e341dd87b35b4678a24301c54"}
Jul 15 19:48:45.115184 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.114870    2576 scope.go:117] "RemoveContainer" containerID="b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6"
Jul 15 19:48:45.124039 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.124024    2576 scope.go:117] "RemoveContainer" containerID="b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6"
Jul 15 19:48:45.124334 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:48:45.124316    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6\": container with ID starting with b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6 not found: ID does not exist" containerID="b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6"
Jul 15 19:48:45.124404 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.124342    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6"} err="failed to get container status \"b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6\": rpc error: code = NotFound desc = could not find container \"b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6\": container with ID starting with b29445e28c882944ba5f6a329845b07922f15788399e0ce51c00655ddc6ae9c6 not found: ID does not exist"
Jul 15 19:48:45.139976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.139949    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54c6499cc5-cnkz5"]
Jul 15 19:48:45.144112 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.144091    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54c6499cc5-cnkz5"]
Jul 15 19:48:45.333347 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:48:45.333319    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32acf62e-dd4d-4b1e-ae67-20d5a744d36c" path="/var/lib/kubelet/pods/32acf62e-dd4d-4b1e-ae67-20d5a744d36c/volumes"
Jul 15 19:49:05.804016 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.803985    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"]
Jul 15 19:49:05.806626 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.804387    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32acf62e-dd4d-4b1e-ae67-20d5a744d36c" containerName="manager"
Jul 15 19:49:05.806626 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.804399    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="32acf62e-dd4d-4b1e-ae67-20d5a744d36c" containerName="manager"
Jul 15 19:49:05.806626 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.804471    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="32acf62e-dd4d-4b1e-ae67-20d5a744d36c" containerName="manager"
Jul 15 19:49:05.807624 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.807608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:05.810968 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.810945    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 15 19:49:05.819016 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.818988    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"]
Jul 15 19:49:05.947954 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.947922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/308507a5-38a4-4a7d-89aa-83228a346e23-openshift-service-ca\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:05.948121 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.948055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rvpc\" (UniqueName: \"kubernetes.io/projected/308507a5-38a4-4a7d-89aa-83228a346e23-kube-api-access-2rvpc\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:05.948121 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:05.948086    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308507a5-38a4-4a7d-89aa-83228a346e23-maas-api-tls\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:06.049716 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.049675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rvpc\" (UniqueName: \"kubernetes.io/projected/308507a5-38a4-4a7d-89aa-83228a346e23-kube-api-access-2rvpc\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:06.049911 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.049730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308507a5-38a4-4a7d-89aa-83228a346e23-maas-api-tls\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:06.049911 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.049773    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/308507a5-38a4-4a7d-89aa-83228a346e23-openshift-service-ca\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:06.050400 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.050381    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/308507a5-38a4-4a7d-89aa-83228a346e23-openshift-service-ca\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:06.052235 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.052213    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/308507a5-38a4-4a7d-89aa-83228a346e23-maas-api-tls\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:06.063934 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.063903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rvpc\" (UniqueName: \"kubernetes.io/projected/308507a5-38a4-4a7d-89aa-83228a346e23-kube-api-access-2rvpc\") pod \"maas-api-57888f7c6b-v6vs2\" (UID: \"308507a5-38a4-4a7d-89aa-83228a346e23\") " pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:06.118755 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.118717    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:06.274048 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.274016    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"]
Jul 15 19:49:06.275961 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:49:06.275930    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308507a5_38a4_4a7d_89aa_83228a346e23.slice/crio-99fa8e04d0d44b8eff436da835eacdfc667bcd48e3caf873e06d99984ce4c12e WatchSource:0}: Error finding container 99fa8e04d0d44b8eff436da835eacdfc667bcd48e3caf873e06d99984ce4c12e: Status 404 returned error can't find the container with id 99fa8e04d0d44b8eff436da835eacdfc667bcd48e3caf873e06d99984ce4c12e
Jul 15 19:49:06.531425 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.531347    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-847lq"]
Jul 15 19:49:06.576470 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.576434    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-82s4t"]
Jul 15 19:49:06.576647 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.576587    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:06.580192 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.580172    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 15 19:49:06.596723 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.596698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-847lq"]
Jul 15 19:49:06.596844 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.596746    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-82s4t"]
Jul 15 19:49:06.596886 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.596843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:06.601051 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.601032    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9nmwj\""
Jul 15 19:49:06.655235 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.655199    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58bac0cd-b41d-4eda-836d-828f933c7b51-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-847lq\" (UID: \"58bac0cd-b41d-4eda-836d-828f933c7b51\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:06.655398 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.655243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f28n\" (UniqueName: \"kubernetes.io/projected/58bac0cd-b41d-4eda-836d-828f933c7b51-kube-api-access-9f28n\") pod \"payload-pre-processing-74584bb9f8-847lq\" (UID: \"58bac0cd-b41d-4eda-836d-828f933c7b51\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:06.655398 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.655299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t959c\" (UniqueName: \"kubernetes.io/projected/5e0dd8ab-6b05-4bed-ae4e-75659eb593ec-kube-api-access-t959c\") pod \"payload-processing-f9b8d9b9b-82s4t\" (UID: \"5e0dd8ab-6b05-4bed-ae4e-75659eb593ec\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:06.655398 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.655361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e0dd8ab-6b05-4bed-ae4e-75659eb593ec-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-82s4t\" (UID: \"5e0dd8ab-6b05-4bed-ae4e-75659eb593ec\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:06.756655 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.756618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e0dd8ab-6b05-4bed-ae4e-75659eb593ec-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-82s4t\" (UID: \"5e0dd8ab-6b05-4bed-ae4e-75659eb593ec\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:06.756655 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.756663    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58bac0cd-b41d-4eda-836d-828f933c7b51-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-847lq\" (UID: \"58bac0cd-b41d-4eda-836d-828f933c7b51\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:06.756880 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.756690    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f28n\" (UniqueName: \"kubernetes.io/projected/58bac0cd-b41d-4eda-836d-828f933c7b51-kube-api-access-9f28n\") pod \"payload-pre-processing-74584bb9f8-847lq\" (UID: \"58bac0cd-b41d-4eda-836d-828f933c7b51\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:06.756880 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.756738    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t959c\" (UniqueName: \"kubernetes.io/projected/5e0dd8ab-6b05-4bed-ae4e-75659eb593ec-kube-api-access-t959c\") pod \"payload-processing-f9b8d9b9b-82s4t\" (UID: \"5e0dd8ab-6b05-4bed-ae4e-75659eb593ec\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:06.757376 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.757357    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58bac0cd-b41d-4eda-836d-828f933c7b51-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-847lq\" (UID: \"58bac0cd-b41d-4eda-836d-828f933c7b51\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:06.757421 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.757374    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e0dd8ab-6b05-4bed-ae4e-75659eb593ec-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-82s4t\" (UID: \"5e0dd8ab-6b05-4bed-ae4e-75659eb593ec\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:06.769120 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.769096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t959c\" (UniqueName: \"kubernetes.io/projected/5e0dd8ab-6b05-4bed-ae4e-75659eb593ec-kube-api-access-t959c\") pod \"payload-processing-f9b8d9b9b-82s4t\" (UID: \"5e0dd8ab-6b05-4bed-ae4e-75659eb593ec\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:06.772117 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.772093    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f28n\" (UniqueName: \"kubernetes.io/projected/58bac0cd-b41d-4eda-836d-828f933c7b51-kube-api-access-9f28n\") pod \"payload-pre-processing-74584bb9f8-847lq\" (UID: \"58bac0cd-b41d-4eda-836d-828f933c7b51\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:06.888107 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.888072    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:06.907137 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:06.907110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:07.047130 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:07.047095    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-847lq"]
Jul 15 19:49:07.051023 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:49:07.050500    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bac0cd_b41d_4eda_836d_828f933c7b51.slice/crio-57c9809feb298e2ec937dfcf2aaafecb2a0b106754dcdfa62228d1fb212beb95 WatchSource:0}: Error finding container 57c9809feb298e2ec937dfcf2aaafecb2a0b106754dcdfa62228d1fb212beb95: Status 404 returned error can't find the container with id 57c9809feb298e2ec937dfcf2aaafecb2a0b106754dcdfa62228d1fb212beb95
Jul 15 19:49:07.088080 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:07.088052    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-82s4t"]
Jul 15 19:49:07.091754 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:49:07.091720    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0dd8ab_6b05_4bed_ae4e_75659eb593ec.slice/crio-811b2ade11576e9167a02925428ec33a4c6b4cac216ae5eb0062937beb3f71f0 WatchSource:0}: Error finding container 811b2ade11576e9167a02925428ec33a4c6b4cac216ae5eb0062937beb3f71f0: Status 404 returned error can't find the container with id 811b2ade11576e9167a02925428ec33a4c6b4cac216ae5eb0062937beb3f71f0
Jul 15 19:49:07.222964 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:07.222882    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq" event={"ID":"58bac0cd-b41d-4eda-836d-828f933c7b51","Type":"ContainerStarted","Data":"57c9809feb298e2ec937dfcf2aaafecb2a0b106754dcdfa62228d1fb212beb95"}
Jul 15 19:49:07.224224 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:07.224194    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2" event={"ID":"308507a5-38a4-4a7d-89aa-83228a346e23","Type":"ContainerStarted","Data":"99fa8e04d0d44b8eff436da835eacdfc667bcd48e3caf873e06d99984ce4c12e"}
Jul 15 19:49:07.225583 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:07.225546    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t" event={"ID":"5e0dd8ab-6b05-4bed-ae4e-75659eb593ec","Type":"ContainerStarted","Data":"811b2ade11576e9167a02925428ec33a4c6b4cac216ae5eb0062937beb3f71f0"}
Jul 15 19:49:08.258239 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:08.257367    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2" event={"ID":"308507a5-38a4-4a7d-89aa-83228a346e23","Type":"ContainerStarted","Data":"ef66485456ababb6f8a45440aaa2f47d20eb8715f7520e2301d0f947a4cf59e8"}
Jul 15 19:49:08.258239 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:08.257640    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:08.281316 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:08.280649    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2" podStartSLOduration=1.5976181390000002 podStartE2EDuration="3.28062482s" totalImagesPullingTime="1.683006681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:49:08.279218291 +0000 UTC m=+649.360412680" watchObservedRunningTime="2026-07-15 19:49:08.28062482 +0000 UTC m=+649.361819185"
Jul 15 19:49:09.266289 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:09.266240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq" event={"ID":"58bac0cd-b41d-4eda-836d-828f933c7b51","Type":"ContainerStarted","Data":"f225158641d84ea215a4ee5c487a5346a3e5513e54e9faf4710fd5ee01da6bee"}
Jul 15 19:49:09.266765 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:09.266339    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:09.268478 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:09.268448    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t" event={"ID":"5e0dd8ab-6b05-4bed-ae4e-75659eb593ec","Type":"ContainerStarted","Data":"0b98495a77694ad1f9dc6db1e6e9d81de3a3ab821c5546aa79160ccd8aab6dc1"}
Jul 15 19:49:09.284509 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:09.284462    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq" podStartSLOduration=1.175389618 podStartE2EDuration="3.28444695s" totalImagesPullingTime="2.109057332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:49:09.283492567 +0000 UTC m=+650.364686927" watchObservedRunningTime="2026-07-15 19:49:09.28444695 +0000 UTC m=+650.365641311"
Jul 15 19:49:09.303537 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:09.303490    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t" podStartSLOduration=1.240939728 podStartE2EDuration="3.303471067s" totalImagesPullingTime="2.062531339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:49:09.302931928 +0000 UTC m=+650.384126290" watchObservedRunningTime="2026-07-15 19:49:09.303471067 +0000 UTC m=+650.384665427"
Jul 15 19:49:10.273536 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:10.273506    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:14.274610 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:14.274581    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-57888f7c6b-v6vs2"
Jul 15 19:49:15.301512 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:15.301479    2576 generic.go:356] "Generic (PLEG): container finished" podID="20ceeb54-89d4-4e26-838c-fe431b9df03a" containerID="eef66ead237c43bcf5e450906c0a1d165fb52246369471cbab056719716b2c6d" exitCode=0
Jul 15 19:49:15.302140 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:15.301555    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" event={"ID":"20ceeb54-89d4-4e26-838c-fe431b9df03a","Type":"ContainerDied","Data":"eef66ead237c43bcf5e450906c0a1d165fb52246369471cbab056719716b2c6d"}
Jul 15 19:49:15.302140 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:15.301979    2576 scope.go:117] "RemoveContainer" containerID="eef66ead237c43bcf5e450906c0a1d165fb52246369471cbab056719716b2c6d"
Jul 15 19:49:15.303010 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:15.302981    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:49:15.303105 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:15.303069    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:49:15.303192 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:15.303117    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 19:49:15.792848 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:15.792811    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:49:16.308264 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:16.308228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" event={"ID":"20ceeb54-89d4-4e26-838c-fe431b9df03a","Type":"ContainerStarted","Data":"c4ffd7d4321b65f06302d1b8e65e2d6df2532ff55e83a6e78ad4a2d8d93eae3c"}
Jul 15 19:49:16.921406 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:16.921368    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:49:16.922612 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:16.922586    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8bcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 15 19:49:16.922753 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:16.922656    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" podUID="20ceeb54-89d4-4e26-838c-fe431b9df03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 15 19:49:17.922415 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:17.922376    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8bcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 15 19:49:17.922818 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:17.922439    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" podUID="20ceeb54-89d4-4e26-838c-fe431b9df03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 15 19:49:18.921396 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:18.921359    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8bcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 15 19:49:18.921599 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:18.921457    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" podUID="20ceeb54-89d4-4e26-838c-fe431b9df03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 15 19:49:19.921712 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:19.921675    2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-8bcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 15 19:49:19.922104 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:19.921741    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk" podUID="20ceeb54-89d4-4e26-838c-fe431b9df03a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 15 19:49:20.275992 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:20.275893    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq" podUID="58bac0cd-b41d-4eda-836d-828f933c7b51" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.46:9004: connect: connection refused"
Jul 15 19:49:20.926024 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:20.925995    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:49:20.926409 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:20.926291    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:49:20.926928 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:20.926911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-8bcgk"
Jul 15 19:49:21.280856 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:21.280777    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-82s4t"
Jul 15 19:49:30.273976 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:30.273942    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-847lq"
Jul 15 19:49:39.229744 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.229706    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"]
Jul 15 19:49:39.234854 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.234832    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.241186 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.241139    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 19:49:39.242183 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.242133    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 19:49:39.242313 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.242145    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 19:49:39.242393 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.242374    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nmvtf\""
Jul 15 19:49:39.248861 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.248840    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"]
Jul 15 19:49:39.361908 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.361868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.362094 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.361954    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.362094 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.362000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.362094 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.362018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.362094 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.362085    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.362289 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.362136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd74v\" (UniqueName: \"kubernetes.io/projected/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-kube-api-access-nd74v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463239 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463206    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd74v\" (UniqueName: \"kubernetes.io/projected/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-kube-api-access-nd74v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463406 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463456 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463517 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463577 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463630 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463686 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463855 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463832    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.463929 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.463853    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.465710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.465688    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.466041 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.466025    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.472786 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.472758    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd74v\" (UniqueName: \"kubernetes.io/projected/040a0645-c22d-42f3-9cc4-4bbf1a2983c7-kube-api-access-nd74v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j\" (UID: \"040a0645-c22d-42f3-9cc4-4bbf1a2983c7\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.546285 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.546190    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:39.693693 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:39.693668    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"]
Jul 15 19:49:39.695924 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:49:39.695894    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040a0645_c22d_42f3_9cc4_4bbf1a2983c7.slice/crio-37c236fae2291ffccbd50f15fb1ce4963b1244adeab6bf8b8535c5b42a9752b9 WatchSource:0}: Error finding container 37c236fae2291ffccbd50f15fb1ce4963b1244adeab6bf8b8535c5b42a9752b9: Status 404 returned error can't find the container with id 37c236fae2291ffccbd50f15fb1ce4963b1244adeab6bf8b8535c5b42a9752b9
Jul 15 19:49:40.424178 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:40.424132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j" event={"ID":"040a0645-c22d-42f3-9cc4-4bbf1a2983c7","Type":"ContainerStarted","Data":"37c236fae2291ffccbd50f15fb1ce4963b1244adeab6bf8b8535c5b42a9752b9"}
Jul 15 19:49:41.430661 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:41.430623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j" event={"ID":"040a0645-c22d-42f3-9cc4-4bbf1a2983c7","Type":"ContainerStarted","Data":"ba6dce017a481efbacc81b83d029236a02c54aa3074f6225521e99322a541487"}
Jul 15 19:49:41.451876 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:41.451822    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j" podStartSLOduration=1.307705272 podStartE2EDuration="2.451804457s" totalImagesPullingTime="1.144099185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:49:41.45095503 +0000 UTC m=+682.532149391" watchObservedRunningTime="2026-07-15 19:49:41.451804457 +0000 UTC m=+682.532998817"
Jul 15 19:49:49.546478 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:49.546442    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:49.546935 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:49.546506    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:49.559119 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:49.559097    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:49:50.485369 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:49:50.485344    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j"
Jul 15 19:50:19.735067 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.734984    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"]
Jul 15 19:50:19.739817 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.739798    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.742270 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.742251    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 19:50:19.749207 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.749182    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"]
Jul 15 19:50:19.841993 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.841944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.842205 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.842010    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc938da9-e7c7-4a19-af7d-4ae801694fe8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.842205 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.842073    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssckv\" (UniqueName: \"kubernetes.io/projected/fc938da9-e7c7-4a19-af7d-4ae801694fe8-kube-api-access-ssckv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.842205 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.842152    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.842346 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.842227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.842346 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.842283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.943512 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.943476    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.943710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.943525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc938da9-e7c7-4a19-af7d-4ae801694fe8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.943710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.943552    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssckv\" (UniqueName: \"kubernetes.io/projected/fc938da9-e7c7-4a19-af7d-4ae801694fe8-kube-api-access-ssckv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.943710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.943609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.943710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.943643    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.943710 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.943692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.944097 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.944071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.944097 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.944076    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.944302 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.944115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.946070 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.946046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc938da9-e7c7-4a19-af7d-4ae801694fe8-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.946231 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.946214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc938da9-e7c7-4a19-af7d-4ae801694fe8-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:19.951741 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:19.951720    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssckv\" (UniqueName: \"kubernetes.io/projected/fc938da9-e7c7-4a19-af7d-4ae801694fe8-kube-api-access-ssckv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86\" (UID: \"fc938da9-e7c7-4a19-af7d-4ae801694fe8\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:20.049745 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:20.049653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:20.189286 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:20.189260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"]
Jul 15 19:50:20.191386 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:50:20.191355    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc938da9_e7c7_4a19_af7d_4ae801694fe8.slice/crio-b9cf8f01044a27f1132e80a744a33728cb271076953bf4fa685d70d0a1c0ed23 WatchSource:0}: Error finding container b9cf8f01044a27f1132e80a744a33728cb271076953bf4fa685d70d0a1c0ed23: Status 404 returned error can't find the container with id b9cf8f01044a27f1132e80a744a33728cb271076953bf4fa685d70d0a1c0ed23
Jul 15 19:50:20.193188 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:20.193155    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 19:50:20.631658 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:20.631622    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86" event={"ID":"fc938da9-e7c7-4a19-af7d-4ae801694fe8","Type":"ContainerStarted","Data":"eca0fbfce75b00590c6df7c17d27b3df3eb23e15c643cbd57da01f68b7c67b64"}
Jul 15 19:50:20.631894 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:20.631680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86" event={"ID":"fc938da9-e7c7-4a19-af7d-4ae801694fe8","Type":"ContainerStarted","Data":"b9cf8f01044a27f1132e80a744a33728cb271076953bf4fa685d70d0a1c0ed23"}
Jul 15 19:50:20.670203 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:20.670074    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86" podStartSLOduration=1.460796555 podStartE2EDuration="1.670052673s" totalImagesPullingTime="209.256118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:50:20.666752873 +0000 UTC m=+721.747947233" watchObservedRunningTime="2026-07-15 19:50:20.670052673 +0000 UTC m=+721.751247034"
Jul 15 19:50:30.050360 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:30.050322    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:30.050770 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:30.050407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:30.063068 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:30.063037    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:50:30.693012 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:50:30.692976    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86"
Jul 15 19:52:01.583327 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.583214    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9c6cd5bcb-4bzlv"]
Jul 15 19:52:01.586979 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.586957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv"
Jul 15 19:52:01.590802 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.590775    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-78smg\""
Jul 15 19:52:01.590802 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.590782    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 19:52:01.600371 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.600344    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9c6cd5bcb-4bzlv"]
Jul 15 19:52:01.618506 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.618478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2652f5a8-2ebf-45ae-9400-767f8629da2f-tls-cert\") pod \"authorino-9c6cd5bcb-4bzlv\" (UID: \"2652f5a8-2ebf-45ae-9400-767f8629da2f\") " pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv"
Jul 15 19:52:01.618656 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.618514    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr5pg\" (UniqueName: \"kubernetes.io/projected/2652f5a8-2ebf-45ae-9400-767f8629da2f-kube-api-access-nr5pg\") pod \"authorino-9c6cd5bcb-4bzlv\" (UID: \"2652f5a8-2ebf-45ae-9400-767f8629da2f\") " pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv"
Jul 15 19:52:01.719215 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.719150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2652f5a8-2ebf-45ae-9400-767f8629da2f-tls-cert\") pod \"authorino-9c6cd5bcb-4bzlv\" (UID: \"2652f5a8-2ebf-45ae-9400-767f8629da2f\") " pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv"
Jul 15 19:52:01.719419 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.719220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr5pg\" (UniqueName: \"kubernetes.io/projected/2652f5a8-2ebf-45ae-9400-767f8629da2f-kube-api-access-nr5pg\") pod \"authorino-9c6cd5bcb-4bzlv\" (UID: \"2652f5a8-2ebf-45ae-9400-767f8629da2f\") " pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv"
Jul 15 19:52:01.721622 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.721601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2652f5a8-2ebf-45ae-9400-767f8629da2f-tls-cert\") pod \"authorino-9c6cd5bcb-4bzlv\" (UID: \"2652f5a8-2ebf-45ae-9400-767f8629da2f\") " pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv"
Jul 15 19:52:01.747759 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.747727    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr5pg\" (UniqueName: \"kubernetes.io/projected/2652f5a8-2ebf-45ae-9400-767f8629da2f-kube-api-access-nr5pg\") pod \"authorino-9c6cd5bcb-4bzlv\" (UID: \"2652f5a8-2ebf-45ae-9400-767f8629da2f\") " pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv"
Jul 15 19:52:01.895982 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:01.895899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv"
Jul 15 19:52:02.040237 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:02.040212    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9c6cd5bcb-4bzlv"]
Jul 15 19:52:02.042033 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:52:02.042004    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2652f5a8_2ebf_45ae_9400_767f8629da2f.slice/crio-1bed43f7c05d4389d5560c556d88839f945f73ab6c08b7149e66ae536ff86502 WatchSource:0}: Error finding container 1bed43f7c05d4389d5560c556d88839f945f73ab6c08b7149e66ae536ff86502: Status 404 returned error can't find the container with id 1bed43f7c05d4389d5560c556d88839f945f73ab6c08b7149e66ae536ff86502
Jul 15 19:52:02.129719 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:02.129683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv" event={"ID":"2652f5a8-2ebf-45ae-9400-767f8629da2f","Type":"ContainerStarted","Data":"1bed43f7c05d4389d5560c556d88839f945f73ab6c08b7149e66ae536ff86502"}
Jul 15 19:52:03.137388 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:03.137343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv" event={"ID":"2652f5a8-2ebf-45ae-9400-767f8629da2f","Type":"ContainerStarted","Data":"2cc48d67f99ad73c970a7665cc4b6e150f90378bb52b6c225e76ea3cae56e704"}
Jul 15 19:52:03.164904 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:52:03.158388    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9c6cd5bcb-4bzlv" podStartSLOduration=1.627548858 podStartE2EDuration="2.158366531s" totalImagesPullingTime="530.817673ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:52:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:52:03.156429689 +0000 UTC m=+824.237624054" watchObservedRunningTime="2026-07-15 19:52:03.158366531 +0000 UTC m=+824.239560893"
Jul 15 19:53:12.519178 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:12.519083    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-648dfbd599-nbqgl"]
Jul 15 19:53:12.519749 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:12.519333    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-648dfbd599-nbqgl" podUID="1d16496f-9d4e-4300-8fcd-391dc25fd315" containerName="manager" containerID="cri-o://b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256" gracePeriod=30
Jul 15 19:53:12.778629 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:12.778556    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:53:12.900724 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:12.900690    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert\") pod \"1d16496f-9d4e-4300-8fcd-391dc25fd315\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") "
Jul 15 19:53:12.900910 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:12.900738    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx9xh\" (UniqueName: \"kubernetes.io/projected/1d16496f-9d4e-4300-8fcd-391dc25fd315-kube-api-access-nx9xh\") pod \"1d16496f-9d4e-4300-8fcd-391dc25fd315\" (UID: \"1d16496f-9d4e-4300-8fcd-391dc25fd315\") "
Jul 15 19:53:12.902819 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:12.902790    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d16496f-9d4e-4300-8fcd-391dc25fd315-kube-api-access-nx9xh" (OuterVolumeSpecName: "kube-api-access-nx9xh") pod "1d16496f-9d4e-4300-8fcd-391dc25fd315" (UID: "1d16496f-9d4e-4300-8fcd-391dc25fd315"). InnerVolumeSpecName "kube-api-access-nx9xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 19:53:12.902963 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:12.902888    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1d16496f-9d4e-4300-8fcd-391dc25fd315" (UID: "1d16496f-9d4e-4300-8fcd-391dc25fd315"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 19:53:13.001781 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.001744    2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d16496f-9d4e-4300-8fcd-391dc25fd315-webhook-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:53:13.001781 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.001774    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx9xh\" (UniqueName: \"kubernetes.io/projected/1d16496f-9d4e-4300-8fcd-391dc25fd315-kube-api-access-nx9xh\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 19:53:13.503061 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.503027    2576 generic.go:356] "Generic (PLEG): container finished" podID="1d16496f-9d4e-4300-8fcd-391dc25fd315" containerID="b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256" exitCode=0
Jul 15 19:53:13.503243 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.503087    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-648dfbd599-nbqgl"
Jul 15 19:53:13.503243 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.503110    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-648dfbd599-nbqgl" event={"ID":"1d16496f-9d4e-4300-8fcd-391dc25fd315","Type":"ContainerDied","Data":"b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256"}
Jul 15 19:53:13.503243 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.503190    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-648dfbd599-nbqgl" event={"ID":"1d16496f-9d4e-4300-8fcd-391dc25fd315","Type":"ContainerDied","Data":"d14b8bf62091f1fcc229591a8461adc0883f58e2f25a565ca1d0ca772f85ca3b"}
Jul 15 19:53:13.503243 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.503220    2576 scope.go:117] "RemoveContainer" containerID="b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256"
Jul 15 19:53:13.512034 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.512012    2576 scope.go:117] "RemoveContainer" containerID="b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256"
Jul 15 19:53:13.512310 ip-10-0-128-48 kubenswrapper[2576]: E0715 19:53:13.512292    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256\": container with ID starting with b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256 not found: ID does not exist" containerID="b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256"
Jul 15 19:53:13.512374 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.512322    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256"} err="failed to get container status \"b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256\": rpc error: code = NotFound desc = could not find container \"b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256\": container with ID starting with b162079f0bf6199b7a41e3c1a912a69a9bc93ab22c72b655a2852d8853517256 not found: ID does not exist"
Jul 15 19:53:13.523992 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.523965    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-648dfbd599-nbqgl"]
Jul 15 19:53:13.525944 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:13.525925    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-648dfbd599-nbqgl"]
Jul 15 19:53:14.268454 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.268417    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-648dfbd599-4s2dr"]
Jul 15 19:53:14.268837 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.268825    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d16496f-9d4e-4300-8fcd-391dc25fd315" containerName="manager"
Jul 15 19:53:14.268882 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.268839    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d16496f-9d4e-4300-8fcd-391dc25fd315" containerName="manager"
Jul 15 19:53:14.268934 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.268923    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d16496f-9d4e-4300-8fcd-391dc25fd315" containerName="manager"
Jul 15 19:53:14.273477 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.273452    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:14.276666 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.276637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 15 19:53:14.276804 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.276667    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 15 19:53:14.276804 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.276673    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rq4np\""
Jul 15 19:53:14.283381 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.283354    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-648dfbd599-4s2dr"]
Jul 15 19:53:14.417628 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.417584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8c570ad-0ab5-4495-8055-35319e99d9b8-webhook-cert\") pod \"maas-controller-648dfbd599-4s2dr\" (UID: \"b8c570ad-0ab5-4495-8055-35319e99d9b8\") " pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:14.417827 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.417696    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqlj\" (UniqueName: \"kubernetes.io/projected/b8c570ad-0ab5-4495-8055-35319e99d9b8-kube-api-access-4mqlj\") pod \"maas-controller-648dfbd599-4s2dr\" (UID: \"b8c570ad-0ab5-4495-8055-35319e99d9b8\") " pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:14.519076 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.518983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8c570ad-0ab5-4495-8055-35319e99d9b8-webhook-cert\") pod \"maas-controller-648dfbd599-4s2dr\" (UID: \"b8c570ad-0ab5-4495-8055-35319e99d9b8\") " pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:14.519286 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.519185    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqlj\" (UniqueName: \"kubernetes.io/projected/b8c570ad-0ab5-4495-8055-35319e99d9b8-kube-api-access-4mqlj\") pod \"maas-controller-648dfbd599-4s2dr\" (UID: \"b8c570ad-0ab5-4495-8055-35319e99d9b8\") " pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:14.521581 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.521558    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8c570ad-0ab5-4495-8055-35319e99d9b8-webhook-cert\") pod \"maas-controller-648dfbd599-4s2dr\" (UID: \"b8c570ad-0ab5-4495-8055-35319e99d9b8\") " pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:14.527992 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.527959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqlj\" (UniqueName: \"kubernetes.io/projected/b8c570ad-0ab5-4495-8055-35319e99d9b8-kube-api-access-4mqlj\") pod \"maas-controller-648dfbd599-4s2dr\" (UID: \"b8c570ad-0ab5-4495-8055-35319e99d9b8\") " pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:14.585921 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.585878    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:14.723442 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:14.723418    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-648dfbd599-4s2dr"]
Jul 15 19:53:14.725394 ip-10-0-128-48 kubenswrapper[2576]: W0715 19:53:14.725370    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c570ad_0ab5_4495_8055_35319e99d9b8.slice/crio-a6e54f9e1ba06f11af7ee13607d57126cf3135f225bb4304702c7fb5948c9c9e WatchSource:0}: Error finding container a6e54f9e1ba06f11af7ee13607d57126cf3135f225bb4304702c7fb5948c9c9e: Status 404 returned error can't find the container with id a6e54f9e1ba06f11af7ee13607d57126cf3135f225bb4304702c7fb5948c9c9e
Jul 15 19:53:15.332195 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:15.332148    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d16496f-9d4e-4300-8fcd-391dc25fd315" path="/var/lib/kubelet/pods/1d16496f-9d4e-4300-8fcd-391dc25fd315/volumes"
Jul 15 19:53:15.516099 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:15.516065    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-648dfbd599-4s2dr" event={"ID":"b8c570ad-0ab5-4495-8055-35319e99d9b8","Type":"ContainerStarted","Data":"a6e54f9e1ba06f11af7ee13607d57126cf3135f225bb4304702c7fb5948c9c9e"}
Jul 15 19:53:16.522691 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:16.522653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-648dfbd599-4s2dr" event={"ID":"b8c570ad-0ab5-4495-8055-35319e99d9b8","Type":"ContainerStarted","Data":"a3809dd2dca300492565718bfabbc4929d8798f0369a4a9f8d0616f4564dc5cf"}
Jul 15 19:53:16.523084 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:16.522811    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 19:53:16.541238 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:16.541194    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-648dfbd599-4s2dr" podStartSLOduration=1.554137822 podStartE2EDuration="2.541159122s" totalImagesPullingTime="987.0213ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 19:53:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 19:53:16.539843436 +0000 UTC m=+897.621037808" watchObservedRunningTime="2026-07-15 19:53:16.541159122 +0000 UTC m=+897.622353483"
Jul 15 19:53:27.530906 ip-10-0-128-48 kubenswrapper[2576]: I0715 19:53:27.530873    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-648dfbd599-4s2dr"
Jul 15 20:05:35.455505 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.455465    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"]
Jul 15 20:05:35.464541 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.464517    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.468239 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.468218    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-10eed66e-openshift-default-dockercfg-fvkfk\""
Jul 15 20:05:35.483906 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.483882    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"]
Jul 15 20:05:35.496630 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223e840b-913e-4902-9a75-2c109c70630c-istiod-ca-cert\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.496795 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496659    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26jrm\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-kube-api-access-26jrm\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.496795 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496764    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-data\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.496927 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-socket\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.496927 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-credential-socket\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.496927 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-istio-token\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.497096 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496927    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223e840b-913e-4902-9a75-2c109c70630c-istio-podinfo\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.497096 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496959    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-certs\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.497096 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.496976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-envoy\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.597602 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.597558    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-istio-token\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.597780 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.597619    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223e840b-913e-4902-9a75-2c109c70630c-istio-podinfo\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.597780 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.597658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-certs\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.597780 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.597684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-envoy\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.597922 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.597893    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223e840b-913e-4902-9a75-2c109c70630c-istiod-ca-cert\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598018 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.597999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26jrm\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-kube-api-access-26jrm\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598073 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.598058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-data\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598132 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.598105    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-socket\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598225 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.598139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-credential-socket\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598293 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.598217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-certs\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598514 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.598488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-data\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598713 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.598491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-socket\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598820 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.598527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-credential-socket\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.598820 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.598648    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223e840b-913e-4902-9a75-2c109c70630c-istiod-ca-cert\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.600153 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.600132    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-envoy\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.600403 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.600385    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223e840b-913e-4902-9a75-2c109c70630c-istio-podinfo\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.606823 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.606798    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-istio-token\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.606931 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.606914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26jrm\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-kube-api-access-26jrm\") pod \"e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") " pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.775661 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.775571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:35.933063 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.933036    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"]
Jul 15 20:05:35.933816 ip-10-0-128-48 kubenswrapper[2576]: W0715 20:05:35.933792    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod223e840b_913e_4902_9a75_2c109c70630c.slice/crio-b22173927c1e7ed262fdbb4e871d2fa0d84e7a6ed5b25fe3c2ff5f667d8c8c4b WatchSource:0}: Error finding container b22173927c1e7ed262fdbb4e871d2fa0d84e7a6ed5b25fe3c2ff5f667d8c8c4b: Status 404 returned error can't find the container with id b22173927c1e7ed262fdbb4e871d2fa0d84e7a6ed5b25fe3c2ff5f667d8c8c4b
Jul 15 20:05:35.936045 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.936014    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:05:35.936129 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.936086    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:05:35.936129 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:35.936114    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:05:36.289617 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:36.289583    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" event={"ID":"223e840b-913e-4902-9a75-2c109c70630c","Type":"ContainerStarted","Data":"e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394"}
Jul 15 20:05:36.289808 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:36.289638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" event={"ID":"223e840b-913e-4902-9a75-2c109c70630c","Type":"ContainerStarted","Data":"b22173927c1e7ed262fdbb4e871d2fa0d84e7a6ed5b25fe3c2ff5f667d8c8c4b"}
Jul 15 20:05:36.316383 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:36.316328    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" podStartSLOduration=1.316309272 podStartE2EDuration="1.316309272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:05:36.314986198 +0000 UTC m=+1637.396180594" watchObservedRunningTime="2026-07-15 20:05:36.316309272 +0000 UTC m=+1637.397503632"
Jul 15 20:05:36.775938 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:36.775905    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:36.781653 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:36.781627    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:37.296269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:37.296239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:37.297255 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:37.297228    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:49.371113 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:49.371077    2576 generic.go:356] "Generic (PLEG): container finished" podID="223e840b-913e-4902-9a75-2c109c70630c" containerID="e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394" exitCode=0
Jul 15 20:05:49.371558 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:49.371148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" event={"ID":"223e840b-913e-4902-9a75-2c109c70630c","Type":"ContainerDied","Data":"e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394"}
Jul 15 20:05:49.371604 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:49.371563    2576 scope.go:117] "RemoveContainer" containerID="e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394"
Jul 15 20:05:49.372591 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:49.372567    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:05:49.372666 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:49.372653    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:05:49.372702 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:49.372693    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:05:50.378027 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:50.377995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" event={"ID":"223e840b-913e-4902-9a75-2c109c70630c","Type":"ContainerStarted","Data":"b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9"}
Jul 15 20:05:50.776136 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:50.776044    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:50.777196 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:50.777155    2576 patch_prober.go:28] interesting pod/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 20:05:50.777319 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:50.777219    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 20:05:51.775996 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:51.775956    2576 patch_prober.go:28] interesting pod/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 20:05:51.776438 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:51.776023    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 20:05:52.301053 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:52.301012    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:52.776493 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:52.776456    2576 patch_prober.go:28] interesting pod/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 20:05:52.776881 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:52.776511    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 20:05:53.776159 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:53.776125    2576 patch_prober.go:28] interesting pod/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 15 20:05:53.776358 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:53.776227    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 15 20:05:54.780242 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:54.780208    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:05:54.781235 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:05:54.781214    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:06:57.017257 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:06:57.017220    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"]
Jul 15 20:06:57.017805 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:06:57.017424    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy" containerID="cri-o://b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9" gracePeriod=30
Jul 15 20:07:02.279449 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.279381    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:07:02.360063 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360032    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223e840b-913e-4902-9a75-2c109c70630c-istiod-ca-cert\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360086    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26jrm\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-kube-api-access-26jrm\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360115    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223e840b-913e-4902-9a75-2c109c70630c-istio-podinfo\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360187    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-envoy\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-data\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360250    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-credential-socket\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360293    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-istio-token\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360322    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-socket\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360725 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360374    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-certs\") pod \"223e840b-913e-4902-9a75-2c109c70630c\" (UID: \"223e840b-913e-4902-9a75-2c109c70630c\") "
Jul 15 20:07:02.360725 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360509    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/223e840b-913e-4902-9a75-2c109c70630c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:07:02.360725 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360613    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:07:02.360895 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360770    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/223e840b-913e-4902-9a75-2c109c70630c-istiod-ca-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.360895 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360789    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-credential-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.361002 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.360959    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:07:02.361060 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.361016    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:07:02.361248 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.361223    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-data" (OuterVolumeSpecName: "istio-data") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:07:02.362779 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.362755    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-istio-token" (OuterVolumeSpecName: "istio-token") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:07:02.363000 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.362973    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:07:02.363099 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.363022    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-kube-api-access-26jrm" (OuterVolumeSpecName: "kube-api-access-26jrm") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "kube-api-access-26jrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:07:02.363350 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.363329    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/223e840b-913e-4902-9a75-2c109c70630c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "223e840b-913e-4902-9a75-2c109c70630c" (UID: "223e840b-913e-4902-9a75-2c109c70630c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 20:07:02.461768 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.461731    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-istio-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.461768 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.461762    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.461768 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.461771    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-workload-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.461768 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.461781    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26jrm\" (UniqueName: \"kubernetes.io/projected/223e840b-913e-4902-9a75-2c109c70630c-kube-api-access-26jrm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.462055 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.461790    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/223e840b-913e-4902-9a75-2c109c70630c-istio-podinfo\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.462055 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.461800    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-envoy\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.462055 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.461807    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/223e840b-913e-4902-9a75-2c109c70630c-istio-data\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:07:02.760122 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.760083    2576 generic.go:356] "Generic (PLEG): container finished" podID="223e840b-913e-4902-9a75-2c109c70630c" containerID="b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9" exitCode=0
Jul 15 20:07:02.760315 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.760146    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"
Jul 15 20:07:02.760315 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.760153    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" event={"ID":"223e840b-913e-4902-9a75-2c109c70630c","Type":"ContainerDied","Data":"b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9"}
Jul 15 20:07:02.760315 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.760227    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7" event={"ID":"223e840b-913e-4902-9a75-2c109c70630c","Type":"ContainerDied","Data":"b22173927c1e7ed262fdbb4e871d2fa0d84e7a6ed5b25fe3c2ff5f667d8c8c4b"}
Jul 15 20:07:02.760315 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.760259    2576 scope.go:117] "RemoveContainer" containerID="b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9"
Jul 15 20:07:02.770283 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.770260    2576 scope.go:117] "RemoveContainer" containerID="e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394"
Jul 15 20:07:02.778927 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.778909    2576 scope.go:117] "RemoveContainer" containerID="b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9"
Jul 15 20:07:02.779231 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:07:02.779209    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9\": container with ID starting with b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9 not found: ID does not exist" containerID="b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9"
Jul 15 20:07:02.779325 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.779247    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9"} err="failed to get container status \"b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9\": rpc error: code = NotFound desc = could not find container \"b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9\": container with ID starting with b780b2dd4dddf6c7f911e6a51894663238bbf5e86245994be5ed16700e3d8ab9 not found: ID does not exist"
Jul 15 20:07:02.779325 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.779274    2576 scope.go:117] "RemoveContainer" containerID="e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394"
Jul 15 20:07:02.779549 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:07:02.779526    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394\": container with ID starting with e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394 not found: ID does not exist" containerID="e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394"
Jul 15 20:07:02.779620 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.779558    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394"} err="failed to get container status \"e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394\": rpc error: code = NotFound desc = could not find container \"e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394\": container with ID starting with e21dfa8a4f08985a518596dfc6c4fb47cb30074570c493ac43eb711d1995f394 not found: ID does not exist"
Jul 15 20:07:02.794773 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.794748    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"]
Jul 15 20:07:02.797776 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:02.797753    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-10eed66e-openshift-default-7588d69cc5-74tl7"]
Jul 15 20:07:03.333514 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:07:03.333479    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="223e840b-913e-4902-9a75-2c109c70630c" path="/var/lib/kubelet/pods/223e840b-913e-4902-9a75-2c109c70630c/volumes"
Jul 15 20:09:43.251361 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.251279    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"]
Jul 15 20:09:43.251848 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.251736    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy"
Jul 15 20:09:43.251848 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.251749    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy"
Jul 15 20:09:43.251848 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.251836    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy"
Jul 15 20:09:43.251848 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.251845    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy"
Jul 15 20:09:43.255140 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.255117    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.257663 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.257648    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-60ba2b89-openshift-default-dockercfg-wjf89\""
Jul 15 20:09:43.272619 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.272588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"]
Jul 15 20:09:43.330012 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.329983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-token\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.330206 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.330032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-certs\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.330206 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.330053    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-envoy\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.330206 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.330123    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-data\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.330323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.330201    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-socket\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.330323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.330266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-credential-socket\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.330323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.330285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgzvp\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-kube-api-access-rgzvp\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.330323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.330307    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istiod-ca-cert\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.330456 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.330389    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-podinfo\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431293 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-socket\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431496 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-credential-socket\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431496 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431413    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzvp\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-kube-api-access-rgzvp\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431496 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431465    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istiod-ca-cert\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431678 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431532    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-podinfo\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431678 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431582    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-token\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431678 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431636    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-certs\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431678 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431664    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-envoy\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431678 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431665    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-credential-socket\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431971 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-socket\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.431971 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.431736    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-data\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.432087 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.432037    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-certs\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.432087 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.432058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-data\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.432222 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.432095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istiod-ca-cert\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.433885 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.433855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-envoy\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.434074 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.434046    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-podinfo\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.446664 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.446638    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgzvp\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-kube-api-access-rgzvp\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.447928 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.447904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-token\") pod \"e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") " pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.568267 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.568233    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:43.712932 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.712908    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"]
Jul 15 20:09:43.714803 ip-10-0-128-48 kubenswrapper[2576]: W0715 20:09:43.714777    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925e0fa9_cf60_4a99_9f26_ad12f90b6559.slice/crio-8e6778b0550170e91258d1361d971411acf7d812a68078c74dd51a6cb6eb3bd9 WatchSource:0}: Error finding container 8e6778b0550170e91258d1361d971411acf7d812a68078c74dd51a6cb6eb3bd9: Status 404 returned error can't find the container with id 8e6778b0550170e91258d1361d971411acf7d812a68078c74dd51a6cb6eb3bd9
Jul 15 20:09:43.716953 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.716923    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:09:43.717016 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.716990    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:09:43.717054 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:43.717015    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:09:44.572538 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:44.572501    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" event={"ID":"925e0fa9-cf60-4a99-9f26-ad12f90b6559","Type":"ContainerStarted","Data":"0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec"}
Jul 15 20:09:44.572930 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:44.572560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" event={"ID":"925e0fa9-cf60-4a99-9f26-ad12f90b6559","Type":"ContainerStarted","Data":"8e6778b0550170e91258d1361d971411acf7d812a68078c74dd51a6cb6eb3bd9"}
Jul 15 20:09:44.643255 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:44.643196    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" podStartSLOduration=1.6431775370000001 podStartE2EDuration="1.643177537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:09:44.632694602 +0000 UTC m=+1885.713888985" watchObservedRunningTime="2026-07-15 20:09:44.643177537 +0000 UTC m=+1885.724371889"
Jul 15 20:09:45.569239 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:45.569201    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:45.574316 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:45.574285    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:45.577605 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:45.577577    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:09:45.578325 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:09:45.578308    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:10:01.053500 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:01.051877    2576 patch_prober.go:28] interesting pod/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:46766->10.133.0.53:15021: read: connection reset by peer" start-of-body=
Jul 15 20:10:01.053500 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:01.051961    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": read tcp 10.133.0.2:46766->10.133.0.53:15021: read: connection reset by peer"
Jul 15 20:10:01.663339 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:01.663306    2576 generic.go:356] "Generic (PLEG): container finished" podID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerID="0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec" exitCode=0
Jul 15 20:10:01.663544 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:01.663362    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" event={"ID":"925e0fa9-cf60-4a99-9f26-ad12f90b6559","Type":"ContainerDied","Data":"0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec"}
Jul 15 20:10:01.663832 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:01.663815    2576 scope.go:117] "RemoveContainer" containerID="0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec"
Jul 15 20:10:01.664857 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:01.664826    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:10:01.664946 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:01.664893    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:10:01.664946 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:01.664927    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:10:02.672240 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:02.672202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" event={"ID":"925e0fa9-cf60-4a99-9f26-ad12f90b6559","Type":"ContainerStarted","Data":"87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763"}
Jul 15 20:10:03.569110 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:03.569070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:10:03.569353 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:03.569321    2576 patch_prober.go:28] interesting pod/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 20:10:03.569436 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:03.569376    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 20:10:04.569323 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:04.569285    2576 patch_prober.go:28] interesting pod/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 20:10:04.569721 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:04.569341    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 20:10:05.569317 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:05.569271    2576 patch_prober.go:28] interesting pod/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 20:10:05.569500 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:05.569345    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 20:10:06.568588 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:06.568546    2576 patch_prober.go:28] interesting pod/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 15 20:10:06.568796 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:06.568626    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 15 20:10:07.572409 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:07.572379    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:10:07.572893 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:07.572755    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:10:07.573454 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:10:07.573434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:11:14.230408 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:14.230311    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"]
Jul 15 20:11:14.230919 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:14.230575    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy" containerID="cri-o://87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763" gracePeriod=30
Jul 15 20:11:19.491518 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.491491    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:11:19.505489 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505412    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-envoy\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.505489 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505446    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istiod-ca-cert\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.505489 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505484    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-podinfo\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.505761 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505510    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-data\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.505761 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505540    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-token\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.505761 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505563    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgzvp\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-kube-api-access-rgzvp\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.505761 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505606    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-credential-socket\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.505761 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505649    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-certs\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.506037 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505888    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:11:19.506037 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505900    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:11:19.506037 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.505951    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-socket\") pod \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\" (UID: \"925e0fa9-cf60-4a99-9f26-ad12f90b6559\") "
Jul 15 20:11:19.506225 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.506039    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:11:19.506225 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.506190    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:11:19.506421 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.506384    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-data" (OuterVolumeSpecName: "istio-data") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:11:19.506421 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.506388    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istiod-ca-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:19.506575 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.506432    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-credential-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:19.506575 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.506450    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:19.506575 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.506465    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-workload-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:19.507738 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.507714    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-token" (OuterVolumeSpecName: "istio-token") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:11:19.507738 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.507727    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:11:19.507896 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.507806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 20:11:19.507896 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.507862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-kube-api-access-rgzvp" (OuterVolumeSpecName: "kube-api-access-rgzvp") pod "925e0fa9-cf60-4a99-9f26-ad12f90b6559" (UID: "925e0fa9-cf60-4a99-9f26-ad12f90b6559"). InnerVolumeSpecName "kube-api-access-rgzvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:11:19.607978 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.607947    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-envoy\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:19.607978 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.607976    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-podinfo\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:19.607978 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.607984    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-data\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:19.608225 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.607992    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-istio-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:19.608225 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:19.608001    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgzvp\" (UniqueName: \"kubernetes.io/projected/925e0fa9-cf60-4a99-9f26-ad12f90b6559-kube-api-access-rgzvp\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:11:20.059444 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.059408    2576 generic.go:356] "Generic (PLEG): container finished" podID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerID="87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763" exitCode=0
Jul 15 20:11:20.059610 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.059493    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"
Jul 15 20:11:20.059610 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.059490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" event={"ID":"925e0fa9-cf60-4a99-9f26-ad12f90b6559","Type":"ContainerDied","Data":"87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763"}
Jul 15 20:11:20.059690 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.059640    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n" event={"ID":"925e0fa9-cf60-4a99-9f26-ad12f90b6559","Type":"ContainerDied","Data":"8e6778b0550170e91258d1361d971411acf7d812a68078c74dd51a6cb6eb3bd9"}
Jul 15 20:11:20.059690 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.059665    2576 scope.go:117] "RemoveContainer" containerID="87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763"
Jul 15 20:11:20.069943 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.069922    2576 scope.go:117] "RemoveContainer" containerID="0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec"
Jul 15 20:11:20.078012 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.077993    2576 scope.go:117] "RemoveContainer" containerID="87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763"
Jul 15 20:11:20.078337 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:11:20.078311    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763\": container with ID starting with 87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763 not found: ID does not exist" containerID="87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763"
Jul 15 20:11:20.078426 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.078349    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763"} err="failed to get container status \"87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763\": rpc error: code = NotFound desc = could not find container \"87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763\": container with ID starting with 87fa96dc41f85fe50259a752556991c6a78c29052b7e49f09e1af4b312d9c763 not found: ID does not exist"
Jul 15 20:11:20.078426 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.078372    2576 scope.go:117] "RemoveContainer" containerID="0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec"
Jul 15 20:11:20.078595 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:11:20.078578    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec\": container with ID starting with 0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec not found: ID does not exist" containerID="0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec"
Jul 15 20:11:20.078647 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.078603    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec"} err="failed to get container status \"0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec\": rpc error: code = NotFound desc = could not find container \"0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec\": container with ID starting with 0c862fa879af42103f7ae738225e5d117aa642b4fd46e7ffae3ac666457c29ec not found: ID does not exist"
Jul 15 20:11:20.084342 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.084318    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"]
Jul 15 20:11:20.095667 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:20.095634    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-60ba2b89-openshift-default-6998c84955-qg98n"]
Jul 15 20:11:21.333769 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:11:21.333735    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" path="/var/lib/kubelet/pods/925e0fa9-cf60-4a99-9f26-ad12f90b6559/volumes"
Jul 15 20:17:26.506281 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506242    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"]
Jul 15 20:17:26.506819 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506704    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy"
Jul 15 20:17:26.506819 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506718    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="223e840b-913e-4902-9a75-2c109c70630c" containerName="istio-proxy"
Jul 15 20:17:26.506819 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506729    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy"
Jul 15 20:17:26.506819 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506734    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy"
Jul 15 20:17:26.506819 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506742    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy"
Jul 15 20:17:26.506819 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506747    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy"
Jul 15 20:17:26.506819 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506811    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy"
Jul 15 20:17:26.506819 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.506817    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="925e0fa9-cf60-4a99-9f26-ad12f90b6559" containerName="istio-proxy"
Jul 15 20:17:26.509902 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.509884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.514231 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.514199    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a27bd5-openshift-default-dockercfg-f6xbl\""
Jul 15 20:17:26.524526 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.524502    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"]
Jul 15 20:17:26.697006 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.696967    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-data\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.697006 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.697015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/947eca02-e095-4d16-890a-6642b663a619-istio-podinfo\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.697268 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.697051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-istio-token\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.697268 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.697108    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-socket\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.697268 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.697141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-credential-socket\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.697268 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.697215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlxb8\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-kube-api-access-hlxb8\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.697268 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.697234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-envoy\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.697431 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.697287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-certs\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.697431 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.697340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/947eca02-e095-4d16-890a-6642b663a619-istiod-ca-cert\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.798910 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.798811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-istio-token\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.798910 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.798867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-socket\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.798910 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.798899    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-credential-socket\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799251 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.798934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlxb8\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-kube-api-access-hlxb8\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799251 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.798959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-envoy\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799251 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-certs\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799251 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799049    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/947eca02-e095-4d16-890a-6642b663a619-istiod-ca-cert\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799251 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799115    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-data\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799251 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/947eca02-e095-4d16-890a-6642b663a619-istio-podinfo\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799617 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-socket\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799617 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-credential-socket\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799617 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799588    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-certs\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799617 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799608    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-data\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.799810 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.799790    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/947eca02-e095-4d16-890a-6642b663a619-istiod-ca-cert\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.801294 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.801274    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-envoy\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.801647 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.801627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/947eca02-e095-4d16-890a-6642b663a619-istio-podinfo\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.808196 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.808150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-istio-token\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.808320 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.808246    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlxb8\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-kube-api-access-hlxb8\") pod \"e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") " pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.827855 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.827836    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:26.975448 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.975416    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"]
Jul 15 20:17:26.977525 ip-10-0-128-48 kubenswrapper[2576]: W0715 20:17:26.977498    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947eca02_e095_4d16_890a_6642b663a619.slice/crio-a047315a51c67ec43a1c2c93e476e83873b4485b897219ab7dee366effaa61e2 WatchSource:0}: Error finding container a047315a51c67ec43a1c2c93e476e83873b4485b897219ab7dee366effaa61e2: Status 404 returned error can't find the container with id a047315a51c67ec43a1c2c93e476e83873b4485b897219ab7dee366effaa61e2
Jul 15 20:17:26.979633 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.979597    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:17:26.979711 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.979665    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:17:26.979711 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:26.979692    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:17:27.907600 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:27.907563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" event={"ID":"947eca02-e095-4d16-890a-6642b663a619","Type":"ContainerStarted","Data":"46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d"}
Jul 15 20:17:27.908012 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:27.907619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" event={"ID":"947eca02-e095-4d16-890a-6642b663a619","Type":"ContainerStarted","Data":"a047315a51c67ec43a1c2c93e476e83873b4485b897219ab7dee366effaa61e2"}
Jul 15 20:17:27.933709 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:27.933660    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" podStartSLOduration=1.933645421 podStartE2EDuration="1.933645421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:17:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:17:27.93085558 +0000 UTC m=+2349.012049978" watchObservedRunningTime="2026-07-15 20:17:27.933645421 +0000 UTC m=+2349.014839781"
Jul 15 20:17:28.828020 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:28.827979    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:28.833134 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:28.833109    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:28.913080 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:28.913048    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:28.914003 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:28.913975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:43.914302 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:43.914262    2576 patch_prober.go:28] interesting pod/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 20:17:43.914732 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:43.914340    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 20:17:43.993089 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:43.993057    2576 generic.go:356] "Generic (PLEG): container finished" podID="947eca02-e095-4d16-890a-6642b663a619" containerID="46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d" exitCode=0
Jul 15 20:17:43.993269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:43.993122    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" event={"ID":"947eca02-e095-4d16-890a-6642b663a619","Type":"ContainerDied","Data":"46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d"}
Jul 15 20:17:43.993580 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:43.993565    2576 scope.go:117] "RemoveContainer" containerID="46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d"
Jul 15 20:17:43.994776 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:43.994745    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:17:43.994833 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:43.994819    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:17:43.994865 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:43.994853    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:17:44.999939 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:44.999906    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" event={"ID":"947eca02-e095-4d16-890a-6642b663a619","Type":"ContainerStarted","Data":"ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974"}
Jul 15 20:17:45.828016 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:45.827977    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:45.828255 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:45.828222    2576 patch_prober.go:28] interesting pod/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 20:17:45.828331 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:45.828280    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 20:17:46.828503 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:46.828466    2576 patch_prober.go:28] interesting pod/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 20:17:46.829571 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:46.829099    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 20:17:47.829365 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:47.829322    2576 patch_prober.go:28] interesting pod/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 20:17:47.829890 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:47.829403    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 20:17:48.829137 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:48.829093    2576 patch_prober.go:28] interesting pod/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 15 20:17:48.829344 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:48.829205    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 15 20:17:49.832903 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:49.832872    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:49.833321 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:49.833199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:17:49.833993 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:17:49.833958    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:20:17.236033 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:17.235946    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"]
Jul 15 20:20:17.236505 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:17.236215    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy" containerID="cri-o://ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974" gracePeriod=30
Jul 15 20:20:19.836196 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:19.836144    2576 patch_prober.go:28] interesting pod/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 20:20:19.836574 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:19.836228    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 20:20:22.503642 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.503582    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:20:22.632948 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.632910    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlxb8\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-kube-api-access-hlxb8\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633120 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.632967    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-envoy\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633120 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.632986    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/947eca02-e095-4d16-890a-6642b663a619-istiod-ca-cert\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633120 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633023    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-socket\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633120 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633071    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-data\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633120 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633096    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-istio-token\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633428 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633128    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-credential-socket\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633428 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633221    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-certs\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633428 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633250    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/947eca02-e095-4d16-890a-6642b663a619-istio-podinfo\") pod \"947eca02-e095-4d16-890a-6642b663a619\" (UID: \"947eca02-e095-4d16-890a-6642b663a619\") "
Jul 15 20:20:22.633428 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633403    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:20:22.633637 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633465    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/947eca02-e095-4d16-890a-6642b663a619-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:20:22.633695 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633633    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:20:22.633750 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633688    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/947eca02-e095-4d16-890a-6642b663a619-istiod-ca-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.633750 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633696    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:20:22.633750 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633718    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.634018 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.633971    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-data" (OuterVolumeSpecName: "istio-data") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:20:22.635381 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.635355    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/947eca02-e095-4d16-890a-6642b663a619-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 20:20:22.635482 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.635425    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-istio-token" (OuterVolumeSpecName: "istio-token") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:20:22.635639 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.635620    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-kube-api-access-hlxb8" (OuterVolumeSpecName: "kube-api-access-hlxb8") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "kube-api-access-hlxb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:20:22.635697 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.635622    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "947eca02-e095-4d16-890a-6642b663a619" (UID: "947eca02-e095-4d16-890a-6642b663a619"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:20:22.735089 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.735049    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-envoy\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.735089 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.735082    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-istio-data\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.735089 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.735090    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-istio-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.735089 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.735101    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-credential-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.735380 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.735109    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/947eca02-e095-4d16-890a-6642b663a619-workload-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.735380 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.735118    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/947eca02-e095-4d16-890a-6642b663a619-istio-podinfo\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.735380 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.735127    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlxb8\" (UniqueName: \"kubernetes.io/projected/947eca02-e095-4d16-890a-6642b663a619-kube-api-access-hlxb8\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:20:22.804109 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.804018    2576 generic.go:356] "Generic (PLEG): container finished" podID="947eca02-e095-4d16-890a-6642b663a619" containerID="ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974" exitCode=0
Jul 15 20:20:22.804109 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.804071    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"
Jul 15 20:20:22.804311 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.804103    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" event={"ID":"947eca02-e095-4d16-890a-6642b663a619","Type":"ContainerDied","Data":"ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974"}
Jul 15 20:20:22.804311 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.804173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz" event={"ID":"947eca02-e095-4d16-890a-6642b663a619","Type":"ContainerDied","Data":"a047315a51c67ec43a1c2c93e476e83873b4485b897219ab7dee366effaa61e2"}
Jul 15 20:20:22.804311 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.804197    2576 scope.go:117] "RemoveContainer" containerID="ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974"
Jul 15 20:20:22.814141 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.814122    2576 scope.go:117] "RemoveContainer" containerID="46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d"
Jul 15 20:20:22.823027 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.823008    2576 scope.go:117] "RemoveContainer" containerID="ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974"
Jul 15 20:20:22.823326 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:20:22.823309    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974\": container with ID starting with ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974 not found: ID does not exist" containerID="ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974"
Jul 15 20:20:22.823383 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.823335    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974"} err="failed to get container status \"ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974\": rpc error: code = NotFound desc = could not find container \"ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974\": container with ID starting with ad68893ec89c9b80da0a520de655fcb4d680eca6ab79a73b2fd9c8709b65c974 not found: ID does not exist"
Jul 15 20:20:22.823383 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.823352    2576 scope.go:117] "RemoveContainer" containerID="46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d"
Jul 15 20:20:22.823607 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:20:22.823590    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d\": container with ID starting with 46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d not found: ID does not exist" containerID="46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d"
Jul 15 20:20:22.823662 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.823611    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d"} err="failed to get container status \"46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d\": rpc error: code = NotFound desc = could not find container \"46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d\": container with ID starting with 46ef75d18b86ba00e8e68671f9eb0da9934441372e3e5765dd6d520f73e7907d not found: ID does not exist"
Jul 15 20:20:22.834147 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.834121    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"]
Jul 15 20:20:22.841148 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:22.841124    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a27bd5-openshift-default-7d96f86d6f-sbcqz"]
Jul 15 20:20:23.333379 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:23.333346    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947eca02-e095-4d16-890a-6642b663a619" path="/var/lib/kubelet/pods/947eca02-e095-4d16-890a-6642b663a619/volumes"
Jul 15 20:20:26.594942 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.594901    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"]
Jul 15 20:20:26.595571 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.595550    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy"
Jul 15 20:20:26.595665 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.595573    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy"
Jul 15 20:20:26.595739 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.595723    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy"
Jul 15 20:20:26.595800 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.595738    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy"
Jul 15 20:20:26.599074 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.599051    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.602579 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.602555    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-772fb7-openshift-default-dockercfg-ljqfd\""
Jul 15 20:20:26.610173 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.610136    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"]
Jul 15 20:20:26.675584 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675546    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jknfk\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-kube-api-access-jknfk\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.675771 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29239649-eb7b-472a-bef7-864ccb018b0c-istio-podinfo\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.675771 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675670    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29239649-eb7b-472a-bef7-864ccb018b0c-istiod-ca-cert\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.675771 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-envoy\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.675771 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-data\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.675905 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675774    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-credential-socket\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.675905 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675791    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-certs\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.675905 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-socket\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.675905 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.675879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-istio-token\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.776586 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.776546    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29239649-eb7b-472a-bef7-864ccb018b0c-istio-podinfo\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.776766 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.776595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29239649-eb7b-472a-bef7-864ccb018b0c-istiod-ca-cert\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.776766 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.776715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-envoy\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.776848 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.776765    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-data\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.776848 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.776798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-credential-socket\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.776848 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.776822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-certs\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.776982 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.776856    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-socket\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.776982 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.776896    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-istio-token\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.777071 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.777015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jknfk\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-kube-api-access-jknfk\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.777361 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.777144    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-credential-socket\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.777361 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.777227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-data\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.777361 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.777305    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-certs\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.777565 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.777372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-socket\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.777565 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.777401    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29239649-eb7b-472a-bef7-864ccb018b0c-istiod-ca-cert\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.779018 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.779000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-envoy\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.779274 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.779258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29239649-eb7b-472a-bef7-864ccb018b0c-istio-podinfo\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.786094 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.786071    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jknfk\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-kube-api-access-jknfk\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.786266 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.786243    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-istio-token\") pod \"e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") " pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:26.910369 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:26.910275    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:27.093430 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:27.093393    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"]
Jul 15 20:20:27.098942 ip-10-0-128-48 kubenswrapper[2576]: W0715 20:20:27.098911    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29239649_eb7b_472a_bef7_864ccb018b0c.slice/crio-88a630a1651a1e4967206bffda3707920c43f828bad1cc5010f7c1451a483839 WatchSource:0}: Error finding container 88a630a1651a1e4967206bffda3707920c43f828bad1cc5010f7c1451a483839: Status 404 returned error can't find the container with id 88a630a1651a1e4967206bffda3707920c43f828bad1cc5010f7c1451a483839
Jul 15 20:20:27.101007 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:27.100974    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:20:27.101099 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:27.101042    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:20:27.101099 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:27.101070    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:20:27.832214 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:27.832154    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" event={"ID":"29239649-eb7b-472a-bef7-864ccb018b0c","Type":"ContainerStarted","Data":"f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217"}
Jul 15 20:20:27.832618 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:27.832228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" event={"ID":"29239649-eb7b-472a-bef7-864ccb018b0c","Type":"ContainerStarted","Data":"88a630a1651a1e4967206bffda3707920c43f828bad1cc5010f7c1451a483839"}
Jul 15 20:20:27.855866 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:27.855809    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" podStartSLOduration=1.855794167 podStartE2EDuration="1.855794167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:20:27.852724907 +0000 UTC m=+2528.933919268" watchObservedRunningTime="2026-07-15 20:20:27.855794167 +0000 UTC m=+2528.936988528"
Jul 15 20:20:27.910707 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:27.910670    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:28.916143 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:28.916113    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:29.843227 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:29.843200    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:29.844359 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:29.844333    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:45.885315 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:45.885274    2576 patch_prober.go:28] interesting pod/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 20:20:45.885724 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:45.885332    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 20:20:46.942608 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:46.942577    2576 generic.go:356] "Generic (PLEG): container finished" podID="29239649-eb7b-472a-bef7-864ccb018b0c" containerID="f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217" exitCode=0
Jul 15 20:20:46.943036 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:46.942660    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" event={"ID":"29239649-eb7b-472a-bef7-864ccb018b0c","Type":"ContainerDied","Data":"f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217"}
Jul 15 20:20:46.943120 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:46.943106    2576 scope.go:117] "RemoveContainer" containerID="f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217"
Jul 15 20:20:46.944124 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:46.944097    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:20:46.944243 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:46.944197    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:20:46.944314 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:46.944246    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:20:47.950225 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:47.950192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" event={"ID":"29239649-eb7b-472a-bef7-864ccb018b0c","Type":"ContainerStarted","Data":"d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e"}
Jul 15 20:20:48.910586 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:48.910547    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:48.910795 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:48.910773    2576 patch_prober.go:28] interesting pod/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 15 20:20:48.910842 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:48.910829    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 15 20:20:49.911579 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:49.911539    2576 patch_prober.go:28] interesting pod/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 15 20:20:49.912022 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:49.911607    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 15 20:20:50.911339 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:50.911303    2576 patch_prober.go:28] interesting pod/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 15 20:20:50.911520 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:50.911356    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 15 20:20:51.911123 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:51.911084    2576 patch_prober.go:28] interesting pod/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 15 20:20:51.911559 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:51.911148    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 15 20:20:52.914721 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:52.914683    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:52.915188 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:52.914990    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:20:52.915748 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:20:52.915733    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:21:34.372064 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:34.372023    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"]
Jul 15 20:21:34.372584 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:34.372263    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy" containerID="cri-o://d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e" gracePeriod=30
Jul 15 20:21:37.916987 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:37.916950    2576 patch_prober.go:28] interesting pod/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 20:21:37.917408 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:37.917009    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 20:21:39.641903 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.641837    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:21:39.808573 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.808538    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29239649-eb7b-472a-bef7-864ccb018b0c-istio-podinfo\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.808763 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.808585    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-istio-token\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.808763 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.808730    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-envoy\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.808894 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.808774    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-data\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.808894 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.808808    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29239649-eb7b-472a-bef7-864ccb018b0c-istiod-ca-cert\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.808894 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.808833    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-certs\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.809046 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.808896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jknfk\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-kube-api-access-jknfk\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.809046 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.808961    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-credential-socket\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.809046 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.809013    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-socket\") pod \"29239649-eb7b-472a-bef7-864ccb018b0c\" (UID: \"29239649-eb7b-472a-bef7-864ccb018b0c\") "
Jul 15 20:21:39.809482 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.809319    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:21:39.809482 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.809396    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29239649-eb7b-472a-bef7-864ccb018b0c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:21:39.809482 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.809442    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:39.809754 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.809568    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:21:39.809754 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.809655    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:21:39.809832 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.809806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-data" (OuterVolumeSpecName: "istio-data") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:21:39.811016 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.810991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:21:39.811125 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.811100    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-kube-api-access-jknfk" (OuterVolumeSpecName: "kube-api-access-jknfk") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "kube-api-access-jknfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:21:39.811309 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.811290    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-istio-token" (OuterVolumeSpecName: "istio-token") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:21:39.811400 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.811385    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29239649-eb7b-472a-bef7-864ccb018b0c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29239649-eb7b-472a-bef7-864ccb018b0c" (UID: "29239649-eb7b-472a-bef7-864ccb018b0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 20:21:39.910475 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.910388    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-envoy\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:39.910475 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.910418    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-istio-data\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:39.910475 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.910427    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29239649-eb7b-472a-bef7-864ccb018b0c-istiod-ca-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:39.910475 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.910437    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jknfk\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-kube-api-access-jknfk\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:39.910475 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.910446    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-credential-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:39.910475 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.910454    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29239649-eb7b-472a-bef7-864ccb018b0c-workload-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:39.910475 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.910461    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29239649-eb7b-472a-bef7-864ccb018b0c-istio-podinfo\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:39.910475 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:39.910473    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29239649-eb7b-472a-bef7-864ccb018b0c-istio-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:21:40.223534 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.223442    2576 generic.go:356] "Generic (PLEG): container finished" podID="29239649-eb7b-472a-bef7-864ccb018b0c" containerID="d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e" exitCode=0
Jul 15 20:21:40.223534 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.223490    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"
Jul 15 20:21:40.223776 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.223531    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" event={"ID":"29239649-eb7b-472a-bef7-864ccb018b0c","Type":"ContainerDied","Data":"d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e"}
Jul 15 20:21:40.223776 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.223596    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj" event={"ID":"29239649-eb7b-472a-bef7-864ccb018b0c","Type":"ContainerDied","Data":"88a630a1651a1e4967206bffda3707920c43f828bad1cc5010f7c1451a483839"}
Jul 15 20:21:40.223776 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.223625    2576 scope.go:117] "RemoveContainer" containerID="d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e"
Jul 15 20:21:40.235003 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.234981    2576 scope.go:117] "RemoveContainer" containerID="f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217"
Jul 15 20:21:40.246539 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.246513    2576 scope.go:117] "RemoveContainer" containerID="d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e"
Jul 15 20:21:40.246913 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:21:40.246882    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e\": container with ID starting with d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e not found: ID does not exist" containerID="d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e"
Jul 15 20:21:40.247025 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.246924    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e"} err="failed to get container status \"d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e\": rpc error: code = NotFound desc = could not find container \"d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e\": container with ID starting with d924ff3e6c92eae05ef571b642688ea2b40718ebd75047dd27119fb8d4c1010e not found: ID does not exist"
Jul 15 20:21:40.247025 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.246950    2576 scope.go:117] "RemoveContainer" containerID="f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217"
Jul 15 20:21:40.247303 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:21:40.247275    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217\": container with ID starting with f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217 not found: ID does not exist" containerID="f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217"
Jul 15 20:21:40.247396 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.247312    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217"} err="failed to get container status \"f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217\": rpc error: code = NotFound desc = could not find container \"f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217\": container with ID starting with f25b9d5ac251233481c7485e8dd35df465b80269b21601ea63b1c9307fb77217 not found: ID does not exist"
Jul 15 20:21:40.252674 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.252649    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"]
Jul 15 20:21:40.257821 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:40.257800    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-772fb7-openshift-default-6b8c4b7547-bq9vj"]
Jul 15 20:21:41.332131 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:41.332057    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" path="/var/lib/kubelet/pods/29239649-eb7b-472a-bef7-864ccb018b0c/volumes"
Jul 15 20:21:44.023427 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.023395    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"]
Jul 15 20:21:44.023845 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.023831    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy"
Jul 15 20:21:44.023934 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.023847    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy"
Jul 15 20:21:44.023934 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.023868    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy"
Jul 15 20:21:44.023934 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.023873    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="947eca02-e095-4d16-890a-6642b663a619" containerName="istio-proxy"
Jul 15 20:21:44.024029 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.023954    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy"
Jul 15 20:21:44.024029 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.023962    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy"
Jul 15 20:21:44.028512 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.028495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.031851 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.031829    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-54098e-openshift-default-dockercfg-fvqc8\""
Jul 15 20:21:44.100815 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.100775    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"]
Jul 15 20:21:44.155030 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.154987    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a79249-8343-44eb-8475-09db94b9f165-istio-podinfo\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.155269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.155051    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-socket\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.155269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.155094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-istio-token\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.155269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.155141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a79249-8343-44eb-8475-09db94b9f165-istiod-ca-cert\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.155269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.155217    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d45xg\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-kube-api-access-d45xg\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.155269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.155244    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-certs\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.155269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.155265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-data\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.155535 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.155302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-credential-socket\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.155535 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.155329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-envoy\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.256666 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256628    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d45xg\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-kube-api-access-d45xg\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.256666 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-certs\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.256909 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256688    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-data\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.256909 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256707    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-credential-socket\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.256909 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-envoy\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.256909 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256834    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a79249-8343-44eb-8475-09db94b9f165-istio-podinfo\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.256909 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256879    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-socket\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.256909 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256901    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-istio-token\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.257289 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.256956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a79249-8343-44eb-8475-09db94b9f165-istiod-ca-cert\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.257289 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.257086    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-certs\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.257289 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.257157    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-data\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.257289 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.257214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-credential-socket\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.257444 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.257417    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-socket\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.257666 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.257649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a79249-8343-44eb-8475-09db94b9f165-istiod-ca-cert\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.259158 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.259136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-envoy\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.259419 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.259395    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a79249-8343-44eb-8475-09db94b9f165-istio-podinfo\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.264947 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.264924    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-istio-token\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.265316 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.265295    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d45xg\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-kube-api-access-d45xg\") pod \"e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") " pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.339081 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.339045    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:44.497190 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.497129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"]
Jul 15 20:21:44.502282 ip-10-0-128-48 kubenswrapper[2576]: W0715 20:21:44.502255    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9a79249_8343_44eb_8475_09db94b9f165.slice/crio-a9f3f5ffed36b9ed35e53a4091c4b182ddd6233413cf08ecfe7ba0197636fd21 WatchSource:0}: Error finding container a9f3f5ffed36b9ed35e53a4091c4b182ddd6233413cf08ecfe7ba0197636fd21: Status 404 returned error can't find the container with id a9f3f5ffed36b9ed35e53a4091c4b182ddd6233413cf08ecfe7ba0197636fd21
Jul 15 20:21:44.504486 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.504451    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:21:44.504606 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.504537    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:21:44.504606 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:44.504582    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:21:45.251018 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:45.250981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" event={"ID":"f9a79249-8343-44eb-8475-09db94b9f165","Type":"ContainerStarted","Data":"8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698"}
Jul 15 20:21:45.251440 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:45.251041    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" event={"ID":"f9a79249-8343-44eb-8475-09db94b9f165","Type":"ContainerStarted","Data":"a9f3f5ffed36b9ed35e53a4091c4b182ddd6233413cf08ecfe7ba0197636fd21"}
Jul 15 20:21:45.287532 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:45.287483    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" podStartSLOduration=2.287467623 podStartE2EDuration="2.287467623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:21:45.28656445 +0000 UTC m=+2606.367758810" watchObservedRunningTime="2026-07-15 20:21:45.287467623 +0000 UTC m=+2606.368661984"
Jul 15 20:21:45.339915 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:45.339887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:45.345219 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:45.345195    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:46.256665 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:46.256636    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:21:46.257597 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:21:46.257578    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:22:02.298331 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:02.298290    2576 patch_prober.go:28] interesting pod/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 15 20:22:02.298746 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:02.298355    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 15 20:22:04.352306 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:04.352267    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9a79249-8343-44eb-8475-09db94b9f165" containerID="8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698" exitCode=0
Jul 15 20:22:04.352306 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:04.352292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" event={"ID":"f9a79249-8343-44eb-8475-09db94b9f165","Type":"ContainerDied","Data":"8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698"}
Jul 15 20:22:04.352791 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:04.352753    2576 scope.go:117] "RemoveContainer" containerID="8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698"
Jul 15 20:22:04.354058 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:04.354030    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:22:04.354129 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:04.354113    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:22:04.354188 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:04.354177    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 20:22:05.362467 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:05.362432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" event={"ID":"f9a79249-8343-44eb-8475-09db94b9f165","Type":"ContainerStarted","Data":"513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb"}
Jul 15 20:22:06.344190 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:06.343202    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:22:06.344190 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:06.343315    2576 patch_prober.go:28] interesting pod/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 15 20:22:06.344190 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:06.343368    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 15 20:22:07.340058 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:07.340020    2576 patch_prober.go:28] interesting pod/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 15 20:22:07.340683 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:07.340652    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 15 20:22:08.339629 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:08.339593    2576 patch_prober.go:28] interesting pod/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 15 20:22:08.339915 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:08.339888    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 15 20:22:09.343757 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:09.343724    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:22:09.344218 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:09.343981    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:22:09.344764 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:09.344743    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:22:32.047670 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.047635    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"]
Jul 15 20:22:32.048315 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.048297    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy"
Jul 15 20:22:32.048402 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.048317    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="29239649-eb7b-472a-bef7-864ccb018b0c" containerName="istio-proxy"
Jul 15 20:22:32.051356 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.051335    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.054998 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.054974    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"openshift-service-ca.crt\""
Jul 15 20:22:32.055141 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.054977    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"kube-root-ca.crt\""
Jul 15 20:22:32.055141 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.055029    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"auth-test-model-54098e-kserve-self-signed-certs\""
Jul 15 20:22:32.055141 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.055049    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-54098e\"/\"default-dockercfg-6c28d\""
Jul 15 20:22:32.065969 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.065941    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"]
Jul 15 20:22:32.235214 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.235140    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4r85\" (UniqueName: \"kubernetes.io/projected/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-kube-api-access-x4r85\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.235400 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.235229    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-dshm\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.235400 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.235262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tls-certs\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.235400 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.235281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tmp-dir\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.235400 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.235331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-model-cache\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.235400 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.235388    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-home\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336122 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-model-cache\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336321 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-home\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336321 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4r85\" (UniqueName: \"kubernetes.io/projected/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-kube-api-access-x4r85\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336321 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-dshm\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336321 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tls-certs\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336527 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336340    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tmp-dir\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336601 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-home\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336664 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336566    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-model-cache\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.336715 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.336662    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tmp-dir\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.338813 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.338788    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-dshm\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.339111 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.339083    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tls-certs\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.345472 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.345435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4r85\" (UniqueName: \"kubernetes.io/projected/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-kube-api-access-x4r85\") pod \"auth-test-model-54098e-kserve-5c9b9768d7-qrpjw\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") " pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.361677 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.361641    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:32.509269 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.504128    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"]
Jul 15 20:22:32.519701 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:32.519677    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw" event={"ID":"9212d3e8-ee97-4186-9a36-d7a4375a3b5e","Type":"ContainerStarted","Data":"0d32ae6ff5473fea1c0a5be5e6cb40e248f6ce2c4595e337d6daa7b700726ba1"}
Jul 15 20:22:33.526264 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:33.526229    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw" event={"ID":"9212d3e8-ee97-4186-9a36-d7a4375a3b5e","Type":"ContainerStarted","Data":"1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1"}
Jul 15 20:22:33.546937 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:33.546889    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw" podStartSLOduration=1.546870181 podStartE2EDuration="1.546870181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:22:33.544962627 +0000 UTC m=+2654.626156988" watchObservedRunningTime="2026-07-15 20:22:33.546870181 +0000 UTC m=+2654.628064541"
Jul 15 20:22:42.362035 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:42.361988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:42.362477 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:42.362049    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:42.374540 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:42.374516    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:22:42.582519 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:22:42.582491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:24:23.681356 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:23.681323    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"]
Jul 15 20:24:38.701478 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.701433    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw" podUID="9212d3e8-ee97-4186-9a36-d7a4375a3b5e" containerName="main" containerID="cri-o://1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1" gracePeriod=45
Jul 15 20:24:38.952182 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.952090    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:24:38.994889 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.994852    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tls-certs\") pod \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") "
Jul 15 20:24:38.995085 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.994900    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-dshm\") pod \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") "
Jul 15 20:24:38.995085 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.994930    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-model-cache\") pod \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") "
Jul 15 20:24:38.995085 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995009    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4r85\" (UniqueName: \"kubernetes.io/projected/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-kube-api-access-x4r85\") pod \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") "
Jul 15 20:24:38.995410 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995095    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-home\") pod \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") "
Jul 15 20:24:38.995410 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995129    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tmp-dir\") pod \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\" (UID: \"9212d3e8-ee97-4186-9a36-d7a4375a3b5e\") "
Jul 15 20:24:38.995410 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995233    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-model-cache" (OuterVolumeSpecName: "model-cache") pod "9212d3e8-ee97-4186-9a36-d7a4375a3b5e" (UID: "9212d3e8-ee97-4186-9a36-d7a4375a3b5e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:24:38.995581 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995408    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-home" (OuterVolumeSpecName: "home") pod "9212d3e8-ee97-4186-9a36-d7a4375a3b5e" (UID: "9212d3e8-ee97-4186-9a36-d7a4375a3b5e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:24:38.995581 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995491    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9212d3e8-ee97-4186-9a36-d7a4375a3b5e" (UID: "9212d3e8-ee97-4186-9a36-d7a4375a3b5e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:24:38.995696 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995671    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:24:38.995753 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995692    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:24:38.995753 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.995707    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:24:38.997315 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.997283    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-kube-api-access-x4r85" (OuterVolumeSpecName: "kube-api-access-x4r85") pod "9212d3e8-ee97-4186-9a36-d7a4375a3b5e" (UID: "9212d3e8-ee97-4186-9a36-d7a4375a3b5e"). InnerVolumeSpecName "kube-api-access-x4r85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:24:38.997315 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.997302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-dshm" (OuterVolumeSpecName: "dshm") pod "9212d3e8-ee97-4186-9a36-d7a4375a3b5e" (UID: "9212d3e8-ee97-4186-9a36-d7a4375a3b5e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:24:38.997515 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:38.997338    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9212d3e8-ee97-4186-9a36-d7a4375a3b5e" (UID: "9212d3e8-ee97-4186-9a36-d7a4375a3b5e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:24:39.097057 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.097016    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:24:39.097057 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.097050    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:24:39.097057 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.097065    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4r85\" (UniqueName: \"kubernetes.io/projected/9212d3e8-ee97-4186-9a36-d7a4375a3b5e-kube-api-access-x4r85\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:24:39.178409 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.178378    2576 generic.go:356] "Generic (PLEG): container finished" podID="9212d3e8-ee97-4186-9a36-d7a4375a3b5e" containerID="1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1" exitCode=0
Jul 15 20:24:39.178409 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.178410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw" event={"ID":"9212d3e8-ee97-4186-9a36-d7a4375a3b5e","Type":"ContainerDied","Data":"1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1"}
Jul 15 20:24:39.178641 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.178427    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"
Jul 15 20:24:39.178641 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.178437    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw" event={"ID":"9212d3e8-ee97-4186-9a36-d7a4375a3b5e","Type":"ContainerDied","Data":"0d32ae6ff5473fea1c0a5be5e6cb40e248f6ce2c4595e337d6daa7b700726ba1"}
Jul 15 20:24:39.178641 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.178453    2576 scope.go:117] "RemoveContainer" containerID="1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1"
Jul 15 20:24:39.187486 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.187467    2576 scope.go:117] "RemoveContainer" containerID="1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1"
Jul 15 20:24:39.187744 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:24:39.187725    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1\": container with ID starting with 1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1 not found: ID does not exist" containerID="1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1"
Jul 15 20:24:39.187790 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.187753    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1"} err="failed to get container status \"1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1\": rpc error: code = NotFound desc = could not find container \"1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1\": container with ID starting with 1f505610f78de655faaf3def9bd98a7e5e6ef3dffab426d89b8174d23e747db1 not found: ID does not exist"
Jul 15 20:24:39.202923 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.202839    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"]
Jul 15 20:24:39.207092 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.207069    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-54098e/auth-test-model-54098e-kserve-5c9b9768d7-qrpjw"]
Jul 15 20:24:39.334755 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:24:39.334723    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9212d3e8-ee97-4186-9a36-d7a4375a3b5e" path="/var/lib/kubelet/pods/9212d3e8-ee97-4186-9a36-d7a4375a3b5e/volumes"
Jul 15 20:25:53.942221 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.942185    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"]
Jul 15 20:25:53.942842 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.942721    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9212d3e8-ee97-4186-9a36-d7a4375a3b5e" containerName="main"
Jul 15 20:25:53.942842 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.942736    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9212d3e8-ee97-4186-9a36-d7a4375a3b5e" containerName="main"
Jul 15 20:25:53.942842 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.942821    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9212d3e8-ee97-4186-9a36-d7a4375a3b5e" containerName="main"
Jul 15 20:25:53.946042 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.946022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:53.948634 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.948612    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"kube-root-ca.crt\""
Jul 15 20:25:53.949498 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.949479    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"default-dockercfg-f6mtf\""
Jul 15 20:25:53.949600 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.949481    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"openshift-service-ca.crt\""
Jul 15 20:25:53.949600 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.949487    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3ada3b\"/\"rate-test-model-3ada3b-kserve-self-signed-certs\""
Jul 15 20:25:53.959748 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:53.959722    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"]
Jul 15 20:25:54.026600 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.026563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tmp-dir\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.026783 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.026610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxz9q\" (UniqueName: \"kubernetes.io/projected/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-kube-api-access-wxz9q\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.026783 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.026637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tls-certs\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.026783 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.026660    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-dshm\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.026783 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.026680    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-home\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.026783 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.026749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-model-cache\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128391 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128336    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-dshm\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128573 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-home\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128573 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-model-cache\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128573 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tmp-dir\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128739 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxz9q\" (UniqueName: \"kubernetes.io/projected/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-kube-api-access-wxz9q\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128739 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tls-certs\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128873 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128843    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-home\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128934 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128912    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-model-cache\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.128997 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.128978    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tmp-dir\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.130565 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.130543    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-dshm\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.130976 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.130959    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tls-certs\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.137928 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.137909    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxz9q\" (UniqueName: \"kubernetes.io/projected/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-kube-api-access-wxz9q\") pod \"rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") " pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.255908 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.255818    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:25:54.394727 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.394698    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"]
Jul 15 20:25:54.397345 ip-10-0-128-48 kubenswrapper[2576]: W0715 20:25:54.397317    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda24c6b9c_1b6b_48e3_95e5_17e534e40aa8.slice/crio-fd464d026963e555bd8b9e56e8f5b7a6752d629b078821952fde816519639257 WatchSource:0}: Error finding container fd464d026963e555bd8b9e56e8f5b7a6752d629b078821952fde816519639257: Status 404 returned error can't find the container with id fd464d026963e555bd8b9e56e8f5b7a6752d629b078821952fde816519639257
Jul 15 20:25:54.581178 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.581132    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5" event={"ID":"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8","Type":"ContainerStarted","Data":"96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05"}
Jul 15 20:25:54.581358 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.581202    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5" event={"ID":"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8","Type":"ContainerStarted","Data":"fd464d026963e555bd8b9e56e8f5b7a6752d629b078821952fde816519639257"}
Jul 15 20:25:54.601434 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:25:54.601386    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5" podStartSLOduration=1.60136939 podStartE2EDuration="1.60136939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:25:54.599816188 +0000 UTC m=+2855.681010551" watchObservedRunningTime="2026-07-15 20:25:54.60136939 +0000 UTC m=+2855.682563750"
Jul 15 20:26:04.256656 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:26:04.256619    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:26:04.257029 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:26:04.256669    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:26:04.269353 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:26:04.269329    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:26:04.643432 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:26:04.643403    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:27:05.987632 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:05.987595    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"]
Jul 15 20:27:21.008253 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.008211    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5" podUID="a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" containerName="main" containerID="cri-o://96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05" gracePeriod=45
Jul 15 20:27:21.260827 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.260763    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:27:21.422607 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.422570    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-home\") pod \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") "
Jul 15 20:27:21.422607 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.422609    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tls-certs\") pod \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") "
Jul 15 20:27:21.422824 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.422660    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxz9q\" (UniqueName: \"kubernetes.io/projected/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-kube-api-access-wxz9q\") pod \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") "
Jul 15 20:27:21.422824 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.422690    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-dshm\") pod \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") "
Jul 15 20:27:21.422824 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.422774    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-model-cache\") pod \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") "
Jul 15 20:27:21.422824 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.422805    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tmp-dir\") pod \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\" (UID: \"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8\") "
Jul 15 20:27:21.422994 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.422887    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-home" (OuterVolumeSpecName: "home") pod "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" (UID: "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:27:21.423079 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.423049    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-model-cache" (OuterVolumeSpecName: "model-cache") pod "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" (UID: "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:27:21.423149 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.423082    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" (UID: "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:27:21.423500 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.423321    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-model-cache\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:27:21.423500 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.423347    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tmp-dir\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:27:21.423500 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.423359    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-home\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:27:21.425076 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.425053    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" (UID: "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:27:21.425327 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.425308    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-dshm" (OuterVolumeSpecName: "dshm") pod "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" (UID: "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:27:21.425395 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.425313    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-kube-api-access-wxz9q" (OuterVolumeSpecName: "kube-api-access-wxz9q") pod "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" (UID: "a24c6b9c-1b6b-48e3-95e5-17e534e40aa8"). InnerVolumeSpecName "kube-api-access-wxz9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:27:21.524530 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.524441    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-tls-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:27:21.524530 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.524473    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxz9q\" (UniqueName: \"kubernetes.io/projected/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-kube-api-access-wxz9q\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:27:21.524530 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:21.524482    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8-dshm\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:27:22.036291 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.036258    2576 generic.go:356] "Generic (PLEG): container finished" podID="a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" containerID="96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05" exitCode=0
Jul 15 20:27:22.036736 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.036301    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"
Jul 15 20:27:22.036736 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.036336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5" event={"ID":"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8","Type":"ContainerDied","Data":"96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05"}
Jul 15 20:27:22.036736 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.036377    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5" event={"ID":"a24c6b9c-1b6b-48e3-95e5-17e534e40aa8","Type":"ContainerDied","Data":"fd464d026963e555bd8b9e56e8f5b7a6752d629b078821952fde816519639257"}
Jul 15 20:27:22.036736 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.036397    2576 scope.go:117] "RemoveContainer" containerID="96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05"
Jul 15 20:27:22.045874 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.045858    2576 scope.go:117] "RemoveContainer" containerID="96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05"
Jul 15 20:27:22.046127 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:27:22.046108    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05\": container with ID starting with 96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05 not found: ID does not exist" containerID="96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05"
Jul 15 20:27:22.046229 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.046135    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05"} err="failed to get container status \"96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05\": rpc error: code = NotFound desc = could not find container \"96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05\": container with ID starting with 96544a4ff305e8e000e5b9bf8ef0c91fbb55e6fef499242308c3cb4f6a619a05 not found: ID does not exist"
Jul 15 20:27:22.058889 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.058860    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"]
Jul 15 20:27:22.063674 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:22.063649    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3ada3b/rate-test-model-3ada3b-kserve-5b7ff46587-gdvr5"]
Jul 15 20:27:23.333582 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:27:23.333548    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" path="/var/lib/kubelet/pods/a24c6b9c-1b6b-48e3-95e5-17e534e40aa8/volumes"
Jul 15 20:28:18.255004 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:18.254918    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"]
Jul 15 20:28:18.255551 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:18.255219    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy" containerID="cri-o://513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb" gracePeriod=30
Jul 15 20:28:18.910281 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:18.910244    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9c6cd5bcb-4bzlv_2652f5a8-2ebf-45ae-9400-767f8629da2f/authorino/0.log"
Jul 15 20:28:23.521245 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.521181    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:28:23.634134 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634100    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-istio-token\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634134 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634141    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a79249-8343-44eb-8475-09db94b9f165-istiod-ca-cert\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634396 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634181    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-envoy\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634396 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634209    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-data\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634396 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634238    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-credential-socket\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634396 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634299    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-socket\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634396 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634336    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a79249-8343-44eb-8475-09db94b9f165-istio-podinfo\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634636 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634397    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d45xg\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-kube-api-access-d45xg\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634636 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634426    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-certs\") pod \"f9a79249-8343-44eb-8475-09db94b9f165\" (UID: \"f9a79249-8343-44eb-8475-09db94b9f165\") "
Jul 15 20:28:23.634739 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634660    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:28:23.634830 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634809    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-credential-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:23.634890 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634669    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:28:23.634949 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.634921    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:28:23.635146 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.635114    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:28:23.635300 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.635144    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9a79249-8343-44eb-8475-09db94b9f165-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:28:23.636523 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.636493    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:28:23.636630 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.636530    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:28:23.636630 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.636553    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9a79249-8343-44eb-8475-09db94b9f165-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 15 20:28:23.636918 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.636898    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-kube-api-access-d45xg" (OuterVolumeSpecName: "kube-api-access-d45xg") pod "f9a79249-8343-44eb-8475-09db94b9f165" (UID: "f9a79249-8343-44eb-8475-09db94b9f165"). InnerVolumeSpecName "kube-api-access-d45xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:28:23.735552 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.735513    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-istio-token\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:23.735552 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.735546    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9a79249-8343-44eb-8475-09db94b9f165-istiod-ca-cert\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:23.735552 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.735560    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-envoy\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:23.735821 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.735571    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-istio-data\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:23.735821 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.735582    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-socket\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:23.735821 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.735593    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9a79249-8343-44eb-8475-09db94b9f165-istio-podinfo\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:23.735821 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.735604    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d45xg\" (UniqueName: \"kubernetes.io/projected/f9a79249-8343-44eb-8475-09db94b9f165-kube-api-access-d45xg\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:23.735821 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:23.735616    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9a79249-8343-44eb-8475-09db94b9f165-workload-certs\") on node \"ip-10-0-128-48.ec2.internal\" DevicePath \"\""
Jul 15 20:28:24.199954 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.199923    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-px9mh_5a95a6d4-6127-448b-99b4-b8c080b0b955/manager/0.log"
Jul 15 20:28:24.355455 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.355420    2576 generic.go:356] "Generic (PLEG): container finished" podID="f9a79249-8343-44eb-8475-09db94b9f165" containerID="513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb" exitCode=0
Jul 15 20:28:24.355622 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.355473    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"
Jul 15 20:28:24.355622 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.355507    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" event={"ID":"f9a79249-8343-44eb-8475-09db94b9f165","Type":"ContainerDied","Data":"513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb"}
Jul 15 20:28:24.355622 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.355570    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q" event={"ID":"f9a79249-8343-44eb-8475-09db94b9f165","Type":"ContainerDied","Data":"a9f3f5ffed36b9ed35e53a4091c4b182ddd6233413cf08ecfe7ba0197636fd21"}
Jul 15 20:28:24.355622 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.355595    2576 scope.go:117] "RemoveContainer" containerID="513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb"
Jul 15 20:28:24.365641 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.365622    2576 scope.go:117] "RemoveContainer" containerID="8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698"
Jul 15 20:28:24.374464 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.374306    2576 scope.go:117] "RemoveContainer" containerID="513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb"
Jul 15 20:28:24.374599 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:28:24.374577    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb\": container with ID starting with 513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb not found: ID does not exist" containerID="513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb"
Jul 15 20:28:24.374641 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.374612    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb"} err="failed to get container status \"513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb\": rpc error: code = NotFound desc = could not find container \"513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb\": container with ID starting with 513ead4cd8f8fd3375761fd4b6188940cbaa98bf6e3b53ff1b8ade93565f6ddb not found: ID does not exist"
Jul 15 20:28:24.374641 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.374634    2576 scope.go:117] "RemoveContainer" containerID="8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698"
Jul 15 20:28:24.374864 ip-10-0-128-48 kubenswrapper[2576]: E0715 20:28:24.374848    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698\": container with ID starting with 8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698 not found: ID does not exist" containerID="8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698"
Jul 15 20:28:24.374910 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.374873    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698"} err="failed to get container status \"8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698\": rpc error: code = NotFound desc = could not find container \"8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698\": container with ID starting with 8dfac25eefc6719c5f3e7d51348f594a7fca43b0a5f673875b98ba16ef4e4698 not found: ID does not exist"
Jul 15 20:28:24.382908 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.382881    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"]
Jul 15 20:28:24.388864 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.388840    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-54098e-openshift-default-d58b98d4c-89r9q"]
Jul 15 20:28:24.435382 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.435350    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-648dfbd599-4s2dr_b8c570ad-0ab5-4495-8055-35319e99d9b8/manager/0.log"
Jul 15 20:28:24.555550 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.555529    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cdlpv_148062f5-fb58-469d-a289-1499c829d2d9/server/0.log"
Jul 15 20:28:24.677248 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:24.677211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l52dk_3bfe5307-67ec-461e-8256-796db969aec3/manager/0.log"
Jul 15 20:28:25.096949 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:25.096920    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p_81641268-c6a7-40b9-8194-c7fe47f43542/copy-manifests/0.log"
Jul 15 20:28:25.120768 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:25.120730    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p_81641268-c6a7-40b9-8194-c7fe47f43542/manager/0.log"
Jul 15 20:28:25.332434 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:25.332405    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a79249-8343-44eb-8475-09db94b9f165" path="/var/lib/kubelet/pods/f9a79249-8343-44eb-8475-09db94b9f165/volumes"
Jul 15 20:28:25.491865 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:25.491784    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-57888f7c6b-v6vs2_308507a5-38a4-4a7d-89aa-83228a346e23/maas-api/0.log"
Jul 15 20:28:27.211795 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:27.211766    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-tshmv_aa4b6bc6-5c96-4be8-bf4c-332a7eae4ace/postgres/0.log"
Jul 15 20:28:28.551596 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:28.551566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9c6cd5bcb-4bzlv_2652f5a8-2ebf-45ae-9400-767f8629da2f/authorino/0.log"
Jul 15 20:28:28.673725 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:28.673699    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ksq4h_310096d2-6388-4254-90c1-9b29465a024b/manager/0.log"
Jul 15 20:28:28.786682 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:28.786635    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2wnc6_78e09e43-7b90-44ee-8e4f-a9ae234aa580/manager/0.log"
Jul 15 20:28:28.896032 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:28.896002    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9tkz9_cc84284e-4c30-491d-b730-18dbb2b8b2a0/kuadrant-console-plugin/0.log"
Jul 15 20:28:29.010012 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:29.009978    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rwtvq_73cee52f-a093-41d2-bcdd-172ae098d242/registry-server/0.log"
Jul 15 20:28:29.359670 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:29.359640    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vlg7h_21f9fee5-2047-477b-8878-b70cfd73a5e1/manager/0.log"
Jul 15 20:28:29.728609 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:29.728530    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d65f7_30814c3c-a750-40fd-b94b-f6105b6054a3/istio-proxy/0.log"
Jul 15 20:28:30.066518 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:30.066491    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fd996b5bf-92brs_3078edef-a1c5-4581-9a02-dfebf9d94aed/kube-auth-proxy/0.log"
Jul 15 20:28:30.179814 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:30.179786    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8bcgk_20ceeb54-89d4-4e26-838c-fe431b9df03a/istio-proxy/1.log"
Jul 15 20:28:30.292666 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:30.292619    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-847lq_58bac0cd-b41d-4eda-836d-828f933c7b51/payload-pre-processing/0.log"
Jul 15 20:28:30.427206 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:30.427119    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-82s4t_5e0dd8ab-6b05-4bed-ae4e-75659eb593ec/payload-processing/0.log"
Jul 15 20:28:30.881012 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:30.880974    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-7wv8j_040a0645-c22d-42f3-9cc4-4bbf1a2983c7/main/0.log"
Jul 15 20:28:31.220084 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:31.219998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db97n86_fc938da9-e7c7-4a19-af7d-4ae801694fe8/main/0.log"
Jul 15 20:28:40.484409 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:40.484379    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fmcqm_0af40cba-63c1-44af-929b-cccdcdeb732d/global-pull-secret-syncer/0.log"
Jul 15 20:28:40.737264 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:40.737158    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rkkl8_c220f879-813d-4809-8415-17c99b43300c/konnectivity-agent/0.log"
Jul 15 20:28:40.759040 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:40.759007    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-48.ec2.internal_fc266b970294ca7e6b02e58f7dfbfaf7/haproxy/0.log"
Jul 15 20:28:45.950026 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:45.949977    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9c6cd5bcb-4bzlv_2652f5a8-2ebf-45ae-9400-767f8629da2f/authorino/0.log"
Jul 15 20:28:45.993911 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:45.993883    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ksq4h_310096d2-6388-4254-90c1-9b29465a024b/manager/0.log"
Jul 15 20:28:46.039681 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:46.039649    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2wnc6_78e09e43-7b90-44ee-8e4f-a9ae234aa580/manager/0.log"
Jul 15 20:28:46.098492 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:46.098466    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9tkz9_cc84284e-4c30-491d-b730-18dbb2b8b2a0/kuadrant-console-plugin/0.log"
Jul 15 20:28:46.189831 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:46.189805    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rwtvq_73cee52f-a093-41d2-bcdd-172ae098d242/registry-server/0.log"
Jul 15 20:28:46.496630 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:46.496590    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vlg7h_21f9fee5-2047-477b-8878-b70cfd73a5e1/manager/0.log"
Jul 15 20:28:48.193509 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.193480    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a13be694-e5a9-44e0-8521-a0ab8ae6b7da/alertmanager/0.log"
Jul 15 20:28:48.230891 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.230835    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a13be694-e5a9-44e0-8521-a0ab8ae6b7da/config-reloader/0.log"
Jul 15 20:28:48.266429 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.266402    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a13be694-e5a9-44e0-8521-a0ab8ae6b7da/kube-rbac-proxy-web/0.log"
Jul 15 20:28:48.290491 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.290456    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a13be694-e5a9-44e0-8521-a0ab8ae6b7da/kube-rbac-proxy/0.log"
Jul 15 20:28:48.313553 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.313525    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a13be694-e5a9-44e0-8521-a0ab8ae6b7da/kube-rbac-proxy-metric/0.log"
Jul 15 20:28:48.336698 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.336666    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a13be694-e5a9-44e0-8521-a0ab8ae6b7da/prom-label-proxy/0.log"
Jul 15 20:28:48.360384 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.360360    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a13be694-e5a9-44e0-8521-a0ab8ae6b7da/init-config-reloader/0.log"
Jul 15 20:28:48.731416 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.731387    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p8drt_81f0582a-05fe-439c-a3d1-2081f0d5903d/node-exporter/0.log"
Jul 15 20:28:48.753320 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.753297    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p8drt_81f0582a-05fe-439c-a3d1-2081f0d5903d/kube-rbac-proxy/0.log"
Jul 15 20:28:48.776029 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:48.776004    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-p8drt_81f0582a-05fe-439c-a3d1-2081f0d5903d/init-textfile/0.log"
Jul 15 20:28:49.150867 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.150842    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b58984df-hsxlx_fc3746ab-f186-4138-aeb8-f534bb06d94b/telemeter-client/0.log"
Jul 15 20:28:49.172611 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.172588    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b58984df-hsxlx_fc3746ab-f186-4138-aeb8-f534bb06d94b/reload/0.log"
Jul 15 20:28:49.198912 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.198885    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-86b58984df-hsxlx_fc3746ab-f186-4138-aeb8-f534bb06d94b/kube-rbac-proxy/0.log"
Jul 15 20:28:49.238331 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.238302    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b587786-vn2tz_18e832cb-56b4-4bd8-af4e-6125616b76f4/thanos-query/0.log"
Jul 15 20:28:49.259804 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.259777    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b587786-vn2tz_18e832cb-56b4-4bd8-af4e-6125616b76f4/kube-rbac-proxy-web/0.log"
Jul 15 20:28:49.282537 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.282503    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b587786-vn2tz_18e832cb-56b4-4bd8-af4e-6125616b76f4/kube-rbac-proxy/0.log"
Jul 15 20:28:49.314640 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.314611    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b587786-vn2tz_18e832cb-56b4-4bd8-af4e-6125616b76f4/prom-label-proxy/0.log"
Jul 15 20:28:49.336428 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.336407    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b587786-vn2tz_18e832cb-56b4-4bd8-af4e-6125616b76f4/kube-rbac-proxy-rules/0.log"
Jul 15 20:28:49.357940 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:49.357918    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59b587786-vn2tz_18e832cb-56b4-4bd8-af4e-6125616b76f4/kube-rbac-proxy-metrics/0.log"
Jul 15 20:28:50.268926 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.268894    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"]
Jul 15 20:28:50.269379 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.269322    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy"
Jul 15 20:28:50.269379 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.269334    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy"
Jul 15 20:28:50.269379 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.269359    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" containerName="main"
Jul 15 20:28:50.269379 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.269364    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" containerName="main"
Jul 15 20:28:50.269513 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.269431    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24c6b9c-1b6b-48e3-95e5-17e534e40aa8" containerName="main"
Jul 15 20:28:50.269513 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.269442    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy"
Jul 15 20:28:50.269513 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.269449    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a79249-8343-44eb-8475-09db94b9f165" containerName="istio-proxy"
Jul 15 20:28:50.272801 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.272784    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.275295 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.275273    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8sl5g\"/\"default-dockercfg-8lcv6\""
Jul 15 20:28:50.275410 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.275394    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8sl5g\"/\"kube-root-ca.crt\""
Jul 15 20:28:50.276253 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.276236    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8sl5g\"/\"openshift-service-ca.crt\""
Jul 15 20:28:50.281259 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.281237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"]
Jul 15 20:28:50.390392 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.390353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-podres\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.390392 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.390391    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-proc\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.390618 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.390413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-lib-modules\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.390618 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.390470    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc2t6\" (UniqueName: \"kubernetes.io/projected/9044b510-109b-4016-b4f8-67b5329e6ef7-kube-api-access-jc2t6\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.390618 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.390547    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-sys\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491636 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-podres\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491636 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-proc\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491880 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-lib-modules\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491880 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc2t6\" (UniqueName: \"kubernetes.io/projected/9044b510-109b-4016-b4f8-67b5329e6ef7-kube-api-access-jc2t6\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491880 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-sys\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491880 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-podres\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491880 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-proc\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491880 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491819    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-lib-modules\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.491880 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.491814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9044b510-109b-4016-b4f8-67b5329e6ef7-sys\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.500340 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.500314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc2t6\" (UniqueName: \"kubernetes.io/projected/9044b510-109b-4016-b4f8-67b5329e6ef7-kube-api-access-jc2t6\") pod \"perf-node-gather-daemonset-6c99c\" (UID: \"9044b510-109b-4016-b4f8-67b5329e6ef7\") " pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.584043 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.584009    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:50.727931 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:50.727905    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"]
Jul 15 20:28:50.729767 ip-10-0-128-48 kubenswrapper[2576]: W0715 20:28:50.729743    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9044b510_109b_4016_b4f8_67b5329e6ef7.slice/crio-e9aa892a59a5659b558eab8c60a22793d50ac3de05f4d5f2139343248515d0b2 WatchSource:0}: Error finding container e9aa892a59a5659b558eab8c60a22793d50ac3de05f4d5f2139343248515d0b2: Status 404 returned error can't find the container with id e9aa892a59a5659b558eab8c60a22793d50ac3de05f4d5f2139343248515d0b2
Jul 15 20:28:51.494499 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:51.494469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c" event={"ID":"9044b510-109b-4016-b4f8-67b5329e6ef7","Type":"ContainerStarted","Data":"d7896a75080ba78a3a5fa19f9e91259b5d40891cbb60a1f1314a2dfce84fdaf1"}
Jul 15 20:28:51.494896 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:51.494526    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c" event={"ID":"9044b510-109b-4016-b4f8-67b5329e6ef7","Type":"ContainerStarted","Data":"e9aa892a59a5659b558eab8c60a22793d50ac3de05f4d5f2139343248515d0b2"}
Jul 15 20:28:51.494896 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:51.494568    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:51.510885 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:51.510826    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c" podStartSLOduration=1.5108073499999999 podStartE2EDuration="1.51080735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:28:51.509525814 +0000 UTC m=+3032.590720196" watchObservedRunningTime="2026-07-15 20:28:51.51080735 +0000 UTC m=+3032.592001711"
Jul 15 20:28:51.624365 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:51.624334    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6cb79bcc77-7x9gm_d9a90616-ab68-4911-b381-8a356fd979e0/console/0.log"
Jul 15 20:28:51.665373 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:51.665344    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-wpxdd_1260b666-810e-4d01-8fa3-a6eb043af249/download-server/0.log"
Jul 15 20:28:53.265466 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:53.265426    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vtsr_67fc290d-d259-4697-b316-63f352ccfe05/dns/0.log"
Jul 15 20:28:53.289841 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:53.289811    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vtsr_67fc290d-d259-4697-b316-63f352ccfe05/kube-rbac-proxy/0.log"
Jul 15 20:28:53.412340 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:53.412314    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-brbhw_e5953ff9-c877-41a2-877f-e74120fa7580/dns-node-resolver/0.log"
Jul 15 20:28:54.021348 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:54.021308    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7b69fc78bd-58gq7_00c089b1-d001-4b70-a79a-c5d1d68b7cb3/registry/0.log"
Jul 15 20:28:54.092556 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:54.092528    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-shvrr_e235c3ae-a21d-41b6-a3aa-729a0849eb4b/node-ca/0.log"
Jul 15 20:28:55.107317 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:55.107291    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d65f7_30814c3c-a750-40fd-b94b-f6105b6054a3/istio-proxy/0.log"
Jul 15 20:28:55.274180 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:55.274139    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fd996b5bf-92brs_3078edef-a1c5-4581-9a02-dfebf9d94aed/kube-auth-proxy/0.log"
Jul 15 20:28:55.308177 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:55.308143    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8bcgk_20ceeb54-89d4-4e26-838c-fe431b9df03a/istio-proxy/0.log"
Jul 15 20:28:55.339486 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:55.339459    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8bcgk_20ceeb54-89d4-4e26-838c-fe431b9df03a/istio-proxy/1.log"
Jul 15 20:28:55.369100 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:55.369016    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-847lq_58bac0cd-b41d-4eda-836d-828f933c7b51/payload-pre-processing/0.log"
Jul 15 20:28:55.404459 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:55.404427    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-82s4t_5e0dd8ab-6b05-4bed-ae4e-75659eb593ec/payload-processing/0.log"
Jul 15 20:28:56.154499 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:56.154472    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dds4_a272420b-2a9c-469e-ab0b-17788c1782ff/serve-healthcheck-canary/0.log"
Jul 15 20:28:56.914832 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:56.914798    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ss47p_800dff05-96b8-4243-85ac-6305f7e82630/kube-rbac-proxy/0.log"
Jul 15 20:28:56.956737 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:56.956709    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ss47p_800dff05-96b8-4243-85ac-6305f7e82630/exporter/0.log"
Jul 15 20:28:56.980451 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:56.980427    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ss47p_800dff05-96b8-4243-85ac-6305f7e82630/extractor/0.log"
Jul 15 20:28:57.517357 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:57.517330    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8sl5g/perf-node-gather-daemonset-6c99c"
Jul 15 20:28:59.250056 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:59.250024    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-px9mh_5a95a6d4-6127-448b-99b4-b8c080b0b955/manager/0.log"
Jul 15 20:28:59.548396 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:59.548352    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-648dfbd599-4s2dr_b8c570ad-0ab5-4495-8055-35319e99d9b8/manager/0.log"
Jul 15 20:28:59.575923 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:59.575897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cdlpv_148062f5-fb58-469d-a289-1499c829d2d9/server/0.log"
Jul 15 20:28:59.652638 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:59.652604    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l52dk_3bfe5307-67ec-461e-8256-796db969aec3/manager/0.log"
Jul 15 20:28:59.938851 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:59.938818    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p_81641268-c6a7-40b9-8194-c7fe47f43542/manager/0.log"
Jul 15 20:28:59.977459 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:28:59.977431    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c8f5fdd94-wkz9p_81641268-c6a7-40b9-8194-c7fe47f43542/copy-manifests/0.log"
Jul 15 20:29:00.939375 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:00.939285    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d65f7_30814c3c-a750-40fd-b94b-f6105b6054a3/istio-proxy/0.log"
Jul 15 20:29:01.081905 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:01.081875    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fd996b5bf-92brs_3078edef-a1c5-4581-9a02-dfebf9d94aed/kube-auth-proxy/0.log"
Jul 15 20:29:01.101311 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:01.101290    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8bcgk_20ceeb54-89d4-4e26-838c-fe431b9df03a/istio-proxy/0.log"
Jul 15 20:29:01.127773 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:01.127747    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8bcgk_20ceeb54-89d4-4e26-838c-fe431b9df03a/istio-proxy/1.log"
Jul 15 20:29:01.150398 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:01.150371    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-847lq_58bac0cd-b41d-4eda-836d-828f933c7b51/payload-pre-processing/0.log"
Jul 15 20:29:01.172097 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:01.172071    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-82s4t_5e0dd8ab-6b05-4bed-ae4e-75659eb593ec/payload-processing/0.log"
Jul 15 20:29:02.453918 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:02.453880    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d65f7_30814c3c-a750-40fd-b94b-f6105b6054a3/istio-proxy/0.log"
Jul 15 20:29:02.586572 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:02.586475    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5fd996b5bf-92brs_3078edef-a1c5-4581-9a02-dfebf9d94aed/kube-auth-proxy/0.log"
Jul 15 20:29:02.606040 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:02.606017    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8bcgk_20ceeb54-89d4-4e26-838c-fe431b9df03a/istio-proxy/0.log"
Jul 15 20:29:02.637973 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:02.637940    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-8bcgk_20ceeb54-89d4-4e26-838c-fe431b9df03a/istio-proxy/1.log"
Jul 15 20:29:02.657811 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:02.657773    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-847lq_58bac0cd-b41d-4eda-836d-828f933c7b51/payload-pre-processing/0.log"
Jul 15 20:29:02.680562 ip-10-0-128-48 kubenswrapper[2576]: I0715 20:29:02.680533    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-82s4t_5e0dd8ab-6b05-4bed-ae4e-75659eb593ec/payload-processing/0.log"