Jul 21 06:15:58.385491 ip-10-0-128-56 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 06:15:58.385504 ip-10-0-128-56 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 06:15:58.385514 ip-10-0-128-56 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 06:15:58.385822 ip-10-0-128-56 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 06:16:08.592505 ip-10-0-128-56 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 06:16:08.592520 ip-10-0-128-56 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3cc1f086dc684fc6bf975b100ad98438 --
Jul 21 06:17:43.059813 ip-10-0-128-56 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 06:17:43.519522 ip-10-0-128-56 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 06:17:43.519522 ip-10-0-128-56 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 06:17:43.519522 ip-10-0-128-56 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 06:17:43.519522 ip-10-0-128-56 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 06:17:43.520147 ip-10-0-128-56 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 06:17:43.520647 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.520493    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 06:17:43.526781 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526762    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 06:17:43.526781 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526778    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 06:17:43.526781 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526782    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 06:17:43.526781 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526785    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 06:17:43.526781 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526790    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526793    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526796    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526799    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526802    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526805    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526808    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526811    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526814    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526816    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526819    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526822    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526824    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526827    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526829    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526832    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526834    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526837    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526839    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526846    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 06:17:43.526969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526848    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526851    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526854    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526856    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526859    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526861    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526864    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526866    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526869    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526871    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526873    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526876    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526878    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526881    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526884    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526887    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526890    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526893    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526896    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526898    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 06:17:43.527490 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526901    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526903    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526906    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526908    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526911    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526913    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526915    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526918    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526920    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526923    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526925    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526928    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526930    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526933    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526935    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526938    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526940    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526943    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526945    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526947    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 06:17:43.527987 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526951    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526955    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526960    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526963    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526965    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526968    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526971    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526974    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526976    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526980    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526984    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526986    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526990    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526993    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526996    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.526999    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527002    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527005    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527008    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 06:17:43.528462 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527012    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527015    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527017    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527020    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527022    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527024    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527027    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527029    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527032    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527034    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527037    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527040    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527042    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527045    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527047    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527050    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527753    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527760    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527762    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 06:17:43.528979 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527765    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527768    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527771    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527773    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527776    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527778    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527781    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527784    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527786    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527789    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527791    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527794    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527796    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527798    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527801    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527804    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527807    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527809    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527811    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527814    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 06:17:43.529427 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527816    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527819    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527822    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527824    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527827    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527829    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527832    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527836    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527840    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527842    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527845    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527847    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527850    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527852    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527854    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527858    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527860    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527863    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527865    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527867    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 06:17:43.529969 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527870    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527872    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527875    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527877    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527879    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527882    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527884    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527887    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527889    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527892    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527894    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527897    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527899    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527902    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527905    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527907    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527910    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527912    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527916    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527918    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 06:17:43.530468 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527921    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527924    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527926    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527929    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527933    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527936    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527939    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527942    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527945    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527948    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527951    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527954    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527956    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527959    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527962    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527964    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527967    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527969    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527971    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 06:17:43.530970 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527974    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527976    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527979    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527982    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527986    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527988    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527994    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527996    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.527999    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528002    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528004    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528007    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528010    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528015    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528017    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528020    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528023    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528380    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528384    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528387    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 06:17:43.531435 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528389    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528392    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528394    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528397    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528399    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528402    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528404    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528407    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528409    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528413    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528417    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528420    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528423    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528427    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528429    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528432    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528435    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528437    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528442    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528444    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 06:17:43.532025 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528447    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528449    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528452    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528455    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528457    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528461    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528464    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528467    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528469    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528472    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528475    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528477    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528480    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528482    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528484    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528487    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528491    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528494    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528496    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 06:17:43.532502 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528499    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528502    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528504    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528506    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528509    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528511    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528514    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528517    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528519    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528522    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528524    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528528    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528545    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528548    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528551    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528553    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528557    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528560    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528564    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528568    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 06:17:43.533021 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528571    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528574    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528577    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528580    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528582    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528585    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528588    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528590    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528593    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528596    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528599    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528601    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528604    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528606    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528609    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528612    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528614    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528616    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528619    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528621    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 06:17:43.533511 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528625    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528627    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528629    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528633    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528636    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528638    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528641    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528643    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528645    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528648    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528651    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528654    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528656    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528659    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528661    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528663    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.528666    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528737    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528744    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528750    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528754    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 06:17:43.534008 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528758    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528761    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528765    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528768    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528771    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528774    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528777    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528780    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528783    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528786    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528789    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528792    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528795    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528798    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528803    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528806    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528809    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528812    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528816    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528819    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528822    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528826    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528829    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528832    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 06:17:43.534507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528835    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528846    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528850    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528853    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528857    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528860    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528862    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528865    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528868    2577 flags.go:64] FLAG: --enable-server="true"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528871    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528875    2577 flags.go:64] FLAG: --event-burst="100"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528878    2577 flags.go:64] FLAG: --event-qps="50"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528881    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528883    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528886    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528890    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528892    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528895    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528898    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528901    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528904    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528907    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528911    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528914    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528916    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 06:17:43.535117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528919    2577 flags.go:64] FLAG: --feature-gates=""
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528923    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528925    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528928    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528932    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528935    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528938    2577 flags.go:64] FLAG: --help="false"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528941    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528944    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528947    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528949    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528953    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528956    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528958    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528961    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528964    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528967    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528969    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528972    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528975    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528978    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528981    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528984    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528986    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 06:17:43.535780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528989    2577 flags.go:64] FLAG: --lock-file=""
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528993    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528995    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.528998    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529003    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529007    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529010    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529012    2577 flags.go:64] FLAG: --logging-format="text"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529015    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529018    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529021    2577 flags.go:64] FLAG: --manifest-url=""
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529023    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529028    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529031    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529034    2577 flags.go:64] FLAG: --max-pods="110"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529037    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529040    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529042    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529045    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529048    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529050    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529053    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529060    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529063    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529066    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 06:17:43.536358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529069    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529071    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529077    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529079    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529082    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529085    2577 flags.go:64] FLAG: --port="10250"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529088    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529091    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-087f56ff1f2ff3040"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529094    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529097    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529100    2577 flags.go:64] FLAG: --register-node="true"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529102    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529106    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529109    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529111    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529114    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529117    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529120    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529123    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529126    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529129    2577 flags.go:64] FLAG: --runonce="false"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529131    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529134    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529137    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529140    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 06:17:43.536975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529142    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529145    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529148    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529151    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529154    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529157    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529159    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529162    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529165    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529167    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529170    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529175    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529178    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529181    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529185    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529187    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529190    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529193    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529195    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529198    2577 flags.go:64] FLAG: --v="2"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529202    2577 flags.go:64] FLAG: --version="false"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529206    2577 flags.go:64] FLAG: --vmodule=""
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529210    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529213    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 06:17:43.537605 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529324    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529327    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529332    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529336    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529339    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529342    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529345    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529347    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529350    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529353    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529355    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529358    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529362    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529365    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529367    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529370    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529372    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529375    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529378    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 06:17:43.538180 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529380    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529383    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529385    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529387    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529390    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529392    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529394    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529397    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529399    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529402    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529404    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529407    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529409    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529412    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529416    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529419    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529422    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529425    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529428    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 06:17:43.538659 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529431    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529434    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529437    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529440    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529443    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529445    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529448    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529450    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529453    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529455    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529458    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529460    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529463    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529466    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529468    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529471    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529473    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529475    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529478    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529480    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529483    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 06:17:43.539152 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529485    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529489    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529491    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529493    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529496    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529499    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529501    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529503    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529506    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529509    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529511    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529514    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529516    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529519    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529521    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529523    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529526    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529528    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529544    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 06:17:43.539680 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529547    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529549    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529552    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529554    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529557    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529560    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529562    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529565    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529567    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529570    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529572    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529574    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529577    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529579    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529584    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529586    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529589    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529591    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529597    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529600    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 06:17:43.540145 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.529602    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.529608    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.536484    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.536498    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.536511    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.536517    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536590    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536596    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536599    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536602    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536605    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536609    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536613    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536616    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 06:17:43.540634 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536619    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536621    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536623    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536626    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536628    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536631    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536634    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536636    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536638    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536641    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536644    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536646    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536648    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536651    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536653    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536656    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536658    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536661    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536663    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536666    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 06:17:43.540999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536668    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536672    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536676    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536679    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536682    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536685    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536688    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536690    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536693    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536696    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536698    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536700    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536703    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536705    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536708    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536710    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536713    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536715    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536718    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536720    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 06:17:43.541475 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536723    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536725    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536728    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536730    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536732    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536735    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536737    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536740    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536742    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536745    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536747    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536749    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536752    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536755    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536758    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536761    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536763    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536766    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536768    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536771    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 06:17:43.542101 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536773    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536775    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536778    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536780    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536782    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536785    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536787    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536790    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536792    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536795    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536797    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536800    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536802    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536805    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536807    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536809    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536812    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536814    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536816    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 06:17:43.542657 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536819    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536823    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536826    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536829    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536832    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536835    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536845    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536849    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536852    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536855    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536858    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536861    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.536866    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536974    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 06:17:43.543116 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536978    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536982    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536985    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536988    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536990    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536993    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536995    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.536998    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537000    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537002    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537005    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537007    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537009    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537012    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537014    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537016    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537019    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537021    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537024    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 06:17:43.543469 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537026    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537028    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537031    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537033    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537035    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537038    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537040    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537043    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537046    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537048    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537051    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537053    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537055    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537058    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537060    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537062    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537065    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537067    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537070    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537072    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 06:17:43.543940 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537076    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537079    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537082    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537084    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537087    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537090    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537093    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537095    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537098    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537100    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537102    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537105    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537107    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537109    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537112    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537116    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537118    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537121    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537124    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537127    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 06:17:43.544419 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537129    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537133    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537136    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537139    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537142    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537144    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537147    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537149    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537152    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537154    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537156    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537159    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537161    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537163    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537166    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537168    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537170    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537173    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537175    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537177    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 06:17:43.544920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537179    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537182    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537184    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537187    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537189    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537191    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537194    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537198    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537201    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537203    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537206    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537208    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537210    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537213    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537215    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537218    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537220    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537222    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 06:17:43.545395 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:43.537225    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 06:17:43.545913 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.537229    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 06:17:43.545913 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.537319    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 06:17:43.545913 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.539586    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 06:17:43.545913 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.541248    2577 server.go:1019] "Starting client certificate rotation"
Jul 21 06:17:43.545913 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.541350    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 06:17:43.545913 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.541421    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 06:17:43.545913 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.544178    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 06:17:43.546528 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.546515    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 06:17:43.557003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.556979    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 21 06:17:43.560877 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.560860    2577 log.go:25] "Validated CRI v1 image API"
Jul 21 06:17:43.561715 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.561699    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 06:17:43.564273 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.564251    2577 fs.go:135] Filesystem UUIDs: map[6c0267ad-e5d7-455c-a316-fa54ba7de61e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b6326ee3-bad8-44d9-85a9-ad03a810ea0e:/dev/nvme0n1p4]
Jul 21 06:17:43.564324 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.564274    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 06:17:43.568610 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.568591    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 06:17:43.570405 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.570300    2577 manager.go:216] Machine: {Timestamp:2026-07-21 06:17:43.568925338 +0000 UTC m=+0.381668999 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099780 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2126ac609798b06c1ea1b8195a1730 SystemUUID:ec2126ac-6097-98b0-6c1e-a1b8195a1730 BootID:3cc1f086-dc68-4fc6-bf97-5b100ad98438 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:43:48:3a:da:71 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:43:48:3a:da:71 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:6a:36:cc:0e:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 06:17:43.570405 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.570404    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 06:17:43.570507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.570476    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 06:17:43.574071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.574051    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 06:17:43.574201 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.574074    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-56.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 06:17:43.575709 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.575697    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 06:17:43.575709 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.575711    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 06:17:43.575774 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.575718    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 06:17:43.576431 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.576421    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 06:17:43.578390 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.578380    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 06:17:43.583076 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583066    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 06:17:43.583194 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583185    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 06:17:43.583229 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583216    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 06:17:43.583258 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583229    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 06:17:43.583258 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583243    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 06:17:43.583258 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583253    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 21 06:17:43.583344 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583262    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 06:17:43.583603 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583592    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 06:17:43.583645 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.583611    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 06:17:43.586013 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.585999    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 06:17:43.588311 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.588296    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 06:17:43.588351 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.588331    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 06:17:43.589581 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589565    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sn8th"
Jul 21 06:17:43.589784 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589773    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 06:17:43.589817 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589790    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 06:17:43.589817 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589796    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 06:17:43.589817 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589801    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 06:17:43.589817 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589808    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 06:17:43.589817 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589814    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 06:17:43.589941 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589829    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 06:17:43.589941 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589836    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 06:17:43.589941 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589843    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 06:17:43.589941 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589848    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 06:17:43.589941 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589860    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 06:17:43.589941 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.589866    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 06:17:43.590734 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.590722    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 06:17:43.590769 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.590735    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 06:17:43.594033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.594019    2577 server.go:1268] "Started kubelet"
Jul 21 06:17:43.594191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.594162    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 06:17:43.594379 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.594358    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 06:17:43.594501 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.594114    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 06:17:43.594842 ip-10-0-128-56 systemd[1]: Started Kubernetes Kubelet.
Jul 21 06:17:43.597313 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.596703    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 06:17:43.597313 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.596944    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 06:17:43.597313 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.596954    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-56.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 06:17:43.597313 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.597173    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-56.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 06:17:43.597763 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.597639    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sn8th"
Jul 21 06:17:43.599772 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.599755    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 06:17:43.599857 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.599795    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 06:17:43.601703 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.600599    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-56.ec2.internal.18c43994cc792af5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-56.ec2.internal,UID:ip-10-0-128-56.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-56.ec2.internal,},FirstTimestamp:2026-07-21 06:17:43.593994997 +0000 UTC m=+0.406738658,LastTimestamp:2026-07-21 06:17:43.593994997 +0000 UTC m=+0.406738658,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-56.ec2.internal,}"
Jul 21 06:17:43.608013 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.607946    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 06:17:43.608013 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.607951    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 06:17:43.608438 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.608294    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:43.608773 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.608755    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 06:17:43.608860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.608780    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 06:17:43.608860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.608795    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 06:17:43.608933 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.608877    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 06:17:43.608933 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.608890    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 06:17:43.610572 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.610552    2577 factory.go:55] Registering systemd factory
Jul 21 06:17:43.610572 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.610573    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 21 06:17:43.610767 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.610751    2577 factory.go:153] Registering CRI-O factory
Jul 21 06:17:43.610767 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.610766    2577 factory.go:223] Registration of the crio container factory successfully
Jul 21 06:17:43.610922 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.610813    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 06:17:43.610922 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.610831    2577 factory.go:103] Registering Raw factory
Jul 21 06:17:43.610922 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.610841    2577 manager.go:1196] Started watching for new ooms in manager
Jul 21 06:17:43.611256 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.611243    2577 manager.go:349] Starting recovery of all containers
Jul 21 06:17:43.616785 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.616729    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 06:17:43.621676 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.621648    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 06:17:43.623145 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.623129    2577 manager.go:354] Recovery completed
Jul 21 06:17:43.624208 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.624188    2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-56.ec2.internal\" not found" node="ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.627439 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.627426    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 06:17:43.629377 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.629364    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 06:17:43.629435 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.629388    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 06:17:43.629435 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.629399    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientPID"
Jul 21 06:17:43.629905 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.629890    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 06:17:43.629905 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.629903    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 06:17:43.630015 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.629919    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 06:17:43.630015 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.629940    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 06:17:43.630701 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.630685    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 06:17:43.630764 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.630716    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 06:17:43.630764 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.630730    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientPID"
Jul 21 06:17:43.632071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.632059    2577 policy_none.go:49] "None policy: Start"
Jul 21 06:17:43.632110 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.632077    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 06:17:43.632110 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.632090    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 06:17:43.634117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.634106    2577 policy_none.go:47] "Start"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.676046    2577 manager.go:337] "Starting Device Plugin manager"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.676079    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.676089    2577 server.go:87] "Starting device plugin registration server"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.676294    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.676308    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.676383    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.676453    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.676463    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.676965    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 06:17:43.688708 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.677010    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:43.707106 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.707089    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 06:17:43.707177 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.707122    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 06:17:43.707177 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.707139    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 06:17:43.707177 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.707172    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 06:17:43.709323 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.709308    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 06:17:43.777298 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.777244    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 06:17:43.777986 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.777970    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 06:17:43.778044 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.777999    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 06:17:43.778044 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.778009    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientPID"
Jul 21 06:17:43.778044 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.778028    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.783577 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.783565    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.783634 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.783583    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-56.ec2.internal\": node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:43.794822 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.794802    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:43.807835 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.807815    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal"]
Jul 21 06:17:43.807907 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.807896    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 06:17:43.809218 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.809205    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 06:17:43.809267 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.809230    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 06:17:43.809267 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.809239    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientPID"
Jul 21 06:17:43.809364 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.809351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bdc3d1b2bcbb087dc40ca7e374bc350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal\" (UID: \"3bdc3d1b2bcbb087dc40ca7e374bc350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.809397 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.809373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bdc3d1b2bcbb087dc40ca7e374bc350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal\" (UID: \"3bdc3d1b2bcbb087dc40ca7e374bc350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.811458 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.811447    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 06:17:43.811596 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.811582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.811648 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.811612    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 06:17:43.812134 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.812118    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 06:17:43.812191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.812149    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 06:17:43.812191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.812167    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 06:17:43.812191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.812180    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientPID"
Jul 21 06:17:43.812292 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.812150    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 06:17:43.812292 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.812229    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientPID"
Jul 21 06:17:43.814499 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.814483    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.814582 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.814508    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 06:17:43.815182 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.815164    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 06:17:43.815256 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.815189    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 06:17:43.815256 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.815198    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeHasSufficientPID"
Jul 21 06:17:43.836046 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.836028    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-56.ec2.internal\" not found" node="ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.840311 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.840297    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-56.ec2.internal\" not found" node="ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.895480 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.895463    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:43.910027 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.910012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bdc3d1b2bcbb087dc40ca7e374bc350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal\" (UID: \"3bdc3d1b2bcbb087dc40ca7e374bc350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.910097 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.910038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bdc3d1b2bcbb087dc40ca7e374bc350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal\" (UID: \"3bdc3d1b2bcbb087dc40ca7e374bc350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.910097 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.910067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42bd7eb63df01dcfbe6e3f5754bb93f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-56.ec2.internal\" (UID: \"42bd7eb63df01dcfbe6e3f5754bb93f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.910191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.910113    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bdc3d1b2bcbb087dc40ca7e374bc350-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal\" (UID: \"3bdc3d1b2bcbb087dc40ca7e374bc350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.910191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:43.910143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bdc3d1b2bcbb087dc40ca7e374bc350-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal\" (UID: \"3bdc3d1b2bcbb087dc40ca7e374bc350\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:43.996524 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:43.996502    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:44.010842 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.010820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42bd7eb63df01dcfbe6e3f5754bb93f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-56.ec2.internal\" (UID: \"42bd7eb63df01dcfbe6e3f5754bb93f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:44.010896 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.010859    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/42bd7eb63df01dcfbe6e3f5754bb93f6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-56.ec2.internal\" (UID: \"42bd7eb63df01dcfbe6e3f5754bb93f6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:44.097270 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.097221    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:44.138692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.138673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:44.143440 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.143295    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:44.198301 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.198268    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:44.298750 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.298728    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:44.399254 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.399191    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:44.499796 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.499764    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-56.ec2.internal\" not found"
Jul 21 06:17:44.540192 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.540173    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 06:17:44.540644 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.540307    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 06:17:44.540644 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.540358    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 06:17:44.562857 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.562839    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 06:17:44.564094 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.564078    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 06:17:44.584001 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.583977    2577 apiserver.go:52] "Watching apiserver"
Jul 21 06:17:44.593657 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.593635    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 06:17:44.593985 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.593966    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-lhqgl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc","openshift-cluster-node-tuning-operator/tuned-srvpw","openshift-dns/node-resolver-9nl56","openshift-image-registry/node-ca-9wv82","openshift-multus/multus-jjzcf","openshift-network-operator/iptables-alerter-ttpzj","kube-system/global-pull-secret-syncer-thwmp","openshift-multus/multus-additional-cni-plugins-kvbl7","openshift-multus/network-metrics-daemon-zgblg","openshift-network-diagnostics/network-check-target-t5xwf","openshift-ovn-kubernetes/ovnkube-node-rg9sr"]
Jul 21 06:17:44.596362 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.596348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:17:44.598453 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.598433    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.598711 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.598693    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9jq8w\""
Jul 21 06:17:44.598837 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.598824    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 06:17:44.598989 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.598977    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 06:17:44.601506 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.601479    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 06:17:44.601653 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.601608    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2zdfx\""
Jul 21 06:17:44.601653 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.601624    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 06:17:44.601992 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.601967    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 06:17:44.602735 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.602710    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.604243 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.604200    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 06:12:44 +0000 UTC" deadline="2028-03-24 12:32:11.115253032 +0000 UTC"
Jul 21 06:17:44.604243 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.604244    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14694h14m26.511012098s"
Jul 21 06:17:44.604902 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.604887    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 06:17:44.604959 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.604935    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p457f\""
Jul 21 06:17:44.605038 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.605021    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.605083 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.605055    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 06:17:44.607286 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.607267    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.607645 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.607576    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 06:17:44.607734 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.607666    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 06:17:44.607842 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.607826    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-khhfb\""
Jul 21 06:17:44.608885 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.608867    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 06:17:44.608949 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.608875    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:44.609502 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.609482    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.609618 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.609504    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 06:17:44.609618 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.609506    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z24dr\""
Jul 21 06:17:44.609844 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.609828    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 06:17:44.609926 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.609910    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 06:17:44.611762 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.611745    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 06:17:44.611850 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.611745    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c2w5z\""
Jul 21 06:17:44.611850 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.611797    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.611966 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.611950    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 06:17:44.612017 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.611979    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 06:17:44.612017 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.611995    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 06:17:44.614059 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614043    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.614135 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.614097    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:17:44.614225 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-cni-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.614283 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614243    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 06:17:44.614283 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-cnibin\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.614436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-k8s-cni-cncf-io\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.614436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614309    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 06:17:44.614436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysconfig\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.614436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614310    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4b9c6\""
Jul 21 06:17:44.614436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-sys\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.614436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614396    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-host\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.614436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea99fd85-6838-44e4-b591-a8f1f6489598-tmp-dir\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2872afe6-bbd2-4ff1-849b-11ca538c3a14-host\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-run\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mmd8\" (UniqueName: \"kubernetes.io/projected/ea99fd85-6838-44e4-b591-a8f1f6489598-kube-api-access-7mmd8\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2872afe6-bbd2-4ff1-849b-11ca538c3a14-serviceca\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614593    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-system-cni-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99395a70-f20e-4a73-b161-66c015c14b90-cni-binary-copy\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-socket-dir-parent\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/367e2d80-bfb6-4260-93d4-700c17a7796d-agent-certs\") pod \"konnectivity-agent-lhqgl\" (UID: \"367e2d80-bfb6-4260-93d4-700c17a7796d\") " pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614680    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-socket-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.614706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-registration-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-os-release\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-netns\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614749    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-etc-kubernetes\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/367e2d80-bfb6-4260-93d4-700c17a7796d-konnectivity-ca\") pod \"konnectivity-agent-lhqgl\" (UID: \"367e2d80-bfb6-4260-93d4-700c17a7796d\") " pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-kubernetes\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysctl-conf\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-systemd\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-var-lib-kubelet\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614905    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea99fd85-6838-44e4-b591-a8f1f6489598-hosts-file\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-cni-multus\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-kubelet\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-lib-modules\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.614992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-conf-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd5rp\" (UniqueName: \"kubernetes.io/projected/99395a70-f20e-4a73-b161-66c015c14b90-kube-api-access-pd5rp\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-device-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-modprobe-d\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615091    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysctl-d\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-tuned\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7ljp\" (UniqueName: \"kubernetes.io/projected/95b7145b-9d61-4402-a97a-419d8f23d8f0-kube-api-access-h7ljp\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdbz\" (UniqueName: \"kubernetes.io/projected/2872afe6-bbd2-4ff1-849b-11ca538c3a14-kube-api-access-vcdbz\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99395a70-f20e-4a73-b161-66c015c14b90-multus-daemon-config\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b7145b-9d61-4402-a97a-419d8f23d8f0-tmp\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-cni-bin\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-hostroot\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-multus-certs\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615428    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-sys-fs\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.615820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.615454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgmsv\" (UniqueName: \"kubernetes.io/projected/bb27775a-8f8c-4310-89c6-11c94610b5c5-kube-api-access-xgmsv\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.616616 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.616600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.618726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.618706    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 06:17:44.618865 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.618848    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 06:17:44.618948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.618903    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 06:17:44.619004 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.618967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:44.619056 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.619002    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal"
Jul 21 06:17:44.619056 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.619033    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:17:44.619150 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.619072    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m87r8\""
Jul 21 06:17:44.621222 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.621190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:44.621319 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.621255    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:17:44.622074 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.622055    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 06:17:44.623463 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.623437    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal"]
Jul 21 06:17:44.623547 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.623517    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.626058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.626044    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 06:17:44.626146 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.626049    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 06:17:44.626206 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.626196    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 06:17:44.627198 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.627183    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 06:17:44.627287 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.627200    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dwspp\""
Jul 21 06:17:44.627287 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.627234    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 06:17:44.627287 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.627254    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 06:17:44.627440 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.627202    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 06:17:44.627499 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.627484    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal"]
Jul 21 06:17:44.639922 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.639867    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zqq5s"
Jul 21 06:17:44.646546 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.646508    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zqq5s"
Jul 21 06:17:44.688047 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:44.688018    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bdc3d1b2bcbb087dc40ca7e374bc350.slice/crio-c0bddf534a5af1ed4855416f61854aa851d2b7282919fa463d2db3ec4e37a27d WatchSource:0}: Error finding container c0bddf534a5af1ed4855416f61854aa851d2b7282919fa463d2db3ec4e37a27d: Status 404 returned error can't find the container with id c0bddf534a5af1ed4855416f61854aa851d2b7282919fa463d2db3ec4e37a27d
Jul 21 06:17:44.692232 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.692217    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 06:17:44.709670 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.709652    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 06:17:44.710756 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.710726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal" event={"ID":"3bdc3d1b2bcbb087dc40ca7e374bc350","Type":"ContainerStarted","Data":"c0bddf534a5af1ed4855416f61854aa851d2b7282919fa463d2db3ec4e37a27d"}
Jul 21 06:17:44.715958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.715940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f9a35c0-171f-424d-8492-501cb9217aa1-ovn-node-metrics-cert\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.716019 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.715967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lmd6\" (UniqueName: \"kubernetes.io/projected/3f9a35c0-171f-424d-8492-501cb9217aa1-kube-api-access-4lmd6\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.716019 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.715981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-kubelet-config\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.716019 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.715995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-system-cni-dir\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.716019 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-os-release\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.716154 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-hostroot\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.716154 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-hostroot\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.716154 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-multus-certs\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.716154 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-sys-fs\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.716285 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-systemd\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.716285 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716180    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-node-log\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.716285 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-multus-certs\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.716285 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-ovnkube-config\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.716285 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716226    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-sys-fs\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.716285 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-cni-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.716285 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-k8s-cni-cncf-io\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-k8s-cni-cncf-io\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-sys\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716347    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-cni-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-host\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-sys\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-host\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-ovnkube-script-lib\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb8gz\" (UniqueName: \"kubernetes.io/projected/1dc25648-0845-4e8f-8eec-9a370cb306cb-kube-api-access-gb8gz\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea99fd85-6838-44e4-b591-a8f1f6489598-tmp-dir\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716624    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-slash\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.716640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mmd8\" (UniqueName: \"kubernetes.io/projected/ea99fd85-6838-44e4-b591-a8f1f6489598-kube-api-access-7mmd8\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-system-cni-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-registration-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/367e2d80-bfb6-4260-93d4-700c17a7796d-konnectivity-ca\") pod \"konnectivity-agent-lhqgl\" (UID: \"367e2d80-bfb6-4260-93d4-700c17a7796d\") " pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysctl-conf\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-registration-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-systemd\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716784    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-system-cni-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a43533d-a759-4491-9505-88a43986ae6b-iptables-alerter-script\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716838    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-systemd\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ea99fd85-6838-44e4-b591-a8f1f6489598-tmp-dir\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea99fd85-6838-44e4-b591-a8f1f6489598-hosts-file\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysctl-conf\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ea99fd85-6838-44e4-b591-a8f1f6489598-hosts-file\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.717289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-cni-multus\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-kubelet\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-cni-multus\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.716991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-kubelet\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-run-netns\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717041    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-cni-netd\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717055    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a43533d-a759-4491-9505-88a43986ae6b-host-slash\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717087    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-device-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717101    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysctl-d\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-ovn\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-device-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/367e2d80-bfb6-4260-93d4-700c17a7796d-konnectivity-ca\") pod \"konnectivity-agent-lhqgl\" (UID: \"367e2d80-bfb6-4260-93d4-700c17a7796d\") " pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b7145b-9d61-4402-a97a-419d8f23d8f0-tmp\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.718033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-log-socket\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-cni-bin\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysctl-d\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgmsv\" (UniqueName: \"kubernetes.io/projected/bb27775a-8f8c-4310-89c6-11c94610b5c5-kube-api-access-xgmsv\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717326    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-var-lib-cni-bin\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-etc-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717419    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w29n\" (UniqueName: \"kubernetes.io/projected/4a43533d-a759-4491-9505-88a43986ae6b-kube-api-access-4w29n\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-cnibin\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysconfig\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-cnibin\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2872afe6-bbd2-4ff1-849b-11ca538c3a14-host\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-sysconfig\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-run\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-cnibin\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717632    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2872afe6-bbd2-4ff1-849b-11ca538c3a14-host\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717646    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-run\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.718726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4lcn\" (UniqueName: \"kubernetes.io/projected/3864ad44-6ed0-49fc-9844-64c3db7cc458-kube-api-access-b4lcn\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2872afe6-bbd2-4ff1-849b-11ca538c3a14-serviceca\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99395a70-f20e-4a73-b161-66c015c14b90-cni-binary-copy\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-socket-dir-parent\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/367e2d80-bfb6-4260-93d4-700c17a7796d-agent-certs\") pod \"konnectivity-agent-lhqgl\" (UID: \"367e2d80-bfb6-4260-93d4-700c17a7796d\") " pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-socket-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-socket-dir-parent\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-os-release\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-netns\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bb27775a-8f8c-4310-89c6-11c94610b5c5-socket-dir\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-etc-kubernetes\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-kubernetes\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717952    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-host-run-netns\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-var-lib-kubelet\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717971    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-os-release\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.717988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-etc-kubernetes\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-env-overrides\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.719234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718013    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-var-lib-kubelet\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-dbus\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-kubernetes\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2872afe6-bbd2-4ff1-849b-11ca538c3a14-serviceca\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-lib-modules\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-conf-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd5rp\" (UniqueName: \"kubernetes.io/projected/99395a70-f20e-4a73-b161-66c015c14b90-kube-api-access-pd5rp\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718178    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-lib-modules\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-modprobe-d\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-tuned\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7ljp\" (UniqueName: \"kubernetes.io/projected/95b7145b-9d61-4402-a97a-419d8f23d8f0-kube-api-access-h7ljp\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718254    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-modprobe-d\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-kubelet\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718206    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99395a70-f20e-4a73-b161-66c015c14b90-multus-conf-dir\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99395a70-f20e-4a73-b161-66c015c14b90-cni-binary-copy\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-systemd-units\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.719745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-var-lib-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.720224 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdbz\" (UniqueName: \"kubernetes.io/projected/2872afe6-bbd2-4ff1-849b-11ca538c3a14-kube-api-access-vcdbz\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.720224 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99395a70-f20e-4a73-b161-66c015c14b90-multus-daemon-config\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.720224 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-cni-bin\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.720224 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.718812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99395a70-f20e-4a73-b161-66c015c14b90-multus-daemon-config\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.720722 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.720696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/95b7145b-9d61-4402-a97a-419d8f23d8f0-etc-tuned\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.720810 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.720731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95b7145b-9d61-4402-a97a-419d8f23d8f0-tmp\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.721097 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.721076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/367e2d80-bfb6-4260-93d4-700c17a7796d-agent-certs\") pod \"konnectivity-agent-lhqgl\" (UID: \"367e2d80-bfb6-4260-93d4-700c17a7796d\") " pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:17:44.725816 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.725782    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgmsv\" (UniqueName: \"kubernetes.io/projected/bb27775a-8f8c-4310-89c6-11c94610b5c5-kube-api-access-xgmsv\") pod \"aws-ebs-csi-driver-node-gz8mc\" (UID: \"bb27775a-8f8c-4310-89c6-11c94610b5c5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.725977 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.725955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mmd8\" (UniqueName: \"kubernetes.io/projected/ea99fd85-6838-44e4-b591-a8f1f6489598-kube-api-access-7mmd8\") pod \"node-resolver-9nl56\" (UID: \"ea99fd85-6838-44e4-b591-a8f1f6489598\") " pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.726234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.726207    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd5rp\" (UniqueName: \"kubernetes.io/projected/99395a70-f20e-4a73-b161-66c015c14b90-kube-api-access-pd5rp\") pod \"multus-jjzcf\" (UID: \"99395a70-f20e-4a73-b161-66c015c14b90\") " pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.726418 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.726402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7ljp\" (UniqueName: \"kubernetes.io/projected/95b7145b-9d61-4402-a97a-419d8f23d8f0-kube-api-access-h7ljp\") pod \"tuned-srvpw\" (UID: \"95b7145b-9d61-4402-a97a-419d8f23d8f0\") " pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.726841 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.726826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdbz\" (UniqueName: \"kubernetes.io/projected/2872afe6-bbd2-4ff1-849b-11ca538c3a14-kube-api-access-vcdbz\") pod \"node-ca-9wv82\" (UID: \"2872afe6-bbd2-4ff1-849b-11ca538c3a14\") " pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.818616 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.818733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-ovn\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.818733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.818733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:44.818733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-ovn\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.818733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.818733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-log-socket\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-etc-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w29n\" (UniqueName: \"kubernetes.io/projected/4a43533d-a759-4491-9505-88a43986ae6b-kube-api-access-4w29n\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-cnibin\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.818793    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-log-socket\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818815    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-etc-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.818856    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs podName:1dc25648-0845-4e8f-8eec-9a370cb306cb nodeName:}" failed. No retries permitted until 2026-07-21 06:17:45.318840279 +0000 UTC m=+2.131583928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs") pod "network-metrics-daemon-zgblg" (UID: "1dc25648-0845-4e8f-8eec-9a370cb306cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4lcn\" (UniqueName: \"kubernetes.io/projected/3864ad44-6ed0-49fc-9844-64c3db7cc458-kube-api-access-b4lcn\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.818991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.818980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-cnibin\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-env-overrides\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-dbus\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-kubelet\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.819157    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-systemd-units\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-var-lib-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-dbus\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.819220    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret podName:54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:45.319204189 +0000 UTC m=+2.131947852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret") pod "global-pull-secret-syncer-thwmp" (UID: "54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7") : object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819222    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-kubelet\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-cni-binary-copy\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-cni-bin\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-systemd-units\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819271    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-var-lib-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.819393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819289    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f9a35c0-171f-424d-8492-501cb9217aa1-ovn-node-metrics-cert\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819294    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-cni-bin\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lmd6\" (UniqueName: \"kubernetes.io/projected/3f9a35c0-171f-424d-8492-501cb9217aa1-kube-api-access-4lmd6\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-kubelet-config\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-system-cni-dir\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-os-release\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819506    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-env-overrides\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-systemd\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819514    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-kubelet-config\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-system-cni-dir\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-node-log\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-systemd\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3864ad44-6ed0-49fc-9844-64c3db7cc458-os-release\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-ovnkube-config\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-node-log\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.820399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-ovnkube-script-lib\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819673    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-run-openvswitch\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb8gz\" (UniqueName: \"kubernetes.io/projected/1dc25648-0845-4e8f-8eec-9a370cb306cb-kube-api-access-gb8gz\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-slash\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a43533d-a759-4491-9505-88a43986ae6b-iptables-alerter-script\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819890    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-run-netns\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-cni-netd\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a43533d-a759-4491-9505-88a43986ae6b-host-slash\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.820006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-run-netns\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.820025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-run-ovn-kubernetes\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.819860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-slash\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.820038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4a43533d-a759-4491-9505-88a43986ae6b-host-slash\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.820078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3f9a35c0-171f-424d-8492-501cb9217aa1-host-cni-netd\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.820108    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3864ad44-6ed0-49fc-9844-64c3db7cc458-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.821228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.820151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-ovnkube-script-lib\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821895 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.820213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3f9a35c0-171f-424d-8492-501cb9217aa1-ovnkube-config\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.821895 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.820451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4a43533d-a759-4491-9505-88a43986ae6b-iptables-alerter-script\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.821895 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.821771    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3f9a35c0-171f-424d-8492-501cb9217aa1-ovn-node-metrics-cert\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.829126 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.829100    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 06:17:44.829126 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.829126    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 06:17:44.829292 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.829134    2577 projected.go:196] Error preparing data for projected volume kube-api-access-5t5gv for pod openshift-network-diagnostics/network-check-target-t5xwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:44.829292 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:44.829189    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv podName:bb89c953-016d-45de-9074-c9e3f1d2943a nodeName:}" failed. No retries permitted until 2026-07-21 06:17:45.329177838 +0000 UTC m=+2.141921491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5t5gv" (UniqueName: "kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv") pod "network-check-target-t5xwf" (UID: "bb89c953-016d-45de-9074-c9e3f1d2943a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:44.830298 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.830273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w29n\" (UniqueName: \"kubernetes.io/projected/4a43533d-a759-4491-9505-88a43986ae6b-kube-api-access-4w29n\") pod \"iptables-alerter-ttpzj\" (UID: \"4a43533d-a759-4491-9505-88a43986ae6b\") " pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:44.830513 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.830493    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4lcn\" (UniqueName: \"kubernetes.io/projected/3864ad44-6ed0-49fc-9844-64c3db7cc458-kube-api-access-b4lcn\") pod \"multus-additional-cni-plugins-kvbl7\" (UID: \"3864ad44-6ed0-49fc-9844-64c3db7cc458\") " pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:44.830594 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.830581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lmd6\" (UniqueName: \"kubernetes.io/projected/3f9a35c0-171f-424d-8492-501cb9217aa1-kube-api-access-4lmd6\") pod \"ovnkube-node-rg9sr\" (UID: \"3f9a35c0-171f-424d-8492-501cb9217aa1\") " pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:44.831268 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.831253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb8gz\" (UniqueName: \"kubernetes.io/projected/1dc25648-0845-4e8f-8eec-9a370cb306cb-kube-api-access-gb8gz\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:44.915078 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.914997    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:17:44.925190 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:44.925169    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367e2d80_bfb6_4260_93d4_700c17a7796d.slice/crio-a4c4b6e5c864ae9f3a9a7f4ff20a2451a1255da2d5018f2da06b6a0dbbdb3771 WatchSource:0}: Error finding container a4c4b6e5c864ae9f3a9a7f4ff20a2451a1255da2d5018f2da06b6a0dbbdb3771: Status 404 returned error can't find the container with id a4c4b6e5c864ae9f3a9a7f4ff20a2451a1255da2d5018f2da06b6a0dbbdb3771
Jul 21 06:17:44.926339 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.926298    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc"
Jul 21 06:17:44.934092 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:44.934073    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb27775a_8f8c_4310_89c6_11c94610b5c5.slice/crio-bc4fe1b8646b25a83634677e390cb73f05daae28a0ca1af691d41312d5ddb9d0 WatchSource:0}: Error finding container bc4fe1b8646b25a83634677e390cb73f05daae28a0ca1af691d41312d5ddb9d0: Status 404 returned error can't find the container with id bc4fe1b8646b25a83634677e390cb73f05daae28a0ca1af691d41312d5ddb9d0
Jul 21 06:17:44.943908 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.943893    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-srvpw"
Jul 21 06:17:44.946014 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.945998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9nl56"
Jul 21 06:17:44.952214 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:44.952195    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95b7145b_9d61_4402_a97a_419d8f23d8f0.slice/crio-6a2f58ec2940fa0de69ff2df0a76e8b41111df754065b2d6171d50f12335c202 WatchSource:0}: Error finding container 6a2f58ec2940fa0de69ff2df0a76e8b41111df754065b2d6171d50f12335c202: Status 404 returned error can't find the container with id 6a2f58ec2940fa0de69ff2df0a76e8b41111df754065b2d6171d50f12335c202
Jul 21 06:17:44.955347 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:44.955328    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea99fd85_6838_44e4_b591_a8f1f6489598.slice/crio-7d5d78d150d50cf550fd90757a1b7e07c7aface8098d16676d2930190c789268 WatchSource:0}: Error finding container 7d5d78d150d50cf550fd90757a1b7e07c7aface8098d16676d2930190c789268: Status 404 returned error can't find the container with id 7d5d78d150d50cf550fd90757a1b7e07c7aface8098d16676d2930190c789268
Jul 21 06:17:44.969227 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.969210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9wv82"
Jul 21 06:17:44.978065 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:44.978047    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2872afe6_bbd2_4ff1_849b_11ca538c3a14.slice/crio-cbad53832fb06d961656811e7df4a66ab8fdff156b822f2a0f58413302fbcf3d WatchSource:0}: Error finding container cbad53832fb06d961656811e7df4a66ab8fdff156b822f2a0f58413302fbcf3d: Status 404 returned error can't find the container with id cbad53832fb06d961656811e7df4a66ab8fdff156b822f2a0f58413302fbcf3d
Jul 21 06:17:44.985958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.985939    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jjzcf"
Jul 21 06:17:44.993206 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:44.993189    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99395a70_f20e_4a73_b161_66c015c14b90.slice/crio-2813574126ac63c1bf678e3f017195d373d33c9ddd7dbd21ac43837cbffcecd2 WatchSource:0}: Error finding container 2813574126ac63c1bf678e3f017195d373d33c9ddd7dbd21ac43837cbffcecd2: Status 404 returned error can't find the container with id 2813574126ac63c1bf678e3f017195d373d33c9ddd7dbd21ac43837cbffcecd2
Jul 21 06:17:44.995977 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:44.995934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ttpzj"
Jul 21 06:17:45.001009 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.000990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kvbl7"
Jul 21 06:17:45.005397 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.005383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:17:45.005494 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:45.005419    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a43533d_a759_4491_9505_88a43986ae6b.slice/crio-7778baf0e23931b0a30d9f5e5036e548f6d18715bfcc73e21e9034663d48eb41 WatchSource:0}: Error finding container 7778baf0e23931b0a30d9f5e5036e548f6d18715bfcc73e21e9034663d48eb41: Status 404 returned error can't find the container with id 7778baf0e23931b0a30d9f5e5036e548f6d18715bfcc73e21e9034663d48eb41
Jul 21 06:17:45.009575 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:45.009556    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3864ad44_6ed0_49fc_9844_64c3db7cc458.slice/crio-17ed812290fcc7d678ffb5ca973e0ae3c97aceab93d0f7923f049e21513d60f5 WatchSource:0}: Error finding container 17ed812290fcc7d678ffb5ca973e0ae3c97aceab93d0f7923f049e21513d60f5: Status 404 returned error can't find the container with id 17ed812290fcc7d678ffb5ca973e0ae3c97aceab93d0f7923f049e21513d60f5
Jul 21 06:17:45.014393 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:45.014376    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f9a35c0_171f_424d_8492_501cb9217aa1.slice/crio-acc8b5fd47731897e900aed2f7aa3d95c4c364d426d3b45bbe9d14682fcf8c16 WatchSource:0}: Error finding container acc8b5fd47731897e900aed2f7aa3d95c4c364d426d3b45bbe9d14682fcf8c16: Status 404 returned error can't find the container with id acc8b5fd47731897e900aed2f7aa3d95c4c364d426d3b45bbe9d14682fcf8c16
Jul 21 06:17:45.323693 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.323617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:45.323839 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.323728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:45.323920 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:45.323848    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:45.323982 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:45.323948    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs podName:1dc25648-0845-4e8f-8eec-9a370cb306cb nodeName:}" failed. No retries permitted until 2026-07-21 06:17:46.323890727 +0000 UTC m=+3.136634393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs") pod "network-metrics-daemon-zgblg" (UID: "1dc25648-0845-4e8f-8eec-9a370cb306cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:45.324364 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:45.324341    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:45.324510 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:45.324398    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret podName:54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:46.324382947 +0000 UTC m=+3.137126599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret") pod "global-pull-secret-syncer-thwmp" (UID: "54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7") : object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:45.360263 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:17:45.360235    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42bd7eb63df01dcfbe6e3f5754bb93f6.slice/crio-64155cbe5d6bce03a6934d5efbde89592798564321a2d0cf6477eb1e975f4958 WatchSource:0}: Error finding container 64155cbe5d6bce03a6934d5efbde89592798564321a2d0cf6477eb1e975f4958: Status 404 returned error can't find the container with id 64155cbe5d6bce03a6934d5efbde89592798564321a2d0cf6477eb1e975f4958
Jul 21 06:17:45.424871 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.424821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:45.425045 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:45.424996    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 06:17:45.425045 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:45.425019    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 06:17:45.425045 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:45.425031    2577 projected.go:196] Error preparing data for projected volume kube-api-access-5t5gv for pod openshift-network-diagnostics/network-check-target-t5xwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:45.425214 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:45.425088    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv podName:bb89c953-016d-45de-9074-c9e3f1d2943a nodeName:}" failed. No retries permitted until 2026-07-21 06:17:46.425067978 +0000 UTC m=+3.237811652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5t5gv" (UniqueName: "kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv") pod "network-check-target-t5xwf" (UID: "bb89c953-016d-45de-9074-c9e3f1d2943a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:45.649330 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.649234    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 06:12:45 +0000 UTC" deadline="2028-02-12 22:23:58.763481672 +0000 UTC"
Jul 21 06:17:45.649330 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.649279    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13720h6m13.114208085s"
Jul 21 06:17:45.716978 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.716940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jjzcf" event={"ID":"99395a70-f20e-4a73-b161-66c015c14b90","Type":"ContainerStarted","Data":"2813574126ac63c1bf678e3f017195d373d33c9ddd7dbd21ac43837cbffcecd2"}
Jul 21 06:17:45.744826 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.744786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9wv82" event={"ID":"2872afe6-bbd2-4ff1-849b-11ca538c3a14","Type":"ContainerStarted","Data":"cbad53832fb06d961656811e7df4a66ab8fdff156b822f2a0f58413302fbcf3d"}
Jul 21 06:17:45.749093 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.749061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nl56" event={"ID":"ea99fd85-6838-44e4-b591-a8f1f6489598","Type":"ContainerStarted","Data":"7d5d78d150d50cf550fd90757a1b7e07c7aface8098d16676d2930190c789268"}
Jul 21 06:17:45.752305 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.752221    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc" event={"ID":"bb27775a-8f8c-4310-89c6-11c94610b5c5","Type":"ContainerStarted","Data":"bc4fe1b8646b25a83634677e390cb73f05daae28a0ca1af691d41312d5ddb9d0"}
Jul 21 06:17:45.756874 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.756818    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lhqgl" event={"ID":"367e2d80-bfb6-4260-93d4-700c17a7796d","Type":"ContainerStarted","Data":"a4c4b6e5c864ae9f3a9a7f4ff20a2451a1255da2d5018f2da06b6a0dbbdb3771"}
Jul 21 06:17:45.768121 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.768097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal" event={"ID":"42bd7eb63df01dcfbe6e3f5754bb93f6","Type":"ContainerStarted","Data":"64155cbe5d6bce03a6934d5efbde89592798564321a2d0cf6477eb1e975f4958"}
Jul 21 06:17:45.770901 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.770873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"acc8b5fd47731897e900aed2f7aa3d95c4c364d426d3b45bbe9d14682fcf8c16"}
Jul 21 06:17:45.773771 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.773742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerStarted","Data":"17ed812290fcc7d678ffb5ca973e0ae3c97aceab93d0f7923f049e21513d60f5"}
Jul 21 06:17:45.779735 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.779688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ttpzj" event={"ID":"4a43533d-a759-4491-9505-88a43986ae6b","Type":"ContainerStarted","Data":"7778baf0e23931b0a30d9f5e5036e548f6d18715bfcc73e21e9034663d48eb41"}
Jul 21 06:17:45.785227 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.785171    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-srvpw" event={"ID":"95b7145b-9d61-4402-a97a-419d8f23d8f0","Type":"ContainerStarted","Data":"6a2f58ec2940fa0de69ff2df0a76e8b41111df754065b2d6171d50f12335c202"}
Jul 21 06:17:45.848236 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.848191    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 06:17:45.912635 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:45.912465    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 06:17:46.334288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:46.334200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:46.334468 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:46.334310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:46.334468 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.334375    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:46.334468 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.334443    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:46.334468 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.334454    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret podName:54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:48.334429325 +0000 UTC m=+5.147172993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret") pod "global-pull-secret-syncer-thwmp" (UID: "54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7") : object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:46.334738 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.334501    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs podName:1dc25648-0845-4e8f-8eec-9a370cb306cb nodeName:}" failed. No retries permitted until 2026-07-21 06:17:48.33448115 +0000 UTC m=+5.147224800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs") pod "network-metrics-daemon-zgblg" (UID: "1dc25648-0845-4e8f-8eec-9a370cb306cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:46.434928 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:46.434894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:46.435110 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.435092    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 06:17:46.435110 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.435108    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 06:17:46.435230 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.435117    2577 projected.go:196] Error preparing data for projected volume kube-api-access-5t5gv for pod openshift-network-diagnostics/network-check-target-t5xwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:46.435230 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.435171    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv podName:bb89c953-016d-45de-9074-c9e3f1d2943a nodeName:}" failed. No retries permitted until 2026-07-21 06:17:48.435152285 +0000 UTC m=+5.247895941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5t5gv" (UniqueName: "kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv") pod "network-check-target-t5xwf" (UID: "bb89c953-016d-45de-9074-c9e3f1d2943a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:46.650343 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:46.650195    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 06:12:45 +0000 UTC" deadline="2028-01-28 17:00:21.54335233 +0000 UTC"
Jul 21 06:17:46.650343 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:46.650257    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13354h42m34.893100039s"
Jul 21 06:17:46.709213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:46.708249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:46.709213 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.708390    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:17:46.709213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:46.708867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:46.709213 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.708974    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:17:46.709213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:46.709055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:46.709213 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:46.709137    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:17:48.353070 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:48.353031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:48.353574 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:48.353130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:48.353574 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.353256    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:48.353574 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.353318    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs podName:1dc25648-0845-4e8f-8eec-9a370cb306cb nodeName:}" failed. No retries permitted until 2026-07-21 06:17:52.353298463 +0000 UTC m=+9.166042119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs") pod "network-metrics-daemon-zgblg" (UID: "1dc25648-0845-4e8f-8eec-9a370cb306cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:48.353799 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.353735    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:48.353799 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.353785    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret podName:54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:17:52.35376848 +0000 UTC m=+9.166512132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret") pod "global-pull-secret-syncer-thwmp" (UID: "54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7") : object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:48.453477 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:48.453440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:48.453673 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.453652    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 06:17:48.453760 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.453677    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 06:17:48.453760 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.453690    2577 projected.go:196] Error preparing data for projected volume kube-api-access-5t5gv for pod openshift-network-diagnostics/network-check-target-t5xwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:48.453760 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.453748    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv podName:bb89c953-016d-45de-9074-c9e3f1d2943a nodeName:}" failed. No retries permitted until 2026-07-21 06:17:52.453728722 +0000 UTC m=+9.266472395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5t5gv" (UniqueName: "kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv") pod "network-check-target-t5xwf" (UID: "bb89c953-016d-45de-9074-c9e3f1d2943a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:48.707695 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:48.707619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:48.707864 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.707768    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:17:48.707864 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:48.707834    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:48.708004 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.707920    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:17:48.708004 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:48.707973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:48.708117 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:48.708047    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:17:50.708567 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:50.707840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:50.708567 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:50.707964    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:17:50.708567 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:50.708346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:50.708567 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:50.708437    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:17:50.708567 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:50.708491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:50.709069 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:50.708577    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:17:52.386825 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:52.386787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:52.387251 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:52.386864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:52.387251 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.386999    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:52.387251 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.387053    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret podName:54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:00.387039096 +0000 UTC m=+17.199782746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret") pod "global-pull-secret-syncer-thwmp" (UID: "54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7") : object "kube-system"/"original-pull-secret" not registered
Jul 21 06:17:52.387486 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.387470    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:52.387551 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.387533    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs podName:1dc25648-0845-4e8f-8eec-9a370cb306cb nodeName:}" failed. No retries permitted until 2026-07-21 06:18:00.387518368 +0000 UTC m=+17.200262018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs") pod "network-metrics-daemon-zgblg" (UID: "1dc25648-0845-4e8f-8eec-9a370cb306cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:17:52.487794 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:52.487704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:52.487959 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.487892    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 06:17:52.487959 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.487911    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 06:17:52.487959 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.487924    2577 projected.go:196] Error preparing data for projected volume kube-api-access-5t5gv for pod openshift-network-diagnostics/network-check-target-t5xwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:52.488110 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.487983    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv podName:bb89c953-016d-45de-9074-c9e3f1d2943a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:00.487963818 +0000 UTC m=+17.300707471 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5t5gv" (UniqueName: "kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv") pod "network-check-target-t5xwf" (UID: "bb89c953-016d-45de-9074-c9e3f1d2943a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:17:52.708173 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:52.708135    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:52.708366 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:52.708256    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:52.708366 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:52.708142    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:52.708366 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.708310    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:17:52.708366 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.708338    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:17:52.708582 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:52.708396    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:17:54.707753 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:54.707711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:54.707753 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:54.707737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:54.708268 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:54.707836    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:17:54.708268 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:54.708154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:54.708268 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:54.708238    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:17:54.708423 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:54.708299    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:17:56.707719 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:56.707686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:56.707719 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:56.707715    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:56.708192 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:56.707728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:56.708192 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:56.707810    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:17:56.708192 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:56.707873    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:17:56.708192 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:56.707932    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:17:58.707674 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:58.707639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:17:58.707674 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:58.707667    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:17:58.708165 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:58.707758    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:17:58.708165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:17:58.707774    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:17:58.708165 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:58.707840    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:17:58.708165 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:17:58.707923    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:00.445742 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:00.445463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:00.446200 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:00.445774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:00.446200 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.445638    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:18:00.446200 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.445887    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs podName:1dc25648-0845-4e8f-8eec-9a370cb306cb nodeName:}" failed. No retries permitted until 2026-07-21 06:18:16.445868634 +0000 UTC m=+33.258612282 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs") pod "network-metrics-daemon-zgblg" (UID: "1dc25648-0845-4e8f-8eec-9a370cb306cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:18:00.446200 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.445888    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 06:18:00.446200 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.445940    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret podName:54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:16.445924678 +0000 UTC m=+33.258668330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret") pod "global-pull-secret-syncer-thwmp" (UID: "54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7") : object "kube-system"/"original-pull-secret" not registered
Jul 21 06:18:00.546301 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:00.546258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:00.546477 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.546424    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 06:18:00.546477 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.546444    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 06:18:00.546477 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.546454    2577 projected.go:196] Error preparing data for projected volume kube-api-access-5t5gv for pod openshift-network-diagnostics/network-check-target-t5xwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:18:00.546676 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.546506    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv podName:bb89c953-016d-45de-9074-c9e3f1d2943a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:16.546493539 +0000 UTC m=+33.359237187 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5t5gv" (UniqueName: "kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv") pod "network-check-target-t5xwf" (UID: "bb89c953-016d-45de-9074-c9e3f1d2943a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:18:00.708149 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:00.708072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:00.708317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:00.708073    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:00.708317 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.708212    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:00.708317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:00.708075    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:00.708317 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.708293    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:00.708509 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:00.708365    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:02.708082 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:02.708053    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:02.708082 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:02.708081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:02.708618 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:02.708090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:02.708618 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:02.708178    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:02.708618 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:02.708272    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:02.708618 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:02.708369    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:04.708059 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:04.708016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:04.708516 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:04.708061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:04.708516 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:04.708061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:04.708516 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:04.708130    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:04.708516 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:04.708255    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:04.708516 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:04.708337    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:06.707800 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.707774    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:06.707800 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.707799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:06.708166 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:06.707896    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:06.708166 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.707959    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:06.708166 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:06.708087    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:06.708260 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:06.708181    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:06.865614 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.865579    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal" event={"ID":"42bd7eb63df01dcfbe6e3f5754bb93f6","Type":"ContainerStarted","Data":"1f4ea7b9b39e87727b71419df228f32b4a96ce3fce7c5ceec97d4b97970e214f"}
Jul 21 06:18:06.867777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.867759    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:18:06.868084 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.868067    2577 generic.go:356] "Generic (PLEG): container finished" podID="3f9a35c0-171f-424d-8492-501cb9217aa1" containerID="6eca74a9fcb3110591439998093b6a482d9d6aa24457f63f74eb001466d52369" exitCode=1
Jul 21 06:18:06.868186 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.868134    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"609f8a76b84ff7030c663c01dba304cef8223655210220ffe8bddd09673a3452"}
Jul 21 06:18:06.868268 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.868252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"45c37e167316d009c4834b91b4a1c7d4c8c89cc940e6cdfeb6b76bdbdd64f69b"}
Jul 21 06:18:06.868325 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.868311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerDied","Data":"6eca74a9fcb3110591439998093b6a482d9d6aa24457f63f74eb001466d52369"}
Jul 21 06:18:06.868395 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.868382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"017d84057ade12279ae8e935b5ed4ac745805c9b6587c372c2a138b0d6cd4dfe"}
Jul 21 06:18:06.869563 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.869517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-srvpw" event={"ID":"95b7145b-9d61-4402-a97a-419d8f23d8f0","Type":"ContainerStarted","Data":"a9d3ce0e544cf208ec4a5a7683f9f05f3660e4f976e23d1d505b5846caadde8d"}
Jul 21 06:18:06.871240 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.871223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jjzcf" event={"ID":"99395a70-f20e-4a73-b161-66c015c14b90","Type":"ContainerStarted","Data":"ea5256b702d3afa748eb502674971c4386cac623ba31c179a57cde18bac0396c"}
Jul 21 06:18:06.878828 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.878790    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-56.ec2.internal" podStartSLOduration=21.87877722 podStartE2EDuration="21.87877722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:06.878033927 +0000 UTC m=+23.690777589" watchObservedRunningTime="2026-07-21 06:18:06.87877722 +0000 UTC m=+23.691520889"
Jul 21 06:18:06.893282 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.893244    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-srvpw" podStartSLOduration=1.719685747 podStartE2EDuration="22.893232817s" totalImagesPullingTime="21.17354707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:06.892885955 +0000 UTC m=+23.705629626" watchObservedRunningTime="2026-07-21 06:18:06.893232817 +0000 UTC m=+23.705976487"
Jul 21 06:18:06.912089 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:06.912053    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jjzcf" podStartSLOduration=1.7778536150000002 podStartE2EDuration="22.912041832s" totalImagesPullingTime="21.134188217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:06.911715732 +0000 UTC m=+23.724459402" watchObservedRunningTime="2026-07-21 06:18:06.912041832 +0000 UTC m=+23.724785495"
Jul 21 06:18:07.875500 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.875275    2577 generic.go:356] "Generic (PLEG): container finished" podID="3bdc3d1b2bcbb087dc40ca7e374bc350" containerID="5dbc45102aaa593087448a378235ea6872f14d06f81c82921ec2f7d46e3f5fb5" exitCode=0
Jul 21 06:18:07.876176 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.875371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal" event={"ID":"3bdc3d1b2bcbb087dc40ca7e374bc350","Type":"ContainerDied","Data":"5dbc45102aaa593087448a378235ea6872f14d06f81c82921ec2f7d46e3f5fb5"}
Jul 21 06:18:07.877779 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.877746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9wv82" event={"ID":"2872afe6-bbd2-4ff1-849b-11ca538c3a14","Type":"ContainerStarted","Data":"1965a2edf5b38a38af3a75a84891ed090de84c90242a3482c1624d1d365f8481"}
Jul 21 06:18:07.882881 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.882750    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9nl56" event={"ID":"ea99fd85-6838-44e4-b591-a8f1f6489598","Type":"ContainerStarted","Data":"4283bbfb71910ea213713c5b322d4be74b3aebdddba390e56d8b45b27578b7c9"}
Jul 21 06:18:07.884771 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.884747    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc" event={"ID":"bb27775a-8f8c-4310-89c6-11c94610b5c5","Type":"ContainerStarted","Data":"a7fcdf7825b22b224d8915c45a95cc1dd15011a604dc1715ba42de701644e60d"}
Jul 21 06:18:07.886436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.886403    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lhqgl" event={"ID":"367e2d80-bfb6-4260-93d4-700c17a7796d","Type":"ContainerStarted","Data":"a40a363e1ef088e6037e3fb998f61ec4cb0b807c1db449b0e3de1a49d0182abb"}
Jul 21 06:18:07.889485 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.889466    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:18:07.889958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.889929    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"dd2a56f2912dffbb707c953d1cefa26486ea925e92dd9bdeb748a49ab805c821"}
Jul 21 06:18:07.890058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.890000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"ff401cae03313912d0e86b00234e395ceffda4854914675ec42330706b52468c"}
Jul 21 06:18:07.892308 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.892285    2577 generic.go:356] "Generic (PLEG): container finished" podID="3864ad44-6ed0-49fc-9844-64c3db7cc458" containerID="bc1d7ec69ad792bfd31f99d12145468d88679fd05727278fb6c253e3ce784696" exitCode=0
Jul 21 06:18:07.892408 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.892369    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerDied","Data":"bc1d7ec69ad792bfd31f99d12145468d88679fd05727278fb6c253e3ce784696"}
Jul 21 06:18:07.894627 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.894609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ttpzj" event={"ID":"4a43533d-a759-4491-9505-88a43986ae6b","Type":"ContainerStarted","Data":"180575e9b03e8114d524b8d876c80413b215a2a75ec434006edfef736714c3da"}
Jul 21 06:18:07.909192 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.909145    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9nl56" podStartSLOduration=2.909259854 podStartE2EDuration="23.90912711s" totalImagesPullingTime="20.999867256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:07.908819514 +0000 UTC m=+24.721563188" watchObservedRunningTime="2026-07-21 06:18:07.90912711 +0000 UTC m=+24.721870781"
Jul 21 06:18:07.939579 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.938791    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9wv82" podStartSLOduration=2.979766357 podStartE2EDuration="23.938773528s" totalImagesPullingTime="20.959007171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:07.925809612 +0000 UTC m=+24.738553285" watchObservedRunningTime="2026-07-21 06:18:07.938773528 +0000 UTC m=+24.751517199"
Jul 21 06:18:07.939579 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.938974    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ttpzj" podStartSLOduration=2.819199073 podStartE2EDuration="23.938963989s" totalImagesPullingTime="21.119764916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:07.938869168 +0000 UTC m=+24.751612838" watchObservedRunningTime="2026-07-21 06:18:07.938963989 +0000 UTC m=+24.751707660"
Jul 21 06:18:07.975883 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:07.975834    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lhqgl" podStartSLOduration=7.286931948 podStartE2EDuration="23.975816353s" totalImagesPullingTime="16.688884405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:07.975626273 +0000 UTC m=+24.788369943" watchObservedRunningTime="2026-07-21 06:18:07.975816353 +0000 UTC m=+24.788560025"
Jul 21 06:18:08.695068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:08.695040    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 06:18:08.707356 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:08.707331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:08.707356 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:08.707349    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:08.707552 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:08.707350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:08.707552 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:08.707431    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:08.707552 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:08.707520    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:08.707715 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:08.707639    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:08.898281 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:08.898203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc" event={"ID":"bb27775a-8f8c-4310-89c6-11c94610b5c5","Type":"ContainerStarted","Data":"7b201ab391f3233de8b7d67f5f2dfa0aa47573cc3a478431bb364f16dc7698e6"}
Jul 21 06:18:08.900246 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:08.900223    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal" event={"ID":"3bdc3d1b2bcbb087dc40ca7e374bc350","Type":"ContainerStarted","Data":"9131b31b092afd1d012a08b328fb4050500ae86667c22c6fc97988cafbc2895f"}
Jul 21 06:18:08.914257 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:08.914214    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-56.ec2.internal" podStartSLOduration=23.914198698 podStartE2EDuration="23.914198698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:08.913971779 +0000 UTC m=+25.726715450" watchObservedRunningTime="2026-07-21 06:18:08.914198698 +0000 UTC m=+25.726942369"
Jul 21 06:18:09.085171 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.085134    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:18:09.085735 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.085707    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:18:09.689467 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.689295    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T06:18:08.695061151Z","UUID":"9035e746-29b9-4ec6-9f71-04e4935cbf77","Handler":null,"Name":"","Endpoint":""}
Jul 21 06:18:09.691250 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.691220    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 06:18:09.691403 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.691271    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 06:18:09.905802 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.905775    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:18:09.906294 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.906262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"448cfbf2cfa82c21e7f19db56d0b3d8f7c7a775f577c4d69a1fef1bc231d86fc"}
Jul 21 06:18:09.906608 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.906590    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:18:09.907271 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:09.907253    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lhqgl"
Jul 21 06:18:10.707692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:10.707663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:10.707899 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:10.707663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:10.707899 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:10.707778    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:10.707899 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:10.707873    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:10.707899 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:10.707665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:10.708149 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:10.707991    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:10.911569 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:10.911509    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc" event={"ID":"bb27775a-8f8c-4310-89c6-11c94610b5c5","Type":"ContainerStarted","Data":"9451c0943632bae51587eb4b138cf35c432113ac4f5964443f9cb3b937a18c44"}
Jul 21 06:18:10.927833 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:10.927786    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8mc" podStartSLOduration=7.422475357 podStartE2EDuration="26.9277682s" totalImagesPullingTime="19.505292843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:10.927358371 +0000 UTC m=+27.740102041" watchObservedRunningTime="2026-07-21 06:18:10.9277682 +0000 UTC m=+27.740511870"
Jul 21 06:18:12.707643 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.707466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:12.708220 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.707487    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:12.708220 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:12.707721    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:12.708220 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:12.707792    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:12.708220 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.707524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:12.708220 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:12.707895    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:12.919499 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.919436    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:18:12.919862 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.919839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"cf0444b28c01d46da7d5e00f7cc5477ff97203c2a24caa6f20ff229f670c5d03"}
Jul 21 06:18:12.920079 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.920061    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:18:12.920167 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.920117    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:18:12.920288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.920262    2577 scope.go:117] "RemoveContainer" containerID="6eca74a9fcb3110591439998093b6a482d9d6aa24457f63f74eb001466d52369"
Jul 21 06:18:12.921939 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.921917    2577 generic.go:356] "Generic (PLEG): container finished" podID="3864ad44-6ed0-49fc-9844-64c3db7cc458" containerID="d1b7978c2d20f3af345d06413b504d47f3ffe1f818294392b4c1888cc4130ae0" exitCode=0
Jul 21 06:18:12.922022 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.921949    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerDied","Data":"d1b7978c2d20f3af345d06413b504d47f3ffe1f818294392b4c1888cc4130ae0"}
Jul 21 06:18:12.936741 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:12.936721    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:18:13.929459 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:13.929278    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:18:13.929947 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:13.929918    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" event={"ID":"3f9a35c0-171f-424d-8492-501cb9217aa1","Type":"ContainerStarted","Data":"852d3781c82ef9e5a446b52a73f8404b4fd02619c6c41c29129f76b62198ff5d"}
Jul 21 06:18:13.930261 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:13.930239    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:18:13.955318 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:13.955013    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:18:13.958679 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:13.958640    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr" podStartSLOduration=8.607758903 podStartE2EDuration="29.958625106s" totalImagesPullingTime="21.350866203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:13.958075664 +0000 UTC m=+30.770819356" watchObservedRunningTime="2026-07-21 06:18:13.958625106 +0000 UTC m=+30.771368775"
Jul 21 06:18:14.228139 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:14.228042    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5xwf"]
Jul 21 06:18:14.228258 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:14.228152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:14.228258 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:14.228227    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:14.231099 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:14.231069    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zgblg"]
Jul 21 06:18:14.231212 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:14.231181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:14.231311 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:14.231286    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:14.231726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:14.231693    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-thwmp"]
Jul 21 06:18:14.231825 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:14.231784    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:14.231885 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:14.231859    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:14.933406 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:14.933371    2577 generic.go:356] "Generic (PLEG): container finished" podID="3864ad44-6ed0-49fc-9844-64c3db7cc458" containerID="83404889cec00b04c60f74c15122d68771801f91b63d436d62f13b9a29060004" exitCode=0
Jul 21 06:18:14.933786 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:14.933455    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerDied","Data":"83404889cec00b04c60f74c15122d68771801f91b63d436d62f13b9a29060004"}
Jul 21 06:18:15.707679 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:15.707616    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:15.707837 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:15.707735    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:15.938845 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:15.938813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerStarted","Data":"bbeae0b4311033be0594cef6d6bff9c1a1470055ee9673a9d4e1b7aab21e13c1"}
Jul 21 06:18:16.470808 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:16.470781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:16.470925 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:16.470841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:16.470963 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.470924    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:18:16.470963 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.470924    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 06:18:16.471021 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.470982    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret podName:54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7 nodeName:}" failed. No retries permitted until 2026-07-21 06:18:48.47096384 +0000 UTC m=+65.283707488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret") pod "global-pull-secret-syncer-thwmp" (UID: "54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7") : object "kube-system"/"original-pull-secret" not registered
Jul 21 06:18:16.471021 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.470997    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs podName:1dc25648-0845-4e8f-8eec-9a370cb306cb nodeName:}" failed. No retries permitted until 2026-07-21 06:18:48.470989817 +0000 UTC m=+65.283733465 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs") pod "network-metrics-daemon-zgblg" (UID: "1dc25648-0845-4e8f-8eec-9a370cb306cb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 06:18:16.571183 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:16.571159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:16.571291 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.571271    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 06:18:16.571291 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.571285    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 06:18:16.571355 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.571295    2577 projected.go:196] Error preparing data for projected volume kube-api-access-5t5gv for pod openshift-network-diagnostics/network-check-target-t5xwf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:18:16.571355 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.571336    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv podName:bb89c953-016d-45de-9074-c9e3f1d2943a nodeName:}" failed. No retries permitted until 2026-07-21 06:18:48.571324955 +0000 UTC m=+65.384068603 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5t5gv" (UniqueName: "kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv") pod "network-check-target-t5xwf" (UID: "bb89c953-016d-45de-9074-c9e3f1d2943a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 06:18:16.708076 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:16.708026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:16.708076 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:16.708058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:16.708194 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.708142    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:16.708272 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:16.708252    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:16.943311 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:16.943282    2577 generic.go:356] "Generic (PLEG): container finished" podID="3864ad44-6ed0-49fc-9844-64c3db7cc458" containerID="bbeae0b4311033be0594cef6d6bff9c1a1470055ee9673a9d4e1b7aab21e13c1" exitCode=0
Jul 21 06:18:16.943687 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:16.943343    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerDied","Data":"bbeae0b4311033be0594cef6d6bff9c1a1470055ee9673a9d4e1b7aab21e13c1"}
Jul 21 06:18:17.708051 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:17.708016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:17.708207 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:17.708124    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:18.707579 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:18.707548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:18.708011 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:18.707552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:18.708011 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:18.707643    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xwf" podUID="bb89c953-016d-45de-9074-c9e3f1d2943a"
Jul 21 06:18:18.708011 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:18.707756    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zgblg" podUID="1dc25648-0845-4e8f-8eec-9a370cb306cb"
Jul 21 06:18:19.708053 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.708018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:19.708438 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:19.708146    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-thwmp" podUID="54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7"
Jul 21 06:18:19.949315 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.949106    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-56.ec2.internal" event="NodeReady"
Jul 21 06:18:19.949482 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.949428    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 06:18:19.987184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.987113    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s8z97"]
Jul 21 06:18:19.992355 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.992326    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6lq5t"]
Jul 21 06:18:19.992479 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.992444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:19.995190 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.995134    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 06:18:19.995315 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.995289    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 06:18:19.995520 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.995505    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5sp2g\""
Jul 21 06:18:19.995786 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.995771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6lq5t"
Jul 21 06:18:19.997898 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.997879    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 06:18:19.998000 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.997953    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 06:18:19.998065 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.997953    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rjnwl\""
Jul 21 06:18:19.998065 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:19.998038    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 06:18:20.000487 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.000352    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s8z97"]
Jul 21 06:18:20.003563 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.003525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6lq5t"]
Jul 21 06:18:20.101115 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.101085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/330c0482-8a09-475a-990e-01b83091f19b-config-volume\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.101245 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.101122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/330c0482-8a09-475a-990e-01b83091f19b-tmp-dir\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.101245 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.101172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmggg\" (UniqueName: \"kubernetes.io/projected/30b29ba6-dcbc-4db4-9109-baaafe62e0ab-kube-api-access-xmggg\") pod \"ingress-canary-6lq5t\" (UID: \"30b29ba6-dcbc-4db4-9109-baaafe62e0ab\") " pod="openshift-ingress-canary/ingress-canary-6lq5t"
Jul 21 06:18:20.101245 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.101210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9tsv\" (UniqueName: \"kubernetes.io/projected/330c0482-8a09-475a-990e-01b83091f19b-kube-api-access-k9tsv\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.101404 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.101273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.101404 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.101331    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b29ba6-dcbc-4db4-9109-baaafe62e0ab-cert\") pod \"ingress-canary-6lq5t\" (UID: \"30b29ba6-dcbc-4db4-9109-baaafe62e0ab\") " pod="openshift-ingress-canary/ingress-canary-6lq5t"
Jul 21 06:18:20.202457 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.202425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b29ba6-dcbc-4db4-9109-baaafe62e0ab-cert\") pod \"ingress-canary-6lq5t\" (UID: \"30b29ba6-dcbc-4db4-9109-baaafe62e0ab\") " pod="openshift-ingress-canary/ingress-canary-6lq5t"
Jul 21 06:18:20.202622 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.202497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/330c0482-8a09-475a-990e-01b83091f19b-config-volume\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.202893 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.202858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/330c0482-8a09-475a-990e-01b83091f19b-tmp-dir\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.203254 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.203232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/330c0482-8a09-475a-990e-01b83091f19b-tmp-dir\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.203387 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.203368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmggg\" (UniqueName: \"kubernetes.io/projected/30b29ba6-dcbc-4db4-9109-baaafe62e0ab-kube-api-access-xmggg\") pod \"ingress-canary-6lq5t\" (UID: \"30b29ba6-dcbc-4db4-9109-baaafe62e0ab\") " pod="openshift-ingress-canary/ingress-canary-6lq5t"
Jul 21 06:18:20.203458 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.203443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9tsv\" (UniqueName: \"kubernetes.io/projected/330c0482-8a09-475a-990e-01b83091f19b-kube-api-access-k9tsv\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.203506 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.203481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/330c0482-8a09-475a-990e-01b83091f19b-config-volume\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.203506 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.203491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.206279 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:20.203704    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 06:18:20.206279 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:20.203787    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls podName:330c0482-8a09-475a-990e-01b83091f19b nodeName:}" failed. No retries permitted until 2026-07-21 06:18:20.70376795 +0000 UTC m=+37.516511613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls") pod "dns-default-s8z97" (UID: "330c0482-8a09-475a-990e-01b83091f19b") : secret "dns-default-metrics-tls" not found
Jul 21 06:18:20.207967 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.207944    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30b29ba6-dcbc-4db4-9109-baaafe62e0ab-cert\") pod \"ingress-canary-6lq5t\" (UID: \"30b29ba6-dcbc-4db4-9109-baaafe62e0ab\") " pod="openshift-ingress-canary/ingress-canary-6lq5t"
Jul 21 06:18:20.212166 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.212142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9tsv\" (UniqueName: \"kubernetes.io/projected/330c0482-8a09-475a-990e-01b83091f19b-kube-api-access-k9tsv\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.213902 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.213877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmggg\" (UniqueName: \"kubernetes.io/projected/30b29ba6-dcbc-4db4-9109-baaafe62e0ab-kube-api-access-xmggg\") pod \"ingress-canary-6lq5t\" (UID: \"30b29ba6-dcbc-4db4-9109-baaafe62e0ab\") " pod="openshift-ingress-canary/ingress-canary-6lq5t"
Jul 21 06:18:20.314407 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.314331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6lq5t"
Jul 21 06:18:20.707384 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.707305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:20.707566 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:20.707412    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 06:18:20.707566 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.707484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:20.707566 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:20.707492    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls podName:330c0482-8a09-475a-990e-01b83091f19b nodeName:}" failed. No retries permitted until 2026-07-21 06:18:21.70747209 +0000 UTC m=+38.520215759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls") pod "dns-default-s8z97" (UID: "330c0482-8a09-475a-990e-01b83091f19b") : secret "dns-default-metrics-tls" not found
Jul 21 06:18:20.707747 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.707694    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:20.710223 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.710198    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 06:18:20.710600 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.710261    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 06:18:20.710600 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.710284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8684r\""
Jul 21 06:18:20.711319 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.711302    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rpb4\""
Jul 21 06:18:20.711427 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:20.711389    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 06:18:21.149861 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:21.149795    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6lq5t"]
Jul 21 06:18:21.153763 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:18:21.153736    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b29ba6_dcbc_4db4_9109_baaafe62e0ab.slice/crio-2f398101314dbcccddca7dcb031eb3c14e1570c7b3216207cf3114cf6fbce7f4 WatchSource:0}: Error finding container 2f398101314dbcccddca7dcb031eb3c14e1570c7b3216207cf3114cf6fbce7f4: Status 404 returned error can't find the container with id 2f398101314dbcccddca7dcb031eb3c14e1570c7b3216207cf3114cf6fbce7f4
Jul 21 06:18:21.708096 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:21.707887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:21.710774 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:21.710754    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 06:18:21.712463 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:21.712444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:21.712623 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:21.712608    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 06:18:21.712703 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:21.712665    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls podName:330c0482-8a09-475a-990e-01b83091f19b nodeName:}" failed. No retries permitted until 2026-07-21 06:18:23.71265251 +0000 UTC m=+40.525396158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls") pod "dns-default-s8z97" (UID: "330c0482-8a09-475a-990e-01b83091f19b") : secret "dns-default-metrics-tls" not found
Jul 21 06:18:21.956359 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:21.956327    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6lq5t" event={"ID":"30b29ba6-dcbc-4db4-9109-baaafe62e0ab","Type":"ContainerStarted","Data":"2f398101314dbcccddca7dcb031eb3c14e1570c7b3216207cf3114cf6fbce7f4"}
Jul 21 06:18:21.959403 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:21.959341    2577 generic.go:356] "Generic (PLEG): container finished" podID="3864ad44-6ed0-49fc-9844-64c3db7cc458" containerID="2f08525bf6b82fc0d1ca8d4664b56e89c1c15281c4200ff37b23738d1c3642f1" exitCode=0
Jul 21 06:18:21.959403 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:21.959393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerDied","Data":"2f08525bf6b82fc0d1ca8d4664b56e89c1c15281c4200ff37b23738d1c3642f1"}
Jul 21 06:18:22.965344 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:22.965311    2577 generic.go:356] "Generic (PLEG): container finished" podID="3864ad44-6ed0-49fc-9844-64c3db7cc458" containerID="aa4fbfb8bd742f0510301858cdc3e0138e0ec986b119dc24f95880f00644d808" exitCode=0
Jul 21 06:18:22.965767 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:22.965361    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerDied","Data":"aa4fbfb8bd742f0510301858cdc3e0138e0ec986b119dc24f95880f00644d808"}
Jul 21 06:18:23.748476 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:23.748443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:23.748622 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:23.748570    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 06:18:23.748622 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:23.748619    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls podName:330c0482-8a09-475a-990e-01b83091f19b nodeName:}" failed. No retries permitted until 2026-07-21 06:18:27.748606061 +0000 UTC m=+44.561349709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls") pod "dns-default-s8z97" (UID: "330c0482-8a09-475a-990e-01b83091f19b") : secret "dns-default-metrics-tls" not found
Jul 21 06:18:23.970821 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:23.970750    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" event={"ID":"3864ad44-6ed0-49fc-9844-64c3db7cc458","Type":"ContainerStarted","Data":"a4b0c70db77f894440c0ae495641f6a85afd6147c86ca2197e2d45dbd83338b4"}
Jul 21 06:18:23.972278 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:23.972254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6lq5t" event={"ID":"30b29ba6-dcbc-4db4-9109-baaafe62e0ab","Type":"ContainerStarted","Data":"040ad8aec7c8f3234cfd6cc7d9b13e1a9a74c7e82b24247ce6d9d3ee19284450"}
Jul 21 06:18:23.993394 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:23.993352    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kvbl7" podStartSLOduration=8.62329873 podStartE2EDuration="39.993308063s" totalImagesPullingTime="31.370009333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:23.991798836 +0000 UTC m=+40.804542505" watchObservedRunningTime="2026-07-21 06:18:23.993308063 +0000 UTC m=+40.806051733"
Jul 21 06:18:24.005693 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:24.005655    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6lq5t" podStartSLOduration=2.613772397 podStartE2EDuration="5.005643191s" totalImagesPullingTime="2.391870794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:24.005278521 +0000 UTC m=+40.818022193" watchObservedRunningTime="2026-07-21 06:18:24.005643191 +0000 UTC m=+40.818386887"
Jul 21 06:18:27.775556 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:27.775498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:27.775920 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:27.775637    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 06:18:27.775920 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:27.775694    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls podName:330c0482-8a09-475a-990e-01b83091f19b nodeName:}" failed. No retries permitted until 2026-07-21 06:18:35.775680262 +0000 UTC m=+52.588423910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls") pod "dns-default-s8z97" (UID: "330c0482-8a09-475a-990e-01b83091f19b") : secret "dns-default-metrics-tls" not found
Jul 21 06:18:35.829064 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:35.829029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:35.829496 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:35.829197    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 06:18:35.829496 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:18:35.829270    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls podName:330c0482-8a09-475a-990e-01b83091f19b nodeName:}" failed. No retries permitted until 2026-07-21 06:18:51.829253415 +0000 UTC m=+68.641997066 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls") pod "dns-default-s8z97" (UID: "330c0482-8a09-475a-990e-01b83091f19b") : secret "dns-default-metrics-tls" not found
Jul 21 06:18:36.027435 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.027390    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ltxfw"]
Jul 21 06:18:36.043456 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.043435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ltxfw"]
Jul 21 06:18:36.043557 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.043514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.046013 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.045994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 06:18:36.047140 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.047118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bg69l\""
Jul 21 06:18:36.047233 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.047188    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 06:18:36.047281 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.047189    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 06:18:36.047351 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.047335    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 06:18:36.130804 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.130730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-signing-key\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.130804 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.130780    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-signing-cabundle\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.130804 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.130803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rw5w\" (UniqueName: \"kubernetes.io/projected/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-kube-api-access-4rw5w\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.231691 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.231662    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rw5w\" (UniqueName: \"kubernetes.io/projected/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-kube-api-access-4rw5w\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.231804 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.231763    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-signing-key\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.231864 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.231811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-signing-cabundle\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.232431 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.232411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-signing-cabundle\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.235464 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.235447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-signing-key\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.239838 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.239822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rw5w\" (UniqueName: \"kubernetes.io/projected/a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a-kube-api-access-4rw5w\") pod \"service-ca-58598695f7-ltxfw\" (UID: \"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a\") " pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.352516 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.352495    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-ltxfw"
Jul 21 06:18:36.493134 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:36.493105    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-ltxfw"]
Jul 21 06:18:36.496235 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:18:36.496201    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b8ebf1_4c34_4b4b_aeb0_c9c7601f1a5a.slice/crio-2fc6427dffef54d09736ce9dc0afb035b224c8c68d5ea6083471934b9904d5a6 WatchSource:0}: Error finding container 2fc6427dffef54d09736ce9dc0afb035b224c8c68d5ea6083471934b9904d5a6: Status 404 returned error can't find the container with id 2fc6427dffef54d09736ce9dc0afb035b224c8c68d5ea6083471934b9904d5a6
Jul 21 06:18:37.002423 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:37.002394    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-ltxfw" event={"ID":"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a","Type":"ContainerStarted","Data":"2fc6427dffef54d09736ce9dc0afb035b224c8c68d5ea6083471934b9904d5a6"}
Jul 21 06:18:39.008686 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:39.008624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-ltxfw" event={"ID":"a3b8ebf1-4c34-4b4b-aeb0-c9c7601f1a5a","Type":"ContainerStarted","Data":"7d5f6147e1ee223fe9b8aff973400fb3e2afc4464102a909d5eb28bc85ec47c9"}
Jul 21 06:18:39.023959 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:39.023919    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-ltxfw" podStartSLOduration=0.763557089 podStartE2EDuration="3.023906409s" totalImagesPullingTime="2.26034932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:18:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:39.022506239 +0000 UTC m=+55.835249909" watchObservedRunningTime="2026-07-21 06:18:39.023906409 +0000 UTC m=+55.836650079"
Jul 21 06:18:45.957929 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:45.957898    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rg9sr"
Jul 21 06:18:48.514184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.514147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:48.514656 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.514198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:48.516769 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.516750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 06:18:48.517733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.517719    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 06:18:48.526780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.526757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7-original-pull-secret\") pod \"global-pull-secret-syncer-thwmp\" (UID: \"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7\") " pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:48.526899 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.526821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1dc25648-0845-4e8f-8eec-9a370cb306cb-metrics-certs\") pod \"network-metrics-daemon-zgblg\" (UID: \"1dc25648-0845-4e8f-8eec-9a370cb306cb\") " pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:48.615146 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.615118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:48.617625 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.617610    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 06:18:48.627196 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.627179    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8rpb4\""
Jul 21 06:18:48.627666 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.627654    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 06:18:48.635593 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.635580    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zgblg"
Jul 21 06:18:48.639015 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.638997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t5gv\" (UniqueName: \"kubernetes.io/projected/bb89c953-016d-45de-9074-c9e3f1d2943a-kube-api-access-5t5gv\") pod \"network-check-target-t5xwf\" (UID: \"bb89c953-016d-45de-9074-c9e3f1d2943a\") " pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:48.718036 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.718006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-thwmp"
Jul 21 06:18:48.758929 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.758892    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zgblg"]
Jul 21 06:18:48.762189 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:18:48.762165    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc25648_0845_4e8f_8eec_9a370cb306cb.slice/crio-e4fea4700eea28f454de77a8be83c6d3fc4a2e895a3d42bddedbd1cf4705c587 WatchSource:0}: Error finding container e4fea4700eea28f454de77a8be83c6d3fc4a2e895a3d42bddedbd1cf4705c587: Status 404 returned error can't find the container with id e4fea4700eea28f454de77a8be83c6d3fc4a2e895a3d42bddedbd1cf4705c587
Jul 21 06:18:48.841262 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.841233    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-thwmp"]
Jul 21 06:18:48.844300 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:18:48.844276    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c7c5e3_26b3_44b0_9f4f_0b5353e28cb7.slice/crio-df0769142b5e640b2e611546b29e5ef0d814ffc66254f8781c61c525358edb95 WatchSource:0}: Error finding container df0769142b5e640b2e611546b29e5ef0d814ffc66254f8781c61c525358edb95: Status 404 returned error can't find the container with id df0769142b5e640b2e611546b29e5ef0d814ffc66254f8781c61c525358edb95
Jul 21 06:18:48.920979 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.920958    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8684r\""
Jul 21 06:18:48.928901 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:48.928886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:49.032329 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:49.032249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-thwmp" event={"ID":"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7","Type":"ContainerStarted","Data":"df0769142b5e640b2e611546b29e5ef0d814ffc66254f8781c61c525358edb95"}
Jul 21 06:18:49.033590 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:49.033566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zgblg" event={"ID":"1dc25648-0845-4e8f-8eec-9a370cb306cb","Type":"ContainerStarted","Data":"e4fea4700eea28f454de77a8be83c6d3fc4a2e895a3d42bddedbd1cf4705c587"}
Jul 21 06:18:49.050564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:49.050520    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5xwf"]
Jul 21 06:18:49.053677 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:18:49.053658    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb89c953_016d_45de_9074_c9e3f1d2943a.slice/crio-26a461a26378231f300fb34ec298fb0581104dad4c3bd559d822631b26411124 WatchSource:0}: Error finding container 26a461a26378231f300fb34ec298fb0581104dad4c3bd559d822631b26411124: Status 404 returned error can't find the container with id 26a461a26378231f300fb34ec298fb0581104dad4c3bd559d822631b26411124
Jul 21 06:18:50.037838 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:50.037806    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5xwf" event={"ID":"bb89c953-016d-45de-9074-c9e3f1d2943a","Type":"ContainerStarted","Data":"26a461a26378231f300fb34ec298fb0581104dad4c3bd559d822631b26411124"}
Jul 21 06:18:51.043109 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:51.043071    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zgblg" event={"ID":"1dc25648-0845-4e8f-8eec-9a370cb306cb","Type":"ContainerStarted","Data":"887846ec626333b1db481f019cd80ca8824304737b022bda1051279f043f46ac"}
Jul 21 06:18:51.043567 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:51.043137    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zgblg" event={"ID":"1dc25648-0845-4e8f-8eec-9a370cb306cb","Type":"ContainerStarted","Data":"057bfc06327966abfa3b09c931524c44ae005be2bff700d384d1a15198bddd43"}
Jul 21 06:18:51.059922 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:51.059870    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zgblg" podStartSLOduration=65.868465872 podStartE2EDuration="1m7.059852163s" totalImagesPullingTime="1.191386291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:51.05861573 +0000 UTC m=+67.871359402" watchObservedRunningTime="2026-07-21 06:18:51.059852163 +0000 UTC m=+67.872595835"
Jul 21 06:18:51.837957 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:51.837914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:51.840700 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:51.840671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/330c0482-8a09-475a-990e-01b83091f19b-metrics-tls\") pod \"dns-default-s8z97\" (UID: \"330c0482-8a09-475a-990e-01b83091f19b\") " pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:52.110280 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:52.110200    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5sp2g\""
Jul 21 06:18:52.118421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:52.118395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:54.272059 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:54.271992    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s8z97"]
Jul 21 06:18:54.274769 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:18:54.274747    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod330c0482_8a09_475a_990e_01b83091f19b.slice/crio-583e966a81ebfe2ad3d20c6011e5991fe7bb74466683ce3366f984911a5a76ca WatchSource:0}: Error finding container 583e966a81ebfe2ad3d20c6011e5991fe7bb74466683ce3366f984911a5a76ca: Status 404 returned error can't find the container with id 583e966a81ebfe2ad3d20c6011e5991fe7bb74466683ce3366f984911a5a76ca
Jul 21 06:18:55.056193 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:55.056141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-thwmp" event={"ID":"54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7","Type":"ContainerStarted","Data":"5173166262baa3aeefaea3f6b319d28b2331c32986c6e3e81bf4272fb14f033e"}
Jul 21 06:18:55.058276 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:55.058244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5xwf" event={"ID":"bb89c953-016d-45de-9074-c9e3f1d2943a","Type":"ContainerStarted","Data":"391dd8a7ec22409435d2bdab180bb7d438780b71218804d31668351794fc9c8f"}
Jul 21 06:18:55.058418 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:55.058305    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:18:55.059415 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:55.059387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8z97" event={"ID":"330c0482-8a09-475a-990e-01b83091f19b","Type":"ContainerStarted","Data":"583e966a81ebfe2ad3d20c6011e5991fe7bb74466683ce3366f984911a5a76ca"}
Jul 21 06:18:55.086641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:55.086594    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t5xwf" podStartSLOduration=65.985948233 podStartE2EDuration="1m11.086577238s" totalImagesPullingTime="5.100629005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:55.086399615 +0000 UTC m=+71.899143285" watchObservedRunningTime="2026-07-21 06:18:55.086577238 +0000 UTC m=+71.899320909"
Jul 21 06:18:55.086875 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:55.086851    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-thwmp" podStartSLOduration=65.78559908 podStartE2EDuration="1m11.086843149s" totalImagesPullingTime="5.301244069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:17:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:55.072561898 +0000 UTC m=+71.885305562" watchObservedRunningTime="2026-07-21 06:18:55.086843149 +0000 UTC m=+71.899586798"
Jul 21 06:18:56.066386 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:56.066352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8z97" event={"ID":"330c0482-8a09-475a-990e-01b83091f19b","Type":"ContainerStarted","Data":"903861f13051fd7a1649a5f98effd7cfd7f751dfcdc9cfb96e37ff9fa84182b6"}
Jul 21 06:18:56.066769 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:56.066404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s8z97" event={"ID":"330c0482-8a09-475a-990e-01b83091f19b","Type":"ContainerStarted","Data":"5082dff97881fb48668102f78ecd7a6ba8cd375ee325e26fa024bcc4d458b154"}
Jul 21 06:18:56.082793 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:56.082751    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s8z97" podStartSLOduration=35.608910843 podStartE2EDuration="37.082736348s" totalImagesPullingTime="1.473825505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:56.081792797 +0000 UTC m=+72.894536468" watchObservedRunningTime="2026-07-21 06:18:56.082736348 +0000 UTC m=+72.895480018"
Jul 21 06:18:57.069932 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:57.069901    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s8z97"
Jul 21 06:18:58.352847 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.352811    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b6948bd64-7zfnp"]
Jul 21 06:18:58.355637 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.355620    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.358220 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.358198    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 06:18:58.358352 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.358257    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 06:18:58.358352 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.358324    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 06:18:58.358620 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.358582    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 06:18:58.358690 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.358641    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 06:18:58.359403 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.359386    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 06:18:58.359491 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.359390    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wv47f\""
Jul 21 06:18:58.369663 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.369638    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b6948bd64-7zfnp"]
Jul 21 06:18:58.480645 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.480617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-default-certificate\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.480645 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.480646    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9f9p\" (UniqueName: \"kubernetes.io/projected/34287f05-4dc0-49e8-bd95-719ca9e8f580-kube-api-access-g9f9p\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.480801 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.480669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34287f05-4dc0-49e8-bd95-719ca9e8f580-service-ca-bundle\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.480801 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.480715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-metrics-certs\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.480801 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.480762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-stats-auth\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.484945 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.484926    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-fzwlk"]
Jul 21 06:18:58.487570 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.487556    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fzwlk"
Jul 21 06:18:58.489956 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.489937    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zwzgw\""
Jul 21 06:18:58.490054 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.490007    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 06:18:58.490229 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.490212    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 06:18:58.499564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.499525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fzwlk"]
Jul 21 06:18:58.581332 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.581306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-default-certificate\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.581432 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.581335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9f9p\" (UniqueName: \"kubernetes.io/projected/34287f05-4dc0-49e8-bd95-719ca9e8f580-kube-api-access-g9f9p\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.581432 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.581357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34287f05-4dc0-49e8-bd95-719ca9e8f580-service-ca-bundle\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.581432 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.581374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-metrics-certs\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.581432 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.581391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzs66\" (UniqueName: \"kubernetes.io/projected/b7654c73-3579-4c49-b969-7945805d2a5a-kube-api-access-wzs66\") pod \"downloads-5bc67dcd46-fzwlk\" (UID: \"b7654c73-3579-4c49-b969-7945805d2a5a\") " pod="openshift-console/downloads-5bc67dcd46-fzwlk"
Jul 21 06:18:58.581432 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.581415    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-stats-auth\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.582113 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.582033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/34287f05-4dc0-49e8-bd95-719ca9e8f580-service-ca-bundle\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.583912 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.583884    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-stats-auth\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.584003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.583938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-metrics-certs\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.584003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.583983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/34287f05-4dc0-49e8-bd95-719ca9e8f580-default-certificate\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.592812 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.592792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9f9p\" (UniqueName: \"kubernetes.io/projected/34287f05-4dc0-49e8-bd95-719ca9e8f580-kube-api-access-g9f9p\") pod \"router-default-6b6948bd64-7zfnp\" (UID: \"34287f05-4dc0-49e8-bd95-719ca9e8f580\") " pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.664791 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.664735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:58.681814 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.681792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzs66\" (UniqueName: \"kubernetes.io/projected/b7654c73-3579-4c49-b969-7945805d2a5a-kube-api-access-wzs66\") pod \"downloads-5bc67dcd46-fzwlk\" (UID: \"b7654c73-3579-4c49-b969-7945805d2a5a\") " pod="openshift-console/downloads-5bc67dcd46-fzwlk"
Jul 21 06:18:58.691311 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.691291    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzs66\" (UniqueName: \"kubernetes.io/projected/b7654c73-3579-4c49-b969-7945805d2a5a-kube-api-access-wzs66\") pod \"downloads-5bc67dcd46-fzwlk\" (UID: \"b7654c73-3579-4c49-b969-7945805d2a5a\") " pod="openshift-console/downloads-5bc67dcd46-fzwlk"
Jul 21 06:18:58.790255 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.790103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b6948bd64-7zfnp"]
Jul 21 06:18:58.792621 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:18:58.792597    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34287f05_4dc0_49e8_bd95_719ca9e8f580.slice/crio-40102e00491b68c4d36488d91d3607ec39968f1ec46f81c7c08ce132dd428475 WatchSource:0}: Error finding container 40102e00491b68c4d36488d91d3607ec39968f1ec46f81c7c08ce132dd428475: Status 404 returned error can't find the container with id 40102e00491b68c4d36488d91d3607ec39968f1ec46f81c7c08ce132dd428475
Jul 21 06:18:58.796385 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.796365    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-fzwlk"
Jul 21 06:18:58.925775 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:58.925751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-fzwlk"]
Jul 21 06:18:58.928000 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:18:58.927975    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7654c73_3579_4c49_b969_7945805d2a5a.slice/crio-75712e8fa834b2c53a9f4247c3f53776396904041f27a45c9bcf4973c0dd3d21 WatchSource:0}: Error finding container 75712e8fa834b2c53a9f4247c3f53776396904041f27a45c9bcf4973c0dd3d21: Status 404 returned error can't find the container with id 75712e8fa834b2c53a9f4247c3f53776396904041f27a45c9bcf4973c0dd3d21
Jul 21 06:18:59.077203 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:59.077164    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fzwlk" event={"ID":"b7654c73-3579-4c49-b969-7945805d2a5a","Type":"ContainerStarted","Data":"75712e8fa834b2c53a9f4247c3f53776396904041f27a45c9bcf4973c0dd3d21"}
Jul 21 06:18:59.078661 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:59.078638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b6948bd64-7zfnp" event={"ID":"34287f05-4dc0-49e8-bd95-719ca9e8f580","Type":"ContainerStarted","Data":"29fa6419a61fdc7e3799d4efc34ad5075e2baa4fe55a7ab64dc7fdb177861cf1"}
Jul 21 06:18:59.078772 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:59.078675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b6948bd64-7zfnp" event={"ID":"34287f05-4dc0-49e8-bd95-719ca9e8f580","Type":"ContainerStarted","Data":"40102e00491b68c4d36488d91d3607ec39968f1ec46f81c7c08ce132dd428475"}
Jul 21 06:18:59.096249 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:59.096207    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b6948bd64-7zfnp" podStartSLOduration=1.096190665 podStartE2EDuration="1.096190665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:18:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:18:59.095404131 +0000 UTC m=+75.908147801" watchObservedRunningTime="2026-07-21 06:18:59.096190665 +0000 UTC m=+75.908934334"
Jul 21 06:18:59.665261 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:59.665220    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:18:59.668029 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:18:59.668006    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:19:00.082991 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:00.082960    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:19:00.084306 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:00.084285    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b6948bd64-7zfnp"
Jul 21 06:19:04.501154 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.501117    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qk2hx"]
Jul 21 06:19:04.504417 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.504397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.506964 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.506942    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 06:19:04.507250 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.507229    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7g9pq\""
Jul 21 06:19:04.508389 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.508099    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 06:19:04.508389 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.508189    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 06:19:04.508389 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.508306    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 06:19:04.514365 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.514346    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qk2hx"]
Jul 21 06:19:04.627820 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.627786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-data-volume\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.627968 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.627842    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk4wk\" (UniqueName: \"kubernetes.io/projected/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-api-access-tk4wk\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.627968 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.627955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-crio-socket\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.628068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.627992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.628068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.628029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.729043 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.729019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-crio-socket\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.729184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.729049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.729184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.729077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.729184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.729110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-data-volume\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.729184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.729142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk4wk\" (UniqueName: \"kubernetes.io/projected/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-api-access-tk4wk\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.729184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.729143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-crio-socket\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.729403 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:04.729227    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 06:19:04.729403 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:04.729288    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:05.229268367 +0000 UTC m=+82.042012017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : configmap "kube-rbac-proxy" not found
Jul 21 06:19:04.729403 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:04.729357    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:04.729403 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:04.729390    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:05.229377925 +0000 UTC m=+82.042121573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:04.729728 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.729711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-data-volume\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:04.737354 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:04.737334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk4wk\" (UniqueName: \"kubernetes.io/projected/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-api-access-tk4wk\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:05.231945 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:05.231819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:05.231945 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:05.231856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:05.231945 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:05.231940    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 06:19:05.232209 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:05.231984    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:05.232209 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:05.232003    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:06.231985615 +0000 UTC m=+83.044729263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : configmap "kube-rbac-proxy" not found
Jul 21 06:19:05.232209 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:05.232037    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:06.232023202 +0000 UTC m=+83.044766850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:05.909739 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:05.909705    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s8z97_330c0482-8a09-475a-990e-01b83091f19b/dns/0.log"
Jul 21 06:19:06.094867 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.094827    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s8z97_330c0482-8a09-475a-990e-01b83091f19b/kube-rbac-proxy/0.log"
Jul 21 06:19:06.239327 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.239233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:06.239327 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.239301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:06.239570 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:06.239375    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 06:19:06.239570 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:06.239405    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:06.239570 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:06.239442    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:08.239420835 +0000 UTC m=+85.052164497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : configmap "kube-rbac-proxy" not found
Jul 21 06:19:06.239570 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:06.239467    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:08.239449684 +0000 UTC m=+85.052193347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:06.294557 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.294517    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d95c59659-6rsp9"]
Jul 21 06:19:06.298961 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.298934    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nl56_ea99fd85-6838-44e4-b591-a8f1f6489598/dns-node-resolver/0.log"
Jul 21 06:19:06.300109 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.300084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.304349 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.304327    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 06:19:06.304468 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.304327    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 06:19:06.304906 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.304646    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 06:19:06.304906 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.304699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zcncg\""
Jul 21 06:19:06.304906 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.304799    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 06:19:06.304906 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.304826    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 06:19:06.306430 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.306412    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d95c59659-6rsp9"]
Jul 21 06:19:06.340259 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.340225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-kube-api-access-pnkpn\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.340364 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.340277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-config\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.340364 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.340308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-oauth-config\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.340462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.340372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-serving-cert\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.340462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.340404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-service-ca\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.340462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.340431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-oauth-serving-cert\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.441684 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.441660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-kube-api-access-pnkpn\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.441816 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.441713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-config\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.441816 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.441740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-oauth-config\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.441816 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.441780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-serving-cert\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.441816 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.441805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-service-ca\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.442023 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.441829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-oauth-serving-cert\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.442586 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.442502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-oauth-serving-cert\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.442586 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.442504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-config\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.442748 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.442722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-service-ca\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.445221 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.445176    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-oauth-config\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.445480 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.445462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-serving-cert\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.449529 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.449512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-kube-api-access-pnkpn\") pod \"console-5d95c59659-6rsp9\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") " pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.612079 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.612052    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:06.752758 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:06.752724    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d95c59659-6rsp9"]
Jul 21 06:19:06.755408 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:19:06.755384    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e98f7e8_1ea5_4a21_b0e4_8108b243b7f0.slice/crio-77557c7e016947c6b66c74e4dbbeec45b4a50a68231540590b18ea7d86b87552 WatchSource:0}: Error finding container 77557c7e016947c6b66c74e4dbbeec45b4a50a68231540590b18ea7d86b87552: Status 404 returned error can't find the container with id 77557c7e016947c6b66c74e4dbbeec45b4a50a68231540590b18ea7d86b87552
Jul 21 06:19:07.075178 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.075155    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s8z97"
Jul 21 06:19:07.108529 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.108494    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d95c59659-6rsp9" event={"ID":"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0","Type":"ContainerStarted","Data":"77557c7e016947c6b66c74e4dbbeec45b4a50a68231540590b18ea7d86b87552"}
Jul 21 06:19:07.218470 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.218431    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"]
Jul 21 06:19:07.222956 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.222929    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.225471 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.225432    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 21 06:19:07.225694 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.225595    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 06:19:07.225694 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.225630    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 21 06:19:07.225694 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.225686    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9fvlk\""
Jul 21 06:19:07.225887 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.225760    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 06:19:07.225887 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.225762    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 06:19:07.228893 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.228871    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"]
Jul 21 06:19:07.350222 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.350133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.350222 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.350206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj76p\" (UniqueName: \"kubernetes.io/projected/dae1a2c1-85bd-4423-ba07-20905ac689b0-kube-api-access-cj76p\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.350427 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.350293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.350427 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.350332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dae1a2c1-85bd-4423-ba07-20905ac689b0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.451686 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.451502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj76p\" (UniqueName: \"kubernetes.io/projected/dae1a2c1-85bd-4423-ba07-20905ac689b0-kube-api-access-cj76p\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.451686 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.451618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.451686 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.451655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dae1a2c1-85bd-4423-ba07-20905ac689b0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.452014 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.451695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.452014 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:07.451816    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 21 06:19:07.452014 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:07.451889    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-tls podName:dae1a2c1-85bd-4423-ba07-20905ac689b0 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:07.951869942 +0000 UTC m=+84.764613595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-b9mgc" (UID: "dae1a2c1-85bd-4423-ba07-20905ac689b0") : secret "prometheus-operator-tls" not found
Jul 21 06:19:07.452860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.452807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dae1a2c1-85bd-4423-ba07-20905ac689b0-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.455577 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.455529    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.462674 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.462652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj76p\" (UniqueName: \"kubernetes.io/projected/dae1a2c1-85bd-4423-ba07-20905ac689b0-kube-api-access-cj76p\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.494790 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.494770    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wv82_2872afe6-bbd2-4ff1-849b-11ca538c3a14/node-ca/0.log"
Jul 21 06:19:07.894590 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.894558    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6948bd64-7zfnp_34287f05-4dc0-49e8-bd95-719ca9e8f580/router/0.log"
Jul 21 06:19:07.955768 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.955344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:07.958307 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:07.958286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/dae1a2c1-85bd-4423-ba07-20905ac689b0-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-b9mgc\" (UID: \"dae1a2c1-85bd-4423-ba07-20905ac689b0\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:08.094058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:08.094031    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lq5t_30b29ba6-dcbc-4db4-9109-baaafe62e0ab/serve-healthcheck-canary/0.log"
Jul 21 06:19:08.134865 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:08.134839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"
Jul 21 06:19:08.258512 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:08.258077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:08.258512 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:08.258164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:08.258512 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:08.258267    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 06:19:08.258512 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:08.258333    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:12.258313851 +0000 UTC m=+89.071057519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : configmap "kube-rbac-proxy" not found
Jul 21 06:19:08.258512 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:08.258341    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:08.258512 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:08.258379    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:12.258368257 +0000 UTC m=+89.071111905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:08.297982 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:08.297700    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc"]
Jul 21 06:19:08.301292 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:19:08.301267    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae1a2c1_85bd_4423_ba07_20905ac689b0.slice/crio-1460415ed1745e45a81bd6ea339cdfada07be3bcc8b35675d8d043f155b9b29c WatchSource:0}: Error finding container 1460415ed1745e45a81bd6ea339cdfada07be3bcc8b35675d8d043f155b9b29c: Status 404 returned error can't find the container with id 1460415ed1745e45a81bd6ea339cdfada07be3bcc8b35675d8d043f155b9b29c
Jul 21 06:19:09.118637 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:09.118597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc" event={"ID":"dae1a2c1-85bd-4423-ba07-20905ac689b0","Type":"ContainerStarted","Data":"1460415ed1745e45a81bd6ea339cdfada07be3bcc8b35675d8d043f155b9b29c"}
Jul 21 06:19:12.294246 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:12.294211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:12.294756 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:12.294281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:12.294756 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:12.294347    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 06:19:12.294756 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:12.294411    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:12.294756 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:12.294431    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:20.294413635 +0000 UTC m=+97.107157285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : configmap "kube-rbac-proxy" not found
Jul 21 06:19:12.294756 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:19:12.294473    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls podName:bd28b7ed-2e4c-426d-ba6f-cc5a89975621 nodeName:}" failed. No retries permitted until 2026-07-21 06:19:20.294454466 +0000 UTC m=+97.107198116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qk2hx" (UID: "bd28b7ed-2e4c-426d-ba6f-cc5a89975621") : secret "insights-runtime-extractor-tls" not found
Jul 21 06:19:18.151977 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.151937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc" event={"ID":"dae1a2c1-85bd-4423-ba07-20905ac689b0","Type":"ContainerStarted","Data":"030241e65624102bcf16b3572701a18b6efa2b465fd22383db59fd8b27b3487c"}
Jul 21 06:19:18.152489 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.152002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc" event={"ID":"dae1a2c1-85bd-4423-ba07-20905ac689b0","Type":"ContainerStarted","Data":"4238d7bd2c2430e8f4cf3078b49af9f645e9f272a820b38fea87bbb059897176"}
Jul 21 06:19:18.154511 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.154077    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-fzwlk" event={"ID":"b7654c73-3579-4c49-b969-7945805d2a5a","Type":"ContainerStarted","Data":"c9c3d738632786fe7255d8bef66b9b125e428f00b83aa16665133a948018dc1b"}
Jul 21 06:19:18.154511 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.154235    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-fzwlk"
Jul 21 06:19:18.156515 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.156085    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d95c59659-6rsp9" event={"ID":"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0","Type":"ContainerStarted","Data":"9b57f8c266034426517639c5a54d75df894881b6c047f26fd35c310df83d148c"}
Jul 21 06:19:18.168391 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.168338    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-b9mgc" podStartSLOduration=2.197259884 podStartE2EDuration="11.168300115s" totalImagesPullingTime="8.971040231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:19:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:18.167243166 +0000 UTC m=+94.979986837" watchObservedRunningTime="2026-07-21 06:19:18.168300115 +0000 UTC m=+94.981043783"
Jul 21 06:19:18.170742 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.170708    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-fzwlk"
Jul 21 06:19:18.186676 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.186635    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d95c59659-6rsp9" podStartSLOduration=1.7137546559999999 podStartE2EDuration="12.186622045s" totalImagesPullingTime="10.472867389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:18.185730414 +0000 UTC m=+94.998474085" watchObservedRunningTime="2026-07-21 06:19:18.186622045 +0000 UTC m=+94.999365695"
Jul 21 06:19:18.201109 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:18.201066    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-fzwlk" podStartSLOduration=1.900593965 podStartE2EDuration="20.201049399s" totalImagesPullingTime="18.300455434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:18.199755484 +0000 UTC m=+95.012499158" watchObservedRunningTime="2026-07-21 06:19:18.201049399 +0000 UTC m=+95.013793070"
Jul 21 06:19:19.569682 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.569647    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rrlrc"]
Jul 21 06:19:19.606771 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.606739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.609675 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.609265    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 06:19:19.609675 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.609388    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hsg87\""
Jul 21 06:19:19.609675 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.609499    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 06:19:19.609675 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.609600    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 06:19:19.757507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-sys\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.757708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.757708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-wtmp\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.757708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f3879b-2385-4061-8c97-ee6848828496-metrics-client-ca\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.757708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-root\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.757914 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.757914 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-textfile\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.757914 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-tls\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.758054 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.757931    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w89xv\" (UniqueName: \"kubernetes.io/projected/05f3879b-2385-4061-8c97-ee6848828496-kube-api-access-w89xv\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.858727 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-tls\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.858727 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89xv\" (UniqueName: \"kubernetes.io/projected/05f3879b-2385-4061-8c97-ee6848828496-kube-api-access-w89xv\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.858952 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-sys\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.858952 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.858952 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-wtmp\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.858952 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f3879b-2385-4061-8c97-ee6848828496-metrics-client-ca\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.858952 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858867    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-root\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.858952 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.859255 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.858969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-textfile\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.859255 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.859179    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-wtmp\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.859357 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.859276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-textfile\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.859504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.859479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-sys\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.859684 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.859665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/05f3879b-2385-4061-8c97-ee6848828496-root\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.859861 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.859837    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05f3879b-2385-4061-8c97-ee6848828496-metrics-client-ca\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.860337 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.860316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-accelerators-collector-config\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.861985 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.861962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-tls\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.862335 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.862300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05f3879b-2385-4061-8c97-ee6848828496-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.866837 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.866799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w89xv\" (UniqueName: \"kubernetes.io/projected/05f3879b-2385-4061-8c97-ee6848828496-kube-api-access-w89xv\") pod \"node-exporter-rrlrc\" (UID: \"05f3879b-2385-4061-8c97-ee6848828496\") " pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.919848 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:19.919816    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rrlrc"
Jul 21 06:19:19.960665 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:19:19.960594    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05f3879b_2385_4061_8c97_ee6848828496.slice/crio-1bd8235979b0c3fda1db1774476f6e1e1ddbb5a581f8643ca67a4471ec3d43ed WatchSource:0}: Error finding container 1bd8235979b0c3fda1db1774476f6e1e1ddbb5a581f8643ca67a4471ec3d43ed: Status 404 returned error can't find the container with id 1bd8235979b0c3fda1db1774476f6e1e1ddbb5a581f8643ca67a4471ec3d43ed
Jul 21 06:19:20.165460 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:20.165379    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrlrc" event={"ID":"05f3879b-2385-4061-8c97-ee6848828496","Type":"ContainerStarted","Data":"1bd8235979b0c3fda1db1774476f6e1e1ddbb5a581f8643ca67a4471ec3d43ed"}
Jul 21 06:19:20.363638 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:20.363599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:20.363818 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:20.363686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:20.364279 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:20.364245    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:20.366624 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:20.366596    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd28b7ed-2e4c-426d-ba6f-cc5a89975621-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qk2hx\" (UID: \"bd28b7ed-2e4c-426d-ba6f-cc5a89975621\") " pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:20.417720 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:20.417646    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qk2hx"
Jul 21 06:19:20.608944 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:20.608905    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qk2hx"]
Jul 21 06:19:20.611998 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:19:20.611971    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd28b7ed_2e4c_426d_ba6f_cc5a89975621.slice/crio-e74014d5ed30d1d1f3745e0c171cc7f0569313130df12c3bd95cb72bfd6e8f80 WatchSource:0}: Error finding container e74014d5ed30d1d1f3745e0c171cc7f0569313130df12c3bd95cb72bfd6e8f80: Status 404 returned error can't find the container with id e74014d5ed30d1d1f3745e0c171cc7f0569313130df12c3bd95cb72bfd6e8f80
Jul 21 06:19:21.171393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:21.171360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk2hx" event={"ID":"bd28b7ed-2e4c-426d-ba6f-cc5a89975621","Type":"ContainerStarted","Data":"e74014d5ed30d1d1f3745e0c171cc7f0569313130df12c3bd95cb72bfd6e8f80"}
Jul 21 06:19:22.178606 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:22.178282    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrlrc" event={"ID":"05f3879b-2385-4061-8c97-ee6848828496","Type":"ContainerDied","Data":"b5c55a673b358c905c7d7104d09d50f7731fea113c228936e3146c7574409746"}
Jul 21 06:19:22.179177 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:22.178932    2577 generic.go:356] "Generic (PLEG): container finished" podID="05f3879b-2385-4061-8c97-ee6848828496" containerID="b5c55a673b358c905c7d7104d09d50f7731fea113c228936e3146c7574409746" exitCode=0
Jul 21 06:19:23.173594 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.173561    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d95c59659-6rsp9"]
Jul 21 06:19:23.203146 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.203110    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrlrc" event={"ID":"05f3879b-2385-4061-8c97-ee6848828496","Type":"ContainerStarted","Data":"f7c38854a580deede4e5cc3258fa0dbf51ff2eef7af52f6b056dffcc2346758f"}
Jul 21 06:19:23.203653 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.203204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rrlrc" event={"ID":"05f3879b-2385-4061-8c97-ee6848828496","Type":"ContainerStarted","Data":"8255beb90a03cc01be04d7151ac70dd2a44e1a3a0b9894e2c8f714a218f6161a"}
Jul 21 06:19:23.223027 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.222965    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rrlrc" podStartSLOduration=2.433585061 podStartE2EDuration="4.222801095s" totalImagesPullingTime="1.670596616s" totalInitContainerRuntime="118.619418ms" isStatefulPod=true podCreationTimestamp="2026-07-21 06:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:23.2220537 +0000 UTC m=+100.034797371" watchObservedRunningTime="2026-07-21 06:19:23.222801095 +0000 UTC m=+100.035544766"
Jul 21 06:19:23.908707 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.908677    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8cf9cc889-jn4tt"]
Jul 21 06:19:23.945385 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.945350    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8cf9cc889-jn4tt"]
Jul 21 06:19:23.945577 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.945481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:23.950566 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.949487    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 06:19:23.950566 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.949749    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 06:19:23.950566 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.950041    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 06:19:23.950566 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.950055    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ghfg9\""
Jul 21 06:19:23.952689 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.951172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cj284386tgm6i\""
Jul 21 06:19:23.952689 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:23.951401    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 06:19:24.102184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.102095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4badf439-acfd-4c04-864e-581587ebb5b0-metrics-server-audit-profiles\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.102184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.102158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brq4x\" (UniqueName: \"kubernetes.io/projected/4badf439-acfd-4c04-864e-581587ebb5b0-kube-api-access-brq4x\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.102508 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.102192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badf439-acfd-4c04-864e-581587ebb5b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.102508 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.102225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4badf439-acfd-4c04-864e-581587ebb5b0-audit-log\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.102508 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.102263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-client-ca-bundle\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.102508 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.102288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-secret-metrics-server-client-certs\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.102508 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.102313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-secret-metrics-server-tls\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.203295 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.203254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4badf439-acfd-4c04-864e-581587ebb5b0-metrics-server-audit-profiles\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.203418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brq4x\" (UniqueName: \"kubernetes.io/projected/4badf439-acfd-4c04-864e-581587ebb5b0-kube-api-access-brq4x\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.203515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badf439-acfd-4c04-864e-581587ebb5b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.203584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4badf439-acfd-4c04-864e-581587ebb5b0-audit-log\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.203634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-client-ca-bundle\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.203664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-secret-metrics-server-client-certs\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.203792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-secret-metrics-server-tls\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.204084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4badf439-acfd-4c04-864e-581587ebb5b0-audit-log\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.204338    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4badf439-acfd-4c04-864e-581587ebb5b0-metrics-server-audit-profiles\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.204421 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.204389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4badf439-acfd-4c04-864e-581587ebb5b0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.207326 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.207299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-secret-metrics-server-tls\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.208067 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.208004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-client-ca-bundle\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.211430 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.211406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4badf439-acfd-4c04-864e-581587ebb5b0-secret-metrics-server-client-certs\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.212217 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.212175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brq4x\" (UniqueName: \"kubernetes.io/projected/4badf439-acfd-4c04-864e-581587ebb5b0-kube-api-access-brq4x\") pod \"metrics-server-8cf9cc889-jn4tt\" (UID: \"4badf439-acfd-4c04-864e-581587ebb5b0\") " pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.260014 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.259988    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:24.329766 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.329728    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"]
Jul 21 06:19:24.363563 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.363443    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"]
Jul 21 06:19:24.363728 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.363605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:24.366443 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.366251    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 21 06:19:24.366796 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.366773    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2w7j2\""
Jul 21 06:19:24.466002 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.465957    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8cf9cc889-jn4tt"]
Jul 21 06:19:24.507020 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.506983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/502f1f59-7056-4915-8ed3-cdfeba2a880e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-pq2tt\" (UID: \"502f1f59-7056-4915-8ed3-cdfeba2a880e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:24.507159 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.507056    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw8gz\" (UniqueName: \"kubernetes.io/projected/502f1f59-7056-4915-8ed3-cdfeba2a880e-kube-api-access-lw8gz\") pod \"monitoring-plugin-7b7b7bc8bf-pq2tt\" (UID: \"502f1f59-7056-4915-8ed3-cdfeba2a880e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:24.607827 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.607749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw8gz\" (UniqueName: \"kubernetes.io/projected/502f1f59-7056-4915-8ed3-cdfeba2a880e-kube-api-access-lw8gz\") pod \"monitoring-plugin-7b7b7bc8bf-pq2tt\" (UID: \"502f1f59-7056-4915-8ed3-cdfeba2a880e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:24.607976 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.607840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/502f1f59-7056-4915-8ed3-cdfeba2a880e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-pq2tt\" (UID: \"502f1f59-7056-4915-8ed3-cdfeba2a880e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:24.611030 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.610998    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/502f1f59-7056-4915-8ed3-cdfeba2a880e-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-pq2tt\" (UID: \"502f1f59-7056-4915-8ed3-cdfeba2a880e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:24.616778 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.616729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw8gz\" (UniqueName: \"kubernetes.io/projected/502f1f59-7056-4915-8ed3-cdfeba2a880e-kube-api-access-lw8gz\") pod \"monitoring-plugin-7b7b7bc8bf-pq2tt\" (UID: \"502f1f59-7056-4915-8ed3-cdfeba2a880e\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:24.683571 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.682991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:24.750936 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.749557    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"]
Jul 21 06:19:24.788256 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.788219    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"]
Jul 21 06:19:24.788462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.788397    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:24.792055 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.791195    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 06:19:24.792055 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.791320    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 06:19:24.792055 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.791422    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 06:19:24.792055 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.791638    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 06:19:24.792055 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.791690    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 06:19:24.792055 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.791898    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jkchq\""
Jul 21 06:19:24.798104 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.798071    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 06:19:24.910578 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.910452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-telemeter-client-tls\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:24.910746 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.910572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:24.910746 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.910641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-metrics-client-ca\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:24.910746 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.910674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p82tw\" (UniqueName: \"kubernetes.io/projected/52b05a59-dba0-40f7-9e72-373dafc4bce6-kube-api-access-p82tw\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:24.910746 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.910700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-serving-certs-ca-bundle\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:24.910746 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.910729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-secret-telemeter-client\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:24.910949 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.910752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-federate-client-tls\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:24.910949 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:24.910783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.011985 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.011889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-metrics-client-ca\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.011985 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.011938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p82tw\" (UniqueName: \"kubernetes.io/projected/52b05a59-dba0-40f7-9e72-373dafc4bce6-kube-api-access-p82tw\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.011985 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.011967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-serving-certs-ca-bundle\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.013612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.011998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-secret-telemeter-client\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.013612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.012027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-federate-client-tls\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.013612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.012072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.013612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.012122    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-telemeter-client-tls\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.013612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.012155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.013612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.013130    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-serving-certs-ca-bundle\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.013612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.013146    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-metrics-client-ca\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.013612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.013258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52b05a59-dba0-40f7-9e72-373dafc4bce6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.015886 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.015841    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-federate-client-tls\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.015987 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.015937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-telemeter-client-tls\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.016250 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.016217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-secret-telemeter-client\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.016479 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.016456    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52b05a59-dba0-40f7-9e72-373dafc4bce6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.024103 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.024056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p82tw\" (UniqueName: \"kubernetes.io/projected/52b05a59-dba0-40f7-9e72-373dafc4bce6-kube-api-access-p82tw\") pod \"telemeter-client-7bdb9d59d7-rrwlz\" (UID: \"52b05a59-dba0-40f7-9e72-373dafc4bce6\") " pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.105349 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.105314    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"
Jul 21 06:19:25.862841 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.862781    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:19:25.936614 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.934520    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:19:25.936614 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.934716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:25.938681 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.938655    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 06:19:25.938915 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.938896    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 06:19:25.940504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.939221    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 06:19:25.940504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.939411    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 06:19:25.940504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.940021    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 06:19:25.940504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.940108    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 06:19:25.940504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.940297    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 06:19:25.940504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.940349    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 06:19:25.940837 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.940609    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c9trj4kfh0ge7\""
Jul 21 06:19:25.940837 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.940303    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 06:19:25.942237 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.940958    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 06:19:25.942237 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.941053    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 06:19:25.942237 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.941166    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 06:19:25.942237 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.941272    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zvcf4\""
Jul 21 06:19:25.948958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.944647    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 06:19:25.948958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:25.948780    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.021985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-config\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.023890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k7nk\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-kube-api-access-6k7nk\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.024823 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.024823 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.024823 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.024823 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.022234    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.069575 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.069521    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t5xwf"
Jul 21 06:19:26.123003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.122921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.122972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-config\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k7nk\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-kube-api-access-6k7nk\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.123641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.123489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.124329 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.124301    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.128574 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.128162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.128574 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.128304    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-web-config\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.130890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.130869    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.137007 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.131572    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-config-out\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.137007 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.131587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.137007 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.131613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-config\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.137007 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.134626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.137007 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.134740    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.137007 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.135019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.137007 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.135766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.142462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.138673    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.142462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.138758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.142462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.138810    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.142462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.139512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.142462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.139973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.142462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.140976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.145089 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.144925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.145203 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.145093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.145654 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.145618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k7nk\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-kube-api-access-6k7nk\") pod \"prometheus-k8s-0\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.252347 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.252079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:26.612448 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:26.612414    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:27.258380 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:19:27.258350    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4badf439_acfd_4c04_864e_581587ebb5b0.slice/crio-eacc807a3efcdaf09cdc031a743372b2cf025cd4cbd810d3e47d1da63c4cefab WatchSource:0}: Error finding container eacc807a3efcdaf09cdc031a743372b2cf025cd4cbd810d3e47d1da63c4cefab: Status 404 returned error can't find the container with id eacc807a3efcdaf09cdc031a743372b2cf025cd4cbd810d3e47d1da63c4cefab
Jul 21 06:19:28.227386 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:28.227345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt" event={"ID":"4badf439-acfd-4c04-864e-581587ebb5b0","Type":"ContainerStarted","Data":"eacc807a3efcdaf09cdc031a743372b2cf025cd4cbd810d3e47d1da63c4cefab"}
Jul 21 06:19:28.250693 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:28.250667    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:19:28.252081 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:19:28.252057    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6076d03c_5e87_41e6_a920_a82ece11c7ae.slice/crio-9c5c4a7a74e735c65d9e2ba299b893f5359ae9a309e54d1596851290bc18982a WatchSource:0}: Error finding container 9c5c4a7a74e735c65d9e2ba299b893f5359ae9a309e54d1596851290bc18982a: Status 404 returned error can't find the container with id 9c5c4a7a74e735c65d9e2ba299b893f5359ae9a309e54d1596851290bc18982a
Jul 21 06:19:28.464933 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:28.464912    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"]
Jul 21 06:19:28.468903 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:19:28.468875    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502f1f59_7056_4915_8ed3_cdfeba2a880e.slice/crio-a451c70acbb946e1249cb9f53ae848eda473232105c56ef2f2c46c134d3f42ea WatchSource:0}: Error finding container a451c70acbb946e1249cb9f53ae848eda473232105c56ef2f2c46c134d3f42ea: Status 404 returned error can't find the container with id a451c70acbb946e1249cb9f53ae848eda473232105c56ef2f2c46c134d3f42ea
Jul 21 06:19:28.469459 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:28.469415    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz"]
Jul 21 06:19:28.473064 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:19:28.472981    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b05a59_dba0_40f7_9e72_373dafc4bce6.slice/crio-833bcb690fc6e1ceb2e3245b8b29c0aec67d94818e04d3e308b8397d45047f5c WatchSource:0}: Error finding container 833bcb690fc6e1ceb2e3245b8b29c0aec67d94818e04d3e308b8397d45047f5c: Status 404 returned error can't find the container with id 833bcb690fc6e1ceb2e3245b8b29c0aec67d94818e04d3e308b8397d45047f5c
Jul 21 06:19:29.231333 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:29.231296    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt" event={"ID":"502f1f59-7056-4915-8ed3-cdfeba2a880e","Type":"ContainerStarted","Data":"a451c70acbb946e1249cb9f53ae848eda473232105c56ef2f2c46c134d3f42ea"}
Jul 21 06:19:29.232444 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:29.232416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerStarted","Data":"9c5c4a7a74e735c65d9e2ba299b893f5359ae9a309e54d1596851290bc18982a"}
Jul 21 06:19:29.233546 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:29.233507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz" event={"ID":"52b05a59-dba0-40f7-9e72-373dafc4bce6","Type":"ContainerStarted","Data":"833bcb690fc6e1ceb2e3245b8b29c0aec67d94818e04d3e308b8397d45047f5c"}
Jul 21 06:19:29.234914 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:29.234894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk2hx" event={"ID":"bd28b7ed-2e4c-426d-ba6f-cc5a89975621","Type":"ContainerStarted","Data":"7d38cd3a54c0daa4d4a848f0c4ecc17d7caad73a81425cfa75c81803a3b019b0"}
Jul 21 06:19:35.262649 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.262558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt" event={"ID":"4badf439-acfd-4c04-864e-581587ebb5b0","Type":"ContainerStarted","Data":"32eba976f9d093101d301171f9ecab9aa8aec9d3d7c4c1812920ad070c760780"}
Jul 21 06:19:35.264927 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.264897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz" event={"ID":"52b05a59-dba0-40f7-9e72-373dafc4bce6","Type":"ContainerStarted","Data":"912510ce39d0972b6d72e2d3be100e831ef13d6f1659dd7d12b6660095b6ebee"}
Jul 21 06:19:35.265053 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.264975    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz" event={"ID":"52b05a59-dba0-40f7-9e72-373dafc4bce6","Type":"ContainerStarted","Data":"f83a52465e95f3ebf5dc9e9dc148b24d2f306bb67333db7f34f77f5ea559eb64"}
Jul 21 06:19:35.265053 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.265007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz" event={"ID":"52b05a59-dba0-40f7-9e72-373dafc4bce6","Type":"ContainerStarted","Data":"6428119e654bf114ed537bcaa0740885aaa596321bd09bd76ae5ae593fa48583"}
Jul 21 06:19:35.272267 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.272240    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk2hx" event={"ID":"bd28b7ed-2e4c-426d-ba6f-cc5a89975621","Type":"ContainerStarted","Data":"a0872fc06853ef9ac4feee84b3b253eb76d24918a4c2124d01df4f3095fa4f9c"}
Jul 21 06:19:35.273725 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.273698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt" event={"ID":"502f1f59-7056-4915-8ed3-cdfeba2a880e","Type":"ContainerStarted","Data":"0b2eaaa38fe30b3ab51883d7dd5a8ae24dfe2925e5edd6451bb3084b94fd4796"}
Jul 21 06:19:35.273889 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.273873    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:35.275292 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.275272    2577 generic.go:356] "Generic (PLEG): container finished" podID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65" exitCode=0
Jul 21 06:19:35.275386 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.275336    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerDied","Data":"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"}
Jul 21 06:19:35.279424 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.279407    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt"
Jul 21 06:19:35.285006 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.284968    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt" podStartSLOduration=5.241449202 podStartE2EDuration="12.284956567s" totalImagesPullingTime="7.043507365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:35.284120938 +0000 UTC m=+112.096864600" watchObservedRunningTime="2026-07-21 06:19:35.284956567 +0000 UTC m=+112.097700237"
Jul 21 06:19:35.340791 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.340743    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bdb9d59d7-rrwlz" podStartSLOduration=5.369550612 podStartE2EDuration="11.340725835s" totalImagesPullingTime="5.971175223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:35.340626039 +0000 UTC m=+112.153369710" watchObservedRunningTime="2026-07-21 06:19:35.340725835 +0000 UTC m=+112.153469508"
Jul 21 06:19:35.341342 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:35.341316    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-pq2tt" podStartSLOduration=5.368241449 podStartE2EDuration="11.341310661s" totalImagesPullingTime="5.973069212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:19:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:35.32086252 +0000 UTC m=+112.133606192" watchObservedRunningTime="2026-07-21 06:19:35.341310661 +0000 UTC m=+112.154054365"
Jul 21 06:19:41.303405 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:41.303371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qk2hx" event={"ID":"bd28b7ed-2e4c-426d-ba6f-cc5a89975621","Type":"ContainerStarted","Data":"c32d9b5715ee78bc68884b34d6b4b2f724ea275587f0a17b58effb1dc7751c78"}
Jul 21 06:19:41.305475 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:41.305449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerStarted","Data":"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"}
Jul 21 06:19:41.305617 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:41.305506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerStarted","Data":"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"}
Jul 21 06:19:41.320761 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:41.320716    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qk2hx" podStartSLOduration=17.524027743 podStartE2EDuration="37.320701084s" totalImagesPullingTime="19.796673341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 06:19:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:41.31931565 +0000 UTC m=+118.132059320" watchObservedRunningTime="2026-07-21 06:19:41.320701084 +0000 UTC m=+118.133444754"
Jul 21 06:19:43.316640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:43.316606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerStarted","Data":"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"}
Jul 21 06:19:44.260253 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:44.260224    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:44.260399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:44.260277    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:19:44.327427 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:44.327387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerStarted","Data":"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"}
Jul 21 06:19:44.327803 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:44.327492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerStarted","Data":"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"}
Jul 21 06:19:44.327803 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:44.327556    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerStarted","Data":"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"}
Jul 21 06:19:44.353982 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:44.353923    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.554917826 podStartE2EDuration="19.353909202s" totalImagesPullingTime="13.755393505s" totalInitContainerRuntime="43.597871ms" isStatefulPod=false podCreationTimestamp="2026-07-21 06:19:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:19:44.352432325 +0000 UTC m=+121.165175994" watchObservedRunningTime="2026-07-21 06:19:44.353909202 +0000 UTC m=+121.166652871"
Jul 21 06:19:46.252789 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:46.252760    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:19:48.209759 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.209696    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5d95c59659-6rsp9" podUID="6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" containerName="console" containerID="cri-o://9b57f8c266034426517639c5a54d75df894881b6c047f26fd35c310df83d148c" gracePeriod=15
Jul 21 06:19:48.344853 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.344816    2577 generic.go:356] "Generic (PLEG): container finished" podID="6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" containerID="9b57f8c266034426517639c5a54d75df894881b6c047f26fd35c310df83d148c" exitCode=0
Jul 21 06:19:48.344967 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.344881    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d95c59659-6rsp9" event={"ID":"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0","Type":"ContainerDied","Data":"9b57f8c266034426517639c5a54d75df894881b6c047f26fd35c310df83d148c"}
Jul 21 06:19:48.488616 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.488560    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:48.524999 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.524976    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-kube-api-access-pnkpn\") pod \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") "
Jul 21 06:19:48.525113 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.525023    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-service-ca\") pod \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") "
Jul 21 06:19:48.525113 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.525044    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-config\") pod \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") "
Jul 21 06:19:48.525113 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.525075    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-oauth-config\") pod \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") "
Jul 21 06:19:48.525226 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.525115    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-oauth-serving-cert\") pod \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") "
Jul 21 06:19:48.525226 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.525163    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-serving-cert\") pod \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\" (UID: \"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0\") "
Jul 21 06:19:48.525410 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.525378    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-config" (OuterVolumeSpecName: "console-config") pod "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" (UID: "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:19:48.525504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.525421    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" (UID: "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:19:48.525504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.525465    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" (UID: "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:19:48.527393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.527370    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" (UID: "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:19:48.527393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.527386    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" (UID: "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:19:48.527509 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.527391    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-kube-api-access-pnkpn" (OuterVolumeSpecName: "kube-api-access-pnkpn") pod "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" (UID: "6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0"). InnerVolumeSpecName "kube-api-access-pnkpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:19:48.630010 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.626695    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-config\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:19:48.630010 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.626733    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-oauth-config\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:19:48.630010 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.626747    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-oauth-serving-cert\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:19:48.630010 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.626760    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-console-serving-cert\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:19:48.630010 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.626774    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnkpn\" (UniqueName: \"kubernetes.io/projected/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-kube-api-access-pnkpn\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:19:48.630010 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:48.626794    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:19:49.350058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:49.350020    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d95c59659-6rsp9" event={"ID":"6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0","Type":"ContainerDied","Data":"77557c7e016947c6b66c74e4dbbeec45b4a50a68231540590b18ea7d86b87552"}
Jul 21 06:19:49.350058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:49.350042    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d95c59659-6rsp9"
Jul 21 06:19:49.350669 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:49.350080    2577 scope.go:117] "RemoveContainer" containerID="9b57f8c266034426517639c5a54d75df894881b6c047f26fd35c310df83d148c"
Jul 21 06:19:49.368916 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:49.368894    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d95c59659-6rsp9"]
Jul 21 06:19:49.372643 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:49.372620    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d95c59659-6rsp9"]
Jul 21 06:19:49.712750 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:19:49.712688    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" path="/var/lib/kubelet/pods/6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0/volumes"
Jul 21 06:20:04.266018 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:04.265988    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:20:04.269908 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:04.269886    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8cf9cc889-jn4tt"
Jul 21 06:20:26.252598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:26.252562    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:26.268440 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:26.268420    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:26.496390 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:26.496365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.061360 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.061323    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:20:44.062345 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.062303    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="prometheus" containerID="cri-o://ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e" gracePeriod=600
Jul 21 06:20:44.062472 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.062331    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="thanos-sidecar" containerID="cri-o://c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d" gracePeriod=600
Jul 21 06:20:44.062472 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.062381    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c" gracePeriod=600
Jul 21 06:20:44.062472 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.062430    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy" containerID="cri-o://002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba" gracePeriod=600
Jul 21 06:20:44.062676 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.062461    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy-web" containerID="cri-o://9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b" gracePeriod=600
Jul 21 06:20:44.062676 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.062385    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="config-reloader" containerID="cri-o://1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d" gracePeriod=600
Jul 21 06:20:44.113488 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:20:44.113435    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6076d03c_5e87_41e6_a920_a82ece11c7ae.slice/crio-conmon-1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6076d03c_5e87_41e6_a920_a82ece11c7ae.slice/crio-9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6076d03c_5e87_41e6_a920_a82ece11c7ae.slice/crio-conmon-9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6076d03c_5e87_41e6_a920_a82ece11c7ae.slice/crio-1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6076d03c_5e87_41e6_a920_a82ece11c7ae.slice/crio-conmon-c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6076d03c_5e87_41e6_a920_a82ece11c7ae.slice/crio-ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e.scope\": RecentStats: unable to find data in memory cache]"
Jul 21 06:20:44.318331 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.318257    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.424967 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.424929    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-trusted-ca-bundle\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.424967 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.424976    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-grpc-tls\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425168 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.424995    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-config\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425168 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425012    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-web-config\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425168 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425141    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-tls-assets\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425178    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-config-out\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425204    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-serving-certs-ca-bundle\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425236    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-kubelet-serving-ca-bundle\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425279    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-thanos-prometheus-http-client-file\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425313    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425341    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-metrics-client-ca\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425423    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-0\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425457    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-1\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425499    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-tls\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425560    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-metrics-client-certs\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425907 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425601    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6k7nk\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-kube-api-access-6k7nk\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425907 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425759    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-2\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425907 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425795    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-kube-rbac-proxy\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.425907 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425824    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-db\") pod \"6076d03c-5e87-41e6-a920-a82ece11c7ae\" (UID: \"6076d03c-5e87-41e6-a920-a82ece11c7ae\") "
Jul 21 06:20:44.429003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425361    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:20:44.429003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.425890    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:20:44.429003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.426291    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:20:44.429003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.426500    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:20:44.429518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.426760    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:20:44.429518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.427207    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 06:20:44.429518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.428464    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:20:44.429518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.428569    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.429518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.428887    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-config" (OuterVolumeSpecName: "config") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.429518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.429292    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.429518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.429378    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:20:44.430454 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.430340    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:20:44.430454 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.430416    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.430649 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.430484    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.430649 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.430491    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-kube-api-access-6k7nk" (OuterVolumeSpecName: "kube-api-access-6k7nk") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "kube-api-access-6k7nk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:20:44.430649 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.430503    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-config-out" (OuterVolumeSpecName: "config-out") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 06:20:44.430816 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.430719    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.431183 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.431152    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.431821 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.431797    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.439431 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.439413    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-web-config" (OuterVolumeSpecName: "web-config") pod "6076d03c-5e87-41e6-a920-a82ece11c7ae" (UID: "6076d03c-5e87-41e6-a920-a82ece11c7ae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:20:44.527049 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527026    2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527049 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527047    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527058    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-metrics-client-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527067    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527075    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527083    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527094    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527101    2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-metrics-client-certs\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527109    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k7nk\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-kube-api-access-6k7nk\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527117    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527125    2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-kube-rbac-proxy\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527133    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-k8s-db\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527141    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527150    2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-secret-grpc-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527158    2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-config\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527522 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527184    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6076d03c-5e87-41e6-a920-a82ece11c7ae-web-config\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527522 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527191    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6076d03c-5e87-41e6-a920-a82ece11c7ae-tls-assets\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527522 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527198    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6076d03c-5e87-41e6-a920-a82ece11c7ae-config-out\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527522 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527206    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.527522 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.527214    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6076d03c-5e87-41e6-a920-a82ece11c7ae-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:20:44.550310 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550277    2577 generic.go:356] "Generic (PLEG): container finished" podID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c" exitCode=0
Jul 21 06:20:44.550310 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550304    2577 generic.go:356] "Generic (PLEG): container finished" podID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba" exitCode=0
Jul 21 06:20:44.550310 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550310    2577 generic.go:356] "Generic (PLEG): container finished" podID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b" exitCode=0
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550316    2577 generic.go:356] "Generic (PLEG): container finished" podID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d" exitCode=0
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550321    2577 generic.go:356] "Generic (PLEG): container finished" podID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d" exitCode=0
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550326    2577 generic.go:356] "Generic (PLEG): container finished" podID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e" exitCode=0
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerDied","Data":"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"}
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550376    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerDied","Data":"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"}
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerDied","Data":"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"}
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerDied","Data":"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"}
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550480    2577 scope.go:117] "RemoveContainer" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"
Jul 21 06:20:44.550504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerDied","Data":"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"}
Jul 21 06:20:44.550993 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerDied","Data":"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"}
Jul 21 06:20:44.550993 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.550572    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6076d03c-5e87-41e6-a920-a82ece11c7ae","Type":"ContainerDied","Data":"9c5c4a7a74e735c65d9e2ba299b893f5359ae9a309e54d1596851290bc18982a"}
Jul 21 06:20:44.558618 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.558591    2577 scope.go:117] "RemoveContainer" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"
Jul 21 06:20:44.565410 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.565396    2577 scope.go:117] "RemoveContainer" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"
Jul 21 06:20:44.571910 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.571893    2577 scope.go:117] "RemoveContainer" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"
Jul 21 06:20:44.573957 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.573939    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:20:44.578330 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.578309    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:20:44.580663 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.580645    2577 scope.go:117] "RemoveContainer" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"
Jul 21 06:20:44.587627 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.587612    2577 scope.go:117] "RemoveContainer" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"
Jul 21 06:20:44.594416 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.594401    2577 scope.go:117] "RemoveContainer" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"
Jul 21 06:20:44.600941 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.600872    2577 scope.go:117] "RemoveContainer" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"
Jul 21 06:20:44.601173 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:20:44.601147    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": container with ID starting with f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c not found: ID does not exist" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"
Jul 21 06:20:44.601231 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.601193    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"} err="failed to get container status \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": rpc error: code = NotFound desc = could not find container \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": container with ID starting with f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c not found: ID does not exist"
Jul 21 06:20:44.601279 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.601235    2577 scope.go:117] "RemoveContainer" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"
Jul 21 06:20:44.601500 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:20:44.601481    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": container with ID starting with 002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba not found: ID does not exist" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"
Jul 21 06:20:44.601592 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.601506    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"} err="failed to get container status \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": rpc error: code = NotFound desc = could not find container \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": container with ID starting with 002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba not found: ID does not exist"
Jul 21 06:20:44.601640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.601525    2577 scope.go:117] "RemoveContainer" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"
Jul 21 06:20:44.601904 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:20:44.601882    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": container with ID starting with 9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b not found: ID does not exist" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"
Jul 21 06:20:44.601998 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.601911    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"} err="failed to get container status \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": rpc error: code = NotFound desc = could not find container \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": container with ID starting with 9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b not found: ID does not exist"
Jul 21 06:20:44.601998 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.601929    2577 scope.go:117] "RemoveContainer" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"
Jul 21 06:20:44.602178 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:20:44.602158    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": container with ID starting with c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d not found: ID does not exist" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"
Jul 21 06:20:44.602216 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602184    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"} err="failed to get container status \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": rpc error: code = NotFound desc = could not find container \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": container with ID starting with c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d not found: ID does not exist"
Jul 21 06:20:44.602216 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602205    2577 scope.go:117] "RemoveContainer" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"
Jul 21 06:20:44.602426 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:20:44.602407    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": container with ID starting with 1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d not found: ID does not exist" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"
Jul 21 06:20:44.602465 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602431    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"} err="failed to get container status \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": rpc error: code = NotFound desc = could not find container \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": container with ID starting with 1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d not found: ID does not exist"
Jul 21 06:20:44.602465 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602447    2577 scope.go:117] "RemoveContainer" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"
Jul 21 06:20:44.602651 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602634    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:20:44.602694 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:20:44.602668    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": container with ID starting with ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e not found: ID does not exist" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"
Jul 21 06:20:44.602732 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602689    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"} err="failed to get container status \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": rpc error: code = NotFound desc = could not find container \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": container with ID starting with ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e not found: ID does not exist"
Jul 21 06:20:44.602732 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602707    2577 scope.go:117] "RemoveContainer" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"
Jul 21 06:20:44.602917 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602898    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy"
Jul 21 06:20:44.602917 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602916    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:20:44.602926    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": container with ID starting with 22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65 not found: ID does not exist" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602938    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="init-config-reloader"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602946    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="init-config-reloader"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602955    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="config-reloader"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602969    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="config-reloader"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602978    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="thanos-sidecar"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602986    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="thanos-sidecar"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602996    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" containerName="console"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603004    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" containerName="console"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603020    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy-web"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603027    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy-web"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.602948    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"} err="failed to get container status \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": rpc error: code = NotFound desc = could not find container \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": container with ID starting with 22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65 not found: ID does not exist"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603038    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy-thanos"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603042    2577 scope.go:117] "RemoveContainer" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603046    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy-thanos"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603062    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="prometheus"
Jul 21 06:20:44.603071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603070    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="prometheus"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603134    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy-web"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603149    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="prometheus"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603157    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603166    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e98f7e8-1ea5-4a21-b0e4-8108b243b7f0" containerName="console"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603176    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="config-reloader"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603184    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="thanos-sidecar"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603192    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" containerName="kube-rbac-proxy-thanos"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603243    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"} err="failed to get container status \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": rpc error: code = NotFound desc = could not find container \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": container with ID starting with f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c not found: ID does not exist"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603258    2577 scope.go:117] "RemoveContainer" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603520    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"} err="failed to get container status \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": rpc error: code = NotFound desc = could not find container \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": container with ID starting with 002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba not found: ID does not exist"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603562    2577 scope.go:117] "RemoveContainer" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603922    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"} err="failed to get container status \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": rpc error: code = NotFound desc = could not find container \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": container with ID starting with 9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b not found: ID does not exist"
Jul 21 06:20:44.603948 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.603945    2577 scope.go:117] "RemoveContainer" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"
Jul 21 06:20:44.604600 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.604203    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"} err="failed to get container status \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": rpc error: code = NotFound desc = could not find container \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": container with ID starting with c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d not found: ID does not exist"
Jul 21 06:20:44.604600 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.604227    2577 scope.go:117] "RemoveContainer" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"
Jul 21 06:20:44.606514 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.606490    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"} err="failed to get container status \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": rpc error: code = NotFound desc = could not find container \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": container with ID starting with 1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d not found: ID does not exist"
Jul 21 06:20:44.606616 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.606516    2577 scope.go:117] "RemoveContainer" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"
Jul 21 06:20:44.606800 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.606781    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"} err="failed to get container status \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": rpc error: code = NotFound desc = could not find container \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": container with ID starting with ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e not found: ID does not exist"
Jul 21 06:20:44.606869 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.606802    2577 scope.go:117] "RemoveContainer" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"
Jul 21 06:20:44.607062 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607045    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"} err="failed to get container status \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": rpc error: code = NotFound desc = could not find container \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": container with ID starting with 22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65 not found: ID does not exist"
Jul 21 06:20:44.607104 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607063    2577 scope.go:117] "RemoveContainer" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"
Jul 21 06:20:44.607308 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607290    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"} err="failed to get container status \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": rpc error: code = NotFound desc = could not find container \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": container with ID starting with f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c not found: ID does not exist"
Jul 21 06:20:44.607356 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607310    2577 scope.go:117] "RemoveContainer" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"
Jul 21 06:20:44.607528 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607511    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"} err="failed to get container status \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": rpc error: code = NotFound desc = could not find container \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": container with ID starting with 002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba not found: ID does not exist"
Jul 21 06:20:44.607528 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607529    2577 scope.go:117] "RemoveContainer" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"
Jul 21 06:20:44.607747 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607729    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"} err="failed to get container status \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": rpc error: code = NotFound desc = could not find container \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": container with ID starting with 9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b not found: ID does not exist"
Jul 21 06:20:44.607793 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607751    2577 scope.go:117] "RemoveContainer" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"
Jul 21 06:20:44.607961 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607943    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"} err="failed to get container status \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": rpc error: code = NotFound desc = could not find container \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": container with ID starting with c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d not found: ID does not exist"
Jul 21 06:20:44.608030 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.607974    2577 scope.go:117] "RemoveContainer" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"
Jul 21 06:20:44.608184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.608168    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"} err="failed to get container status \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": rpc error: code = NotFound desc = could not find container \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": container with ID starting with 1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d not found: ID does not exist"
Jul 21 06:20:44.608234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.608184    2577 scope.go:117] "RemoveContainer" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"
Jul 21 06:20:44.608430 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.608408    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"} err="failed to get container status \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": rpc error: code = NotFound desc = could not find container \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": container with ID starting with ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e not found: ID does not exist"
Jul 21 06:20:44.608518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.608430    2577 scope.go:117] "RemoveContainer" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"
Jul 21 06:20:44.608681 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.608665    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"} err="failed to get container status \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": rpc error: code = NotFound desc = could not find container \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": container with ID starting with 22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65 not found: ID does not exist"
Jul 21 06:20:44.608733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.608681    2577 scope.go:117] "RemoveContainer" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"
Jul 21 06:20:44.608863 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.608848    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"} err="failed to get container status \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": rpc error: code = NotFound desc = could not find container \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": container with ID starting with f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c not found: ID does not exist"
Jul 21 06:20:44.608910 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.608865    2577 scope.go:117] "RemoveContainer" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"
Jul 21 06:20:44.609028 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.609011    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.609125 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.609098    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"} err="failed to get container status \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": rpc error: code = NotFound desc = could not find container \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": container with ID starting with 002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba not found: ID does not exist"
Jul 21 06:20:44.609125 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.609118    2577 scope.go:117] "RemoveContainer" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"
Jul 21 06:20:44.609884 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.609684    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"} err="failed to get container status \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": rpc error: code = NotFound desc = could not find container \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": container with ID starting with 9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b not found: ID does not exist"
Jul 21 06:20:44.609884 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.609708    2577 scope.go:117] "RemoveContainer" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"
Jul 21 06:20:44.610108 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.610086    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"} err="failed to get container status \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": rpc error: code = NotFound desc = could not find container \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": container with ID starting with c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d not found: ID does not exist"
Jul 21 06:20:44.610152 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.610110    2577 scope.go:117] "RemoveContainer" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"
Jul 21 06:20:44.610377 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.610358    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"} err="failed to get container status \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": rpc error: code = NotFound desc = could not find container \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": container with ID starting with 1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d not found: ID does not exist"
Jul 21 06:20:44.610428 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.610378    2577 scope.go:117] "RemoveContainer" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"
Jul 21 06:20:44.610626 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.610608    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"} err="failed to get container status \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": rpc error: code = NotFound desc = could not find container \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": container with ID starting with ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e not found: ID does not exist"
Jul 21 06:20:44.610681 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.610628    2577 scope.go:117] "RemoveContainer" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"
Jul 21 06:20:44.610871 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.610854    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"} err="failed to get container status \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": rpc error: code = NotFound desc = could not find container \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": container with ID starting with 22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65 not found: ID does not exist"
Jul 21 06:20:44.610911 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.610873    2577 scope.go:117] "RemoveContainer" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"
Jul 21 06:20:44.611136 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.611120    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"} err="failed to get container status \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": rpc error: code = NotFound desc = could not find container \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": container with ID starting with f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c not found: ID does not exist"
Jul 21 06:20:44.611182 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.611138    2577 scope.go:117] "RemoveContainer" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"
Jul 21 06:20:44.611428 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.611414    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"} err="failed to get container status \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": rpc error: code = NotFound desc = could not find container \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": container with ID starting with 002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba not found: ID does not exist"
Jul 21 06:20:44.611467 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.611430    2577 scope.go:117] "RemoveContainer" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"
Jul 21 06:20:44.611750 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.611728    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"} err="failed to get container status \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": rpc error: code = NotFound desc = could not find container \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": container with ID starting with 9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b not found: ID does not exist"
Jul 21 06:20:44.611750 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.611750    2577 scope.go:117] "RemoveContainer" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"
Jul 21 06:20:44.611907 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.611881    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 06:20:44.612107 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612082    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"} err="failed to get container status \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": rpc error: code = NotFound desc = could not find container \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": container with ID starting with c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d not found: ID does not exist"
Jul 21 06:20:44.612107 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612106    2577 scope.go:117] "RemoveContainer" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"
Jul 21 06:20:44.612258 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612202    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 06:20:44.612258 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612233    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 06:20:44.612363 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612269    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 06:20:44.612363 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612237    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 06:20:44.612363 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612349    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 06:20:44.612500 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 06:20:44.612573 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612497    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c9trj4kfh0ge7\""
Jul 21 06:20:44.613323 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612923    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"} err="failed to get container status \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": rpc error: code = NotFound desc = could not find container \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": container with ID starting with 1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d not found: ID does not exist"
Jul 21 06:20:44.613323 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.612956    2577 scope.go:117] "RemoveContainer" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"
Jul 21 06:20:44.613456 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.613352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 06:20:44.613505 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.613458    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 06:20:44.613786 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.613760    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"} err="failed to get container status \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": rpc error: code = NotFound desc = could not find container \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": container with ID starting with ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e not found: ID does not exist"
Jul 21 06:20:44.613855 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.613789    2577 scope.go:117] "RemoveContainer" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"
Jul 21 06:20:44.614179 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.614159    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-zvcf4\""
Jul 21 06:20:44.614239 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.614177    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 06:20:44.618165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.617497    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 06:20:44.618165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.618027    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 06:20:44.620870 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.620154    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"} err="failed to get container status \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": rpc error: code = NotFound desc = could not find container \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": container with ID starting with 22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65 not found: ID does not exist"
Jul 21 06:20:44.620870 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.620766    2577 scope.go:117] "RemoveContainer" containerID="f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"
Jul 21 06:20:44.621071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621044    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c"} err="failed to get container status \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": rpc error: code = NotFound desc = could not find container \"f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c\": container with ID starting with f56e8a12dea31f605efc2aab83dbfd1174b0d86fc76c93fdb25154af94e8b92c not found: ID does not exist"
Jul 21 06:20:44.621137 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621074    2577 scope.go:117] "RemoveContainer" containerID="002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"
Jul 21 06:20:44.621334 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621310    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba"} err="failed to get container status \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": rpc error: code = NotFound desc = could not find container \"002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba\": container with ID starting with 002225299d1b227bb8c6d3c5e3ba6fcb9d828e48026a2a1b39c6a5ba114ccaba not found: ID does not exist"
Jul 21 06:20:44.621397 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621336    2577 scope.go:117] "RemoveContainer" containerID="9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"
Jul 21 06:20:44.621593 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621570    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b"} err="failed to get container status \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": rpc error: code = NotFound desc = could not find container \"9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b\": container with ID starting with 9ba88895c6456e2875a514571d121b76a214ba9f3b37d0b7c86bf35b03bd9b3b not found: ID does not exist"
Jul 21 06:20:44.621671 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621595    2577 scope.go:117] "RemoveContainer" containerID="c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"
Jul 21 06:20:44.621671 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621627    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 06:20:44.621921 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621887    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d"} err="failed to get container status \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": rpc error: code = NotFound desc = could not find container \"c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d\": container with ID starting with c88f142a7492f153a04c87db612633452cb4547113a9f035878dc0e6cec2ce2d not found: ID does not exist"
Jul 21 06:20:44.622000 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.621921    2577 scope.go:117] "RemoveContainer" containerID="1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"
Jul 21 06:20:44.622246 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.622228    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d"} err="failed to get container status \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": rpc error: code = NotFound desc = could not find container \"1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d\": container with ID starting with 1f9fccf9d7ab1ad8d80b34d76cda0a59ecd5ed7b3f7dbde79c6075513dc0f00d not found: ID does not exist"
Jul 21 06:20:44.622334 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.622247    2577 scope.go:117] "RemoveContainer" containerID="ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"
Jul 21 06:20:44.622384 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.622366    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:20:44.622577 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.622558    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e"} err="failed to get container status \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": rpc error: code = NotFound desc = could not find container \"ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e\": container with ID starting with ff3cf70a061776f06338a3a89dec98b309a6867acda46e0fb4c2de3089655a1e not found: ID does not exist"
Jul 21 06:20:44.622630 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.622578    2577 scope.go:117] "RemoveContainer" containerID="22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"
Jul 21 06:20:44.622866 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.622843    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65"} err="failed to get container status \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": rpc error: code = NotFound desc = could not find container \"22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65\": container with ID starting with 22845c2a5176a53f80bd09e71ccf9a553de249b7964852d8ea88ede4766d2d65 not found: ID does not exist"
Jul 21 06:20:44.623088 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.623069    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 06:20:44.728364 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728463 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728370    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728463 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728463 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-config\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728463 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64839c1d-b21a-47eb-9fbe-58b9ea24346a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64839c1d-b21a-47eb-9fbe-58b9ea24346a-config-out\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728785 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728785 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728785 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvvh\" (UniqueName: \"kubernetes.io/projected/64839c1d-b21a-47eb-9fbe-58b9ea24346a-kube-api-access-mfvvh\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728785 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-web-config\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728897 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728897 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728897 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728897 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.728897 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.729037 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.728898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.829945 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.829882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.829945 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.829918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.829945 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.829934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830138 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.829962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830138 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.829987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830138 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-config\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830280 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64839c1d-b21a-47eb-9fbe-58b9ea24346a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830280 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830280 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64839c1d-b21a-47eb-9fbe-58b9ea24346a-config-out\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830280 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830471 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830471 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830471 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830471 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830471 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvvh\" (UniqueName: \"kubernetes.io/projected/64839c1d-b21a-47eb-9fbe-58b9ea24346a-kube-api-access-mfvvh\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830471 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-web-config\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830565    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.830777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.830593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.831605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.831579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.831869 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.831846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.833415 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.833212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.833415 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.833297    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.833415 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.833386    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.833415 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.833408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-config\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.833685 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.833443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.833809 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.833684    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.834399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.834288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.834399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.834314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.834399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.834361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.834818 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.834793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.835104 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.835037    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.835104 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.835075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64839c1d-b21a-47eb-9fbe-58b9ea24346a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.835732 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.835710    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.835825 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.835771    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64839c1d-b21a-47eb-9fbe-58b9ea24346a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.835994 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.835976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64839c1d-b21a-47eb-9fbe-58b9ea24346a-web-config\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.836445 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.836427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64839c1d-b21a-47eb-9fbe-58b9ea24346a-config-out\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.840599 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.840581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvvh\" (UniqueName: \"kubernetes.io/projected/64839c1d-b21a-47eb-9fbe-58b9ea24346a-kube-api-access-mfvvh\") pod \"prometheus-k8s-0\" (UID: \"64839c1d-b21a-47eb-9fbe-58b9ea24346a\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:44.922132 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:44.922099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:20:45.055395 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:45.055374    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 06:20:45.057420 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:20:45.057398    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64839c1d_b21a_47eb_9fbe_58b9ea24346a.slice/crio-1a96d2416c7427d28c0d4e3ed29a51e4bf95df55d34763c6c3f9667826bcdd92 WatchSource:0}: Error finding container 1a96d2416c7427d28c0d4e3ed29a51e4bf95df55d34763c6c3f9667826bcdd92: Status 404 returned error can't find the container with id 1a96d2416c7427d28c0d4e3ed29a51e4bf95df55d34763c6c3f9667826bcdd92
Jul 21 06:20:45.555332 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:45.555304    2577 generic.go:356] "Generic (PLEG): container finished" podID="64839c1d-b21a-47eb-9fbe-58b9ea24346a" containerID="9aec17d68dd1be92e3e1c238d6c9f980e2daf6613ba5aced186a903242272161" exitCode=0
Jul 21 06:20:45.555738 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:45.555391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64839c1d-b21a-47eb-9fbe-58b9ea24346a","Type":"ContainerDied","Data":"9aec17d68dd1be92e3e1c238d6c9f980e2daf6613ba5aced186a903242272161"}
Jul 21 06:20:45.555738 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:45.555462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64839c1d-b21a-47eb-9fbe-58b9ea24346a","Type":"ContainerStarted","Data":"1a96d2416c7427d28c0d4e3ed29a51e4bf95df55d34763c6c3f9667826bcdd92"}
Jul 21 06:20:45.714396 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:45.714368    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6076d03c-5e87-41e6-a920-a82ece11c7ae" path="/var/lib/kubelet/pods/6076d03c-5e87-41e6-a920-a82ece11c7ae/volumes"
Jul 21 06:20:46.563825 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:46.563794    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64839c1d-b21a-47eb-9fbe-58b9ea24346a","Type":"ContainerStarted","Data":"10d760a76361216e5e413003c6f0421c19eb878db2afcacbcad30da283c42121"}
Jul 21 06:20:46.564173 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:46.563885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64839c1d-b21a-47eb-9fbe-58b9ea24346a","Type":"ContainerStarted","Data":"5cda65c5b988b54b744fa701b17a8bb2858580737eca53405a5994f26a18148e"}
Jul 21 06:20:46.564173 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:46.563913    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64839c1d-b21a-47eb-9fbe-58b9ea24346a","Type":"ContainerStarted","Data":"3214c6314c814ac5a17512910a702edbc10dcc3aed380529f47187d9530bab64"}
Jul 21 06:20:46.564173 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:46.563938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64839c1d-b21a-47eb-9fbe-58b9ea24346a","Type":"ContainerStarted","Data":"388722b70856b105aa5e234f7e6420db099194d8a2f386b2f7af52fdeab953b8"}
Jul 21 06:20:46.564173 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:46.563961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64839c1d-b21a-47eb-9fbe-58b9ea24346a","Type":"ContainerStarted","Data":"60eab7cb8209aebc8bc110651fea3786e2315348c4a98ce3c2e00883b31d5e21"}
Jul 21 06:20:46.564173 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:46.563984    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"64839c1d-b21a-47eb-9fbe-58b9ea24346a","Type":"ContainerStarted","Data":"bee92e429648d961029f43657054d0969581390191389cf05597b7bb1ae22e82"}
Jul 21 06:20:46.590079 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:46.590026    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.571897752 podStartE2EDuration="2.590006603s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.108851ms" isStatefulPod=false podCreationTimestamp="2026-07-21 06:20:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:20:46.588632044 +0000 UTC m=+183.401375716" watchObservedRunningTime="2026-07-21 06:20:46.590006603 +0000 UTC m=+183.402750287"
Jul 21 06:20:49.923249 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:20:49.923215    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:21:44.923158 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:21:44.923127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:21:44.938781 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:21:44.938750    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:21:45.786326 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:21:45.786297    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 06:22:41.868019 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:41.867985    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"]
Jul 21 06:22:41.871075 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:41.871058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"
Jul 21 06:22:41.873798 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:41.873768    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 06:22:41.874780 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:41.874765    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-q7nb6\""
Jul 21 06:22:41.874861 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:41.874808    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 06:22:41.880049 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:41.880029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"]
Jul 21 06:22:41.958509 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:41.958487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/449f7269-f910-4431-ac36-140b819b7b35-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pwd27\" (UID: \"449f7269-f910-4431-ac36-140b819b7b35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"
Jul 21 06:22:41.958631 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:41.958522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qm4l\" (UniqueName: \"kubernetes.io/projected/449f7269-f910-4431-ac36-140b819b7b35-kube-api-access-9qm4l\") pod \"openshift-lws-operator-fd8ccff4c-pwd27\" (UID: \"449f7269-f910-4431-ac36-140b819b7b35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"
Jul 21 06:22:42.059040 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:42.059007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/449f7269-f910-4431-ac36-140b819b7b35-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pwd27\" (UID: \"449f7269-f910-4431-ac36-140b819b7b35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"
Jul 21 06:22:42.059147 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:42.059052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qm4l\" (UniqueName: \"kubernetes.io/projected/449f7269-f910-4431-ac36-140b819b7b35-kube-api-access-9qm4l\") pod \"openshift-lws-operator-fd8ccff4c-pwd27\" (UID: \"449f7269-f910-4431-ac36-140b819b7b35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"
Jul 21 06:22:42.059343 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:42.059326    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/449f7269-f910-4431-ac36-140b819b7b35-tmp\") pod \"openshift-lws-operator-fd8ccff4c-pwd27\" (UID: \"449f7269-f910-4431-ac36-140b819b7b35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"
Jul 21 06:22:42.066934 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:42.066910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qm4l\" (UniqueName: \"kubernetes.io/projected/449f7269-f910-4431-ac36-140b819b7b35-kube-api-access-9qm4l\") pod \"openshift-lws-operator-fd8ccff4c-pwd27\" (UID: \"449f7269-f910-4431-ac36-140b819b7b35\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"
Jul 21 06:22:42.190796 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:42.190726    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"
Jul 21 06:22:42.316598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:42.316566    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27"]
Jul 21 06:22:42.319564 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:22:42.319521    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod449f7269_f910_4431_ac36_140b819b7b35.slice/crio-cdc4ad3ed8c2bbd6048005099e6597ba7c5727c48e900786a7e3adf6e1c5c857 WatchSource:0}: Error finding container cdc4ad3ed8c2bbd6048005099e6597ba7c5727c48e900786a7e3adf6e1c5c857: Status 404 returned error can't find the container with id cdc4ad3ed8c2bbd6048005099e6597ba7c5727c48e900786a7e3adf6e1c5c857
Jul 21 06:22:42.969888 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:42.969823    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27" event={"ID":"449f7269-f910-4431-ac36-140b819b7b35","Type":"ContainerStarted","Data":"cdc4ad3ed8c2bbd6048005099e6597ba7c5727c48e900786a7e3adf6e1c5c857"}
Jul 21 06:22:44.688771 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:44.688736    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:22:44.691097 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:44.689213    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:22:44.698011 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:44.697989    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 06:22:44.980606 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:44.980501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27" event={"ID":"449f7269-f910-4431-ac36-140b819b7b35","Type":"ContainerStarted","Data":"2b08b3878a3742a3af210d4cf6f21c178449a0d6ef5988c8c445b482eaa5b2df"}
Jul 21 06:22:44.999504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:22:44.999452    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-pwd27" podStartSLOduration=1.585164479 podStartE2EDuration="3.999432525s" totalImagesPullingTime="2.414268046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:22:44.997906495 +0000 UTC m=+301.810650164" watchObservedRunningTime="2026-07-21 06:22:44.999432525 +0000 UTC m=+301.812176200"
Jul 21 06:23:04.377615 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.377560    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"]
Jul 21 06:23:04.380810 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.380788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.383489 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.383335    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7pnhr\""
Jul 21 06:23:04.383489 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.383365    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 06:23:04.383693 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.383673    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 06:23:04.383777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.383758    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 06:23:04.384336 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.384323    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 06:23:04.394018 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.394000    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"]
Jul 21 06:23:04.413078 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.413049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.413180 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.413084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkvjf\" (UniqueName: \"kubernetes.io/projected/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-kube-api-access-fkvjf\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.413180 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.413122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-manifests\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.413290 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.413194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-tmp\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.413290 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.413221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.514605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.514568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.514605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.514608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkvjf\" (UniqueName: \"kubernetes.io/projected/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-kube-api-access-fkvjf\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.514789 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.514633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-manifests\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.514789 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.514669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-tmp\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.514789 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.514686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.515135 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.515114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-manifests\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.517014 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.516991    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-tmp\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.517149 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.517134    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.517444 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.517425    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-webhook-cert\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.522420 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.522403    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkvjf\" (UniqueName: \"kubernetes.io/projected/1136e1ef-12c2-4add-8244-5fc8f33b9ba2-kube-api-access-fkvjf\") pod \"opendatahub-operator-controller-manager-78c844c949-g6x2t\" (UID: \"1136e1ef-12c2-4add-8244-5fc8f33b9ba2\") " pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.690512 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.690453    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:04.823442 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.823410    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"]
Jul 21 06:23:04.825391 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:23:04.825352    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1136e1ef_12c2_4add_8244_5fc8f33b9ba2.slice/crio-08b437a2b967a7fe356fc0b0758874aa74430a24f3bdd90cfc6c134d4da2098c WatchSource:0}: Error finding container 08b437a2b967a7fe356fc0b0758874aa74430a24f3bdd90cfc6c134d4da2098c: Status 404 returned error can't find the container with id 08b437a2b967a7fe356fc0b0758874aa74430a24f3bdd90cfc6c134d4da2098c
Jul 21 06:23:04.827202 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:04.827182    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 06:23:05.056840 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:05.056812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t" event={"ID":"1136e1ef-12c2-4add-8244-5fc8f33b9ba2","Type":"ContainerStarted","Data":"08b437a2b967a7fe356fc0b0758874aa74430a24f3bdd90cfc6c134d4da2098c"}
Jul 21 06:23:08.073057 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:08.073022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t" event={"ID":"1136e1ef-12c2-4add-8244-5fc8f33b9ba2","Type":"ContainerStarted","Data":"30cee08c09caffd0ddd31adc6ca6ca88198cf3d0c889713fade3b1b18efa7219"}
Jul 21 06:23:09.079189 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:09.079159    2577 generic.go:356] "Generic (PLEG): container finished" podID="1136e1ef-12c2-4add-8244-5fc8f33b9ba2" containerID="30cee08c09caffd0ddd31adc6ca6ca88198cf3d0c889713fade3b1b18efa7219" exitCode=0
Jul 21 06:23:09.079491 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:09.079193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t" event={"ID":"1136e1ef-12c2-4add-8244-5fc8f33b9ba2","Type":"ContainerDied","Data":"30cee08c09caffd0ddd31adc6ca6ca88198cf3d0c889713fade3b1b18efa7219"}
Jul 21 06:23:10.085969 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:10.085924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t" event={"ID":"1136e1ef-12c2-4add-8244-5fc8f33b9ba2","Type":"ContainerStarted","Data":"16ebc10f5f87e91bb67927dce7d6e1c21268fcbddbd4f871bd0ce746dd3cb0ec"}
Jul 21 06:23:10.086359 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:10.086078    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:10.107757 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:10.107705    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t" podStartSLOduration=1.6480338140000002 podStartE2EDuration="6.107685126s" totalImagesPullingTime="3.422271622s" totalInitContainerRuntime="1.03737969s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:23:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:23:10.105090701 +0000 UTC m=+326.917834372" watchObservedRunningTime="2026-07-21 06:23:10.107685126 +0000 UTC m=+326.920428797"
Jul 21 06:23:21.091569 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:21.091517    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78c844c949-g6x2t"
Jul 21 06:23:24.574142 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.574106    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jbj6f"]
Jul 21 06:23:24.583141 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.583114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:24.586330 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.586298    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 21 06:23:24.586718 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.586696    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jbj6f"]
Jul 21 06:23:24.666484 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.666448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-tls-certs\") pod \"model-serving-api-54d89bd5fc-jbj6f\" (UID: \"7bd765f3-66f8-426c-8da9-2ef07cdc74c1\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:24.666680 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.666492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffcb4\" (UniqueName: \"kubernetes.io/projected/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-kube-api-access-ffcb4\") pod \"model-serving-api-54d89bd5fc-jbj6f\" (UID: \"7bd765f3-66f8-426c-8da9-2ef07cdc74c1\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:24.672490 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.672464    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"]
Jul 21 06:23:24.675674 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.675657    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.678189 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.678169    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 06:23:24.678341 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.678175    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 06:23:24.678422 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.678234    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 06:23:24.678477 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.678251    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c8khv\""
Jul 21 06:23:24.678582 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.678277    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 06:23:24.687305 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.687280    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"]
Jul 21 06:23:24.767243 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767212    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.767389 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqzb4\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-kube-api-access-gqzb4\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.767389 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-token\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.767463 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.767463 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-tls-certs\") pod \"model-serving-api-54d89bd5fc-jbj6f\" (UID: \"7bd765f3-66f8-426c-8da9-2ef07cdc74c1\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:24.767523 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-cacerts\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.767578 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-local-certs\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.767578 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:23:24.767568    2577 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 21 06:23:24.767641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffcb4\" (UniqueName: \"kubernetes.io/projected/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-kube-api-access-ffcb4\") pod \"model-serving-api-54d89bd5fc-jbj6f\" (UID: \"7bd765f3-66f8-426c-8da9-2ef07cdc74c1\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:24.767641 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.767610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.767641 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:23:24.767634    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-tls-certs podName:7bd765f3-66f8-426c-8da9-2ef07cdc74c1 nodeName:}" failed. No retries permitted until 2026-07-21 06:23:25.267615158 +0000 UTC m=+342.080358811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-tls-certs") pod "model-serving-api-54d89bd5fc-jbj6f" (UID: "7bd765f3-66f8-426c-8da9-2ef07cdc74c1") : secret "model-serving-api-tls" not found
Jul 21 06:23:24.776070 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.776037    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffcb4\" (UniqueName: \"kubernetes.io/projected/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-kube-api-access-ffcb4\") pod \"model-serving-api-54d89bd5fc-jbj6f\" (UID: \"7bd765f3-66f8-426c-8da9-2ef07cdc74c1\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:24.868876 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.868788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-token\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.868876 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.868832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.869085 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.868889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-cacerts\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.869085 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.868929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-local-certs\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.869085 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.868957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.869085 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.868998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.869085 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.869032    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqzb4\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-kube-api-access-gqzb4\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.869946 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.869916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.871494 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.871468    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.871494 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.871482    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-cacerts\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.871725 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.871571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.871725 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.871675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-local-certs\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.876645 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.876622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-token\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.876728 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.876696    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqzb4\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-kube-api-access-gqzb4\") pod \"istiod-openshift-gateway-7574459656-k8t4c\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:24.988087 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:24.988058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:25.124022 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:25.123972    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"]
Jul 21 06:23:25.126907 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:23:25.126871    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa249e8_3123_4f64_9f6a_0f2a5fcc4859.slice/crio-d27e6de98d08c09bba1358f6bd63bd89c3c967c9fff7064af99059120262b2fb WatchSource:0}: Error finding container d27e6de98d08c09bba1358f6bd63bd89c3c967c9fff7064af99059120262b2fb: Status 404 returned error can't find the container with id d27e6de98d08c09bba1358f6bd63bd89c3c967c9fff7064af99059120262b2fb
Jul 21 06:23:25.144593 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:25.144559    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c" event={"ID":"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859","Type":"ContainerStarted","Data":"d27e6de98d08c09bba1358f6bd63bd89c3c967c9fff7064af99059120262b2fb"}
Jul 21 06:23:25.272707 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:25.272672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-tls-certs\") pod \"model-serving-api-54d89bd5fc-jbj6f\" (UID: \"7bd765f3-66f8-426c-8da9-2ef07cdc74c1\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:25.275282 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:25.275251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bd765f3-66f8-426c-8da9-2ef07cdc74c1-tls-certs\") pod \"model-serving-api-54d89bd5fc-jbj6f\" (UID: \"7bd765f3-66f8-426c-8da9-2ef07cdc74c1\") " pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:25.497408 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:25.497306    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:25.636461 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:25.636438    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jbj6f"]
Jul 21 06:23:25.639132 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:23:25.639107    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd765f3_66f8_426c_8da9_2ef07cdc74c1.slice/crio-3831807a2feede77994b285fe1359196d9e2b070024dce06128877e68495d952 WatchSource:0}: Error finding container 3831807a2feede77994b285fe1359196d9e2b070024dce06128877e68495d952: Status 404 returned error can't find the container with id 3831807a2feede77994b285fe1359196d9e2b070024dce06128877e68495d952
Jul 21 06:23:26.152501 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:26.152456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f" event={"ID":"7bd765f3-66f8-426c-8da9-2ef07cdc74c1","Type":"ContainerStarted","Data":"3831807a2feede77994b285fe1359196d9e2b070024dce06128877e68495d952"}
Jul 21 06:23:27.982517 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:27.982453    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 06:23:27.982917 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:27.982574    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Jul 21 06:23:28.162793 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:28.162752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c" event={"ID":"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859","Type":"ContainerStarted","Data":"8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307"}
Jul 21 06:23:28.163073 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:28.162815    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:28.164474 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:28.164447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f" event={"ID":"7bd765f3-66f8-426c-8da9-2ef07cdc74c1","Type":"ContainerStarted","Data":"ae2d53274b44962c18105c4f887f7174122253a345aa70276ee0935d27a53184"}
Jul 21 06:23:28.164595 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:28.164552    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:28.184378 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:28.184331    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c" podStartSLOduration=1.331280691 podStartE2EDuration="4.184313432s" totalImagesPullingTime="2.853032741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:23:28.181324697 +0000 UTC m=+344.994068368" watchObservedRunningTime="2026-07-21 06:23:28.184313432 +0000 UTC m=+344.997057103"
Jul 21 06:23:28.198650 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:28.198605    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f" podStartSLOduration=1.855185579 podStartE2EDuration="4.198587429s" totalImagesPullingTime="2.34340185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:23:28.1964522 +0000 UTC m=+345.009195871" watchObservedRunningTime="2026-07-21 06:23:28.198587429 +0000 UTC m=+345.011331101"
Jul 21 06:23:29.170341 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:29.170300    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-k8t4c container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 06:23:29.170742 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:29.170382    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c" podUID="1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 06:23:31.172452 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.172414    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"]
Jul 21 06:23:31.176833 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.176808    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.179772 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.179751    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 06:23:31.180742 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.180720    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 06:23:31.180742 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.180734    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 06:23:31.181645 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.181629    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nms9n\""
Jul 21 06:23:31.187062 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.187040    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"]
Jul 21 06:23:31.333271 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.333247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0da85fb2-b1de-43d0-8566-aa35eed5d07e-cert\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.333374 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.333288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da85fb2-b1de-43d0-8566-aa35eed5d07e-metrics-cert\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.333374 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.333323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0da85fb2-b1de-43d0-8566-aa35eed5d07e-manager-config\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.333457 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.333391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjsg\" (UniqueName: \"kubernetes.io/projected/0da85fb2-b1de-43d0-8566-aa35eed5d07e-kube-api-access-lzjsg\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.434077 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.434018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0da85fb2-b1de-43d0-8566-aa35eed5d07e-manager-config\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.434077 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.434052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjsg\" (UniqueName: \"kubernetes.io/projected/0da85fb2-b1de-43d0-8566-aa35eed5d07e-kube-api-access-lzjsg\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.434192 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.434090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0da85fb2-b1de-43d0-8566-aa35eed5d07e-cert\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.434192 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.434131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da85fb2-b1de-43d0-8566-aa35eed5d07e-metrics-cert\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.434645 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.434619    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0da85fb2-b1de-43d0-8566-aa35eed5d07e-manager-config\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.436680 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.436661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0da85fb2-b1de-43d0-8566-aa35eed5d07e-metrics-cert\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.436849 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.436829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0da85fb2-b1de-43d0-8566-aa35eed5d07e-cert\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.452481 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.452458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjsg\" (UniqueName: \"kubernetes.io/projected/0da85fb2-b1de-43d0-8566-aa35eed5d07e-kube-api-access-lzjsg\") pod \"lws-controller-manager-964495ff5-q9x6f\" (UID: \"0da85fb2-b1de-43d0-8566-aa35eed5d07e\") " pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.486474 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.486452    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:31.644417 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:31.644386    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"]
Jul 21 06:23:31.647169 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:23:31.647141    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da85fb2_b1de_43d0_8566_aa35eed5d07e.slice/crio-701a78291de8233eff31007a5861fbdbe74ef571d60cb2629c2a75f1b7a9272d WatchSource:0}: Error finding container 701a78291de8233eff31007a5861fbdbe74ef571d60cb2629c2a75f1b7a9272d: Status 404 returned error can't find the container with id 701a78291de8233eff31007a5861fbdbe74ef571d60cb2629c2a75f1b7a9272d
Jul 21 06:23:32.170019 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:32.169986    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:32.180483 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:32.180455    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f" event={"ID":"0da85fb2-b1de-43d0-8566-aa35eed5d07e","Type":"ContainerStarted","Data":"701a78291de8233eff31007a5861fbdbe74ef571d60cb2629c2a75f1b7a9272d"}
Jul 21 06:23:33.186239 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:33.186209    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f" event={"ID":"0da85fb2-b1de-43d0-8566-aa35eed5d07e","Type":"ContainerStarted","Data":"bb1085b3ebd1b8c4cc84e225552c7767fee35cbfc66d782a8a4dd241ea5c6d32"}
Jul 21 06:23:33.186629 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:33.186328    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:23:33.219807 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:33.219759    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f" podStartSLOduration=0.818567682 podStartE2EDuration="2.219745521s" totalImagesPullingTime="1.401177839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:23:33.218693137 +0000 UTC m=+350.031436806" watchObservedRunningTime="2026-07-21 06:23:33.219745521 +0000 UTC m=+350.032489191"
Jul 21 06:23:36.335084 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.335007    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"]
Jul 21 06:23:36.335459 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.335190    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c" podUID="1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" containerName="discovery" containerID="cri-o://8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307" gracePeriod=30
Jul 21 06:23:36.576627 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.576604    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:36.679024 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.678958    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-dns-cert\") pod \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") "
Jul 21 06:23:36.679024 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.679000    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-token\") pod \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") "
Jul 21 06:23:36.679223 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.679033    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqzb4\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-kube-api-access-gqzb4\") pod \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") "
Jul 21 06:23:36.679223 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.679093    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-local-certs\") pod \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") "
Jul 21 06:23:36.679223 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.679120    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-kubeconfig\") pod \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") "
Jul 21 06:23:36.679223 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.679147    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-cacerts\") pod \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") "
Jul 21 06:23:36.679223 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.679191    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-ca-configmap\") pod \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\" (UID: \"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859\") "
Jul 21 06:23:36.679985 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.679952    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" (UID: "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:23:36.681624 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.681595    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-kube-api-access-gqzb4" (OuterVolumeSpecName: "kube-api-access-gqzb4") pod "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" (UID: "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859"). InnerVolumeSpecName "kube-api-access-gqzb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:23:36.681736 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.681620    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" (UID: "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:23:36.681839 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.681816    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-local-certs" (OuterVolumeSpecName: "local-certs") pod "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" (UID: "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 06:23:36.682120 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.682100    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-cacerts" (OuterVolumeSpecName: "cacerts") pod "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" (UID: "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:23:36.682191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.682150    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" (UID: "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:23:36.682191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.682163    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" (UID: "1fa249e8-3123-4f64-9f6a-0f2a5fcc4859"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:23:36.780423 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.780400    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-local-certs\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:23:36.780423 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.780419    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-kubeconfig\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:23:36.780564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.780428    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-cacerts\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:23:36.780564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.780436    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-ca-configmap\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:23:36.780564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.780445    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-csr-dns-cert\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:23:36.780564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.780453    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-istio-token\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:23:36.780564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:36.780461    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqzb4\" (UniqueName: \"kubernetes.io/projected/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859-kube-api-access-gqzb4\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:23:37.206295 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.206260    2577 generic.go:356] "Generic (PLEG): container finished" podID="1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" containerID="8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307" exitCode=0
Jul 21 06:23:37.206464 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.206307    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"
Jul 21 06:23:37.206464 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.206350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c" event={"ID":"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859","Type":"ContainerDied","Data":"8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307"}
Jul 21 06:23:37.206464 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.206405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c" event={"ID":"1fa249e8-3123-4f64-9f6a-0f2a5fcc4859","Type":"ContainerDied","Data":"d27e6de98d08c09bba1358f6bd63bd89c3c967c9fff7064af99059120262b2fb"}
Jul 21 06:23:37.206464 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.206431    2577 scope.go:117] "RemoveContainer" containerID="8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307"
Jul 21 06:23:37.215160 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.215145    2577 scope.go:117] "RemoveContainer" containerID="8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307"
Jul 21 06:23:37.215429 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:23:37.215411    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307\": container with ID starting with 8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307 not found: ID does not exist" containerID="8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307"
Jul 21 06:23:37.220385 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.215440    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307"} err="failed to get container status \"8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307\": rpc error: code = NotFound desc = could not find container \"8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307\": container with ID starting with 8c8b9c046599fb831156d6d64fcd75951687a073ca8b58306c50fd77ea987307 not found: ID does not exist"
Jul 21 06:23:37.231676 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.231650    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"]
Jul 21 06:23:37.234325 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.234307    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-k8t4c"]
Jul 21 06:23:37.713101 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:37.713071    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" path="/var/lib/kubelet/pods/1fa249e8-3123-4f64-9f6a-0f2a5fcc4859/volumes"
Jul 21 06:23:39.172261 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:39.172234    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jbj6f"
Jul 21 06:23:44.193412 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:23:44.193373    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-964495ff5-q9x6f"
Jul 21 06:24:24.535996 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.535963    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-742nx"]
Jul 21 06:24:24.536398 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.536249    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" containerName="discovery"
Jul 21 06:24:24.536398 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.536259    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" containerName="discovery"
Jul 21 06:24:24.536398 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.536313    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa249e8-3123-4f64-9f6a-0f2a5fcc4859" containerName="discovery"
Jul 21 06:24:24.539376 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.539357    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-742nx"
Jul 21 06:24:24.542147 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.542118    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 06:24:24.542147 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.542118    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 06:24:24.543035 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.543017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-jshmc\""
Jul 21 06:24:24.547683 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.547420    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-742nx"]
Jul 21 06:24:24.617768 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.617738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tgjn\" (UniqueName: \"kubernetes.io/projected/562401bc-9480-4fd8-8311-5d24dc51f974-kube-api-access-5tgjn\") pod \"kuadrant-operator-catalog-742nx\" (UID: \"562401bc-9480-4fd8-8311-5d24dc51f974\") " pod="kuadrant-system/kuadrant-operator-catalog-742nx"
Jul 21 06:24:24.719061 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.719026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tgjn\" (UniqueName: \"kubernetes.io/projected/562401bc-9480-4fd8-8311-5d24dc51f974-kube-api-access-5tgjn\") pod \"kuadrant-operator-catalog-742nx\" (UID: \"562401bc-9480-4fd8-8311-5d24dc51f974\") " pod="kuadrant-system/kuadrant-operator-catalog-742nx"
Jul 21 06:24:24.726745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.726727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tgjn\" (UniqueName: \"kubernetes.io/projected/562401bc-9480-4fd8-8311-5d24dc51f974-kube-api-access-5tgjn\") pod \"kuadrant-operator-catalog-742nx\" (UID: \"562401bc-9480-4fd8-8311-5d24dc51f974\") " pod="kuadrant-system/kuadrant-operator-catalog-742nx"
Jul 21 06:24:24.850949 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.850884    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-742nx"
Jul 21 06:24:24.922803 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.922770    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-742nx"]
Jul 21 06:24:24.981317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:24.981294    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-742nx"]
Jul 21 06:24:24.983956 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:24:24.983923    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562401bc_9480_4fd8_8311_5d24dc51f974.slice/crio-92c0728dd1a7f79498741e75f68aeb33433d892f2fc67510efb41248bca89176 WatchSource:0}: Error finding container 92c0728dd1a7f79498741e75f68aeb33433d892f2fc67510efb41248bca89176: Status 404 returned error can't find the container with id 92c0728dd1a7f79498741e75f68aeb33433d892f2fc67510efb41248bca89176
Jul 21 06:24:25.120298 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.120238    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jw2bc"]
Jul 21 06:24:25.124837 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.124819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:25.130602 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.130578    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jw2bc"]
Jul 21 06:24:25.222496 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.222475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnjsp\" (UniqueName: \"kubernetes.io/projected/ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc-kube-api-access-bnjsp\") pod \"kuadrant-operator-catalog-jw2bc\" (UID: \"ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc\") " pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:25.323414 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.323386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnjsp\" (UniqueName: \"kubernetes.io/projected/ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc-kube-api-access-bnjsp\") pod \"kuadrant-operator-catalog-jw2bc\" (UID: \"ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc\") " pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:25.330763 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.330744    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnjsp\" (UniqueName: \"kubernetes.io/projected/ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc-kube-api-access-bnjsp\") pod \"kuadrant-operator-catalog-jw2bc\" (UID: \"ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc\") " pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:25.410428 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.410369    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-742nx" event={"ID":"562401bc-9480-4fd8-8311-5d24dc51f974","Type":"ContainerStarted","Data":"92c0728dd1a7f79498741e75f68aeb33433d892f2fc67510efb41248bca89176"}
Jul 21 06:24:25.441830 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.441801    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:25.572862 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:25.572830    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jw2bc"]
Jul 21 06:24:25.575709 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:24:25.575683    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5b5dea_3ac9_49f9_bc61_3035b5b39fdc.slice/crio-e021b9250369c18e58562337e5333dccee9143abab345c646141ed84105a28ef WatchSource:0}: Error finding container e021b9250369c18e58562337e5333dccee9143abab345c646141ed84105a28ef: Status 404 returned error can't find the container with id e021b9250369c18e58562337e5333dccee9143abab345c646141ed84105a28ef
Jul 21 06:24:26.416277 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:26.416243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc" event={"ID":"ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc","Type":"ContainerStarted","Data":"e021b9250369c18e58562337e5333dccee9143abab345c646141ed84105a28ef"}
Jul 21 06:24:28.425498 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.425457    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-742nx" event={"ID":"562401bc-9480-4fd8-8311-5d24dc51f974","Type":"ContainerStarted","Data":"d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f"}
Jul 21 06:24:28.425976 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.425555    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-742nx" podUID="562401bc-9480-4fd8-8311-5d24dc51f974" containerName="registry-server" containerID="cri-o://d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f" gracePeriod=2
Jul 21 06:24:28.427207 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.427175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc" event={"ID":"ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc","Type":"ContainerStarted","Data":"077ce3d52fe1f58d732bb99a859110bc7c00bfb82e8934b9a2a1b6f18114d3ae"}
Jul 21 06:24:28.440629 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.440588    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-742nx" podStartSLOduration=2.035668309 podStartE2EDuration="4.440573264s" totalImagesPullingTime="2.404904955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:24:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:24:28.439451245 +0000 UTC m=+405.252194928" watchObservedRunningTime="2026-07-21 06:24:28.440573264 +0000 UTC m=+405.253316933"
Jul 21 06:24:28.453838 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.453795    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc" podStartSLOduration=1.644039272 podStartE2EDuration="3.453783071s" totalImagesPullingTime="1.809743799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:24:28.452975324 +0000 UTC m=+405.265718994" watchObservedRunningTime="2026-07-21 06:24:28.453783071 +0000 UTC m=+405.266526740"
Jul 21 06:24:28.675402 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.675380    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-742nx"
Jul 21 06:24:28.752862 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.752781    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tgjn\" (UniqueName: \"kubernetes.io/projected/562401bc-9480-4fd8-8311-5d24dc51f974-kube-api-access-5tgjn\") pod \"562401bc-9480-4fd8-8311-5d24dc51f974\" (UID: \"562401bc-9480-4fd8-8311-5d24dc51f974\") "
Jul 21 06:24:28.755004 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.754977    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/562401bc-9480-4fd8-8311-5d24dc51f974-kube-api-access-5tgjn" (OuterVolumeSpecName: "kube-api-access-5tgjn") pod "562401bc-9480-4fd8-8311-5d24dc51f974" (UID: "562401bc-9480-4fd8-8311-5d24dc51f974"). InnerVolumeSpecName "kube-api-access-5tgjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:24:28.853433 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:28.853398    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tgjn\" (UniqueName: \"kubernetes.io/projected/562401bc-9480-4fd8-8311-5d24dc51f974-kube-api-access-5tgjn\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:24:29.433647 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.433610    2577 generic.go:356] "Generic (PLEG): container finished" podID="562401bc-9480-4fd8-8311-5d24dc51f974" containerID="d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f" exitCode=0
Jul 21 06:24:29.434114 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.433658    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-742nx"
Jul 21 06:24:29.434114 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.433685    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-742nx" event={"ID":"562401bc-9480-4fd8-8311-5d24dc51f974","Type":"ContainerDied","Data":"d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f"}
Jul 21 06:24:29.434114 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.433732    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-742nx" event={"ID":"562401bc-9480-4fd8-8311-5d24dc51f974","Type":"ContainerDied","Data":"92c0728dd1a7f79498741e75f68aeb33433d892f2fc67510efb41248bca89176"}
Jul 21 06:24:29.434114 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.433753    2577 scope.go:117] "RemoveContainer" containerID="d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f"
Jul 21 06:24:29.442412 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.442397    2577 scope.go:117] "RemoveContainer" containerID="d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f"
Jul 21 06:24:29.442689 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:24:29.442661    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f\": container with ID starting with d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f not found: ID does not exist" containerID="d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f"
Jul 21 06:24:29.442781 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.442696    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f"} err="failed to get container status \"d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f\": rpc error: code = NotFound desc = could not find container \"d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f\": container with ID starting with d06871d8e4e8399be27c552ee16ec9bce1b19a1c574f65a65d658bcf6b79a96f not found: ID does not exist"
Jul 21 06:24:29.454447 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.454427    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-742nx"]
Jul 21 06:24:29.460430 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.460402    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-742nx"]
Jul 21 06:24:29.712821 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:29.712745    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="562401bc-9480-4fd8-8311-5d24dc51f974" path="/var/lib/kubelet/pods/562401bc-9480-4fd8-8311-5d24dc51f974/volumes"
Jul 21 06:24:35.442327 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:35.442291    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:35.442814 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:35.442359    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:35.465111 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:35.465084    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:35.486894 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:35.486868    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-jw2bc"
Jul 21 06:24:52.924521 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.924495    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57977fbb9b-rz4m7"]
Jul 21 06:24:52.924873 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.924817    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="562401bc-9480-4fd8-8311-5d24dc51f974" containerName="registry-server"
Jul 21 06:24:52.924873 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.924828    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="562401bc-9480-4fd8-8311-5d24dc51f974" containerName="registry-server"
Jul 21 06:24:52.924957 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.924886    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="562401bc-9480-4fd8-8311-5d24dc51f974" containerName="registry-server"
Jul 21 06:24:52.929386 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.929365    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:52.932068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.932048    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 06:24:52.932205 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.932089    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 06:24:52.932309 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.932211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 06:24:52.932390 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.932326    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 06:24:52.932572 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.932528    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zcncg\""
Jul 21 06:24:52.932668 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.932607    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 06:24:52.936973 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.936953    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 06:24:52.937897 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:52.937878    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57977fbb9b-rz4m7"]
Jul 21 06:24:53.032923 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.032899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-serving-cert\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.032923 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.032925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-trusted-ca-bundle\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.033101 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.032953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-config\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.033101 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.032975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-service-ca\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.033101 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.033045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-oauth-config\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.033244 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.033099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nswf2\" (UniqueName: \"kubernetes.io/projected/ec71de9e-ac04-47cf-9878-50e5cf451a20-kube-api-access-nswf2\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.033244 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.033159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-oauth-serving-cert\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.134462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.134438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-serving-cert\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.134571 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.134463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-trusted-ca-bundle\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.134571 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.134491    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-config\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.134571 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.134512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-service-ca\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.134571 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.134566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-oauth-config\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.134787 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.134764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nswf2\" (UniqueName: \"kubernetes.io/projected/ec71de9e-ac04-47cf-9878-50e5cf451a20-kube-api-access-nswf2\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.134842 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.134826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-oauth-serving-cert\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.135270 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.135250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-config\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.135356 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.135313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-service-ca\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.135424 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.135408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-oauth-serving-cert\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.135424 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.135414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec71de9e-ac04-47cf-9878-50e5cf451a20-trusted-ca-bundle\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.137439 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.137417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-serving-cert\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.137507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.137419    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec71de9e-ac04-47cf-9878-50e5cf451a20-console-oauth-config\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.143009 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.142988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nswf2\" (UniqueName: \"kubernetes.io/projected/ec71de9e-ac04-47cf-9878-50e5cf451a20-kube-api-access-nswf2\") pod \"console-57977fbb9b-rz4m7\" (UID: \"ec71de9e-ac04-47cf-9878-50e5cf451a20\") " pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.241379 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.241324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:24:53.367693 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.367664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57977fbb9b-rz4m7"]
Jul 21 06:24:53.370350 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:24:53.370323    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec71de9e_ac04_47cf_9878_50e5cf451a20.slice/crio-6b17d79fc906b28e0a6675326c7594b10e28cdb2dc7a2ca2f2df8241b4008261 WatchSource:0}: Error finding container 6b17d79fc906b28e0a6675326c7594b10e28cdb2dc7a2ca2f2df8241b4008261: Status 404 returned error can't find the container with id 6b17d79fc906b28e0a6675326c7594b10e28cdb2dc7a2ca2f2df8241b4008261
Jul 21 06:24:53.537638 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.537596    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57977fbb9b-rz4m7" event={"ID":"ec71de9e-ac04-47cf-9878-50e5cf451a20","Type":"ContainerStarted","Data":"852891f5c83db3c1b211444840e6bdf36f0a1843b127f978e3827a9276b23cc0"}
Jul 21 06:24:53.537785 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.537662    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57977fbb9b-rz4m7" event={"ID":"ec71de9e-ac04-47cf-9878-50e5cf451a20","Type":"ContainerStarted","Data":"6b17d79fc906b28e0a6675326c7594b10e28cdb2dc7a2ca2f2df8241b4008261"}
Jul 21 06:24:53.576194 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.576149    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57977fbb9b-rz4m7" podStartSLOduration=1.576134556 podStartE2EDuration="1.576134556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:24:53.574709758 +0000 UTC m=+430.387453429" watchObservedRunningTime="2026-07-21 06:24:53.576134556 +0000 UTC m=+430.388878226"
Jul 21 06:24:53.625935 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.625905    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"]
Jul 21 06:24:53.629168 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.629152    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"
Jul 21 06:24:53.631760 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.631737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fkldc\""
Jul 21 06:24:53.639088 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.639062    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"]
Jul 21 06:24:53.739338 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.739310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65cjp\" (UniqueName: \"kubernetes.io/projected/2f9ead72-6268-4518-88df-2b3abdb98eff-kube-api-access-65cjp\") pod \"authorino-operator-75cc8d5cb7-2r56g\" (UID: \"2f9ead72-6268-4518-88df-2b3abdb98eff\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"
Jul 21 06:24:53.840417 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.840352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65cjp\" (UniqueName: \"kubernetes.io/projected/2f9ead72-6268-4518-88df-2b3abdb98eff-kube-api-access-65cjp\") pod \"authorino-operator-75cc8d5cb7-2r56g\" (UID: \"2f9ead72-6268-4518-88df-2b3abdb98eff\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"
Jul 21 06:24:53.851839 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.851816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65cjp\" (UniqueName: \"kubernetes.io/projected/2f9ead72-6268-4518-88df-2b3abdb98eff-kube-api-access-65cjp\") pod \"authorino-operator-75cc8d5cb7-2r56g\" (UID: \"2f9ead72-6268-4518-88df-2b3abdb98eff\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"
Jul 21 06:24:53.939973 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:53.939947    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"
Jul 21 06:24:54.076261 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:54.076239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"]
Jul 21 06:24:54.078799 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:24:54.078779    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9ead72_6268_4518_88df_2b3abdb98eff.slice/crio-3e316c5edd516808f35de578bf66b3a03618b9f7bc56436f2835cbb1c519c622 WatchSource:0}: Error finding container 3e316c5edd516808f35de578bf66b3a03618b9f7bc56436f2835cbb1c519c622: Status 404 returned error can't find the container with id 3e316c5edd516808f35de578bf66b3a03618b9f7bc56436f2835cbb1c519c622
Jul 21 06:24:54.543350 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:54.543315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g" event={"ID":"2f9ead72-6268-4518-88df-2b3abdb98eff","Type":"ContainerStarted","Data":"3e316c5edd516808f35de578bf66b3a03618b9f7bc56436f2835cbb1c519c622"}
Jul 21 06:24:56.554330 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.554295    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g" event={"ID":"2f9ead72-6268-4518-88df-2b3abdb98eff","Type":"ContainerStarted","Data":"967040f7585ef5364825c1020bee37794f1e5d58acb2d7d50e20e9a9ac2a6436"}
Jul 21 06:24:56.554714 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.554372    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"
Jul 21 06:24:56.572236 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.572172    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g" podStartSLOduration=1.213714907 podStartE2EDuration="3.572158489s" totalImagesPullingTime="2.358443582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:24:56.571418865 +0000 UTC m=+433.384162536" watchObservedRunningTime="2026-07-21 06:24:56.572158489 +0000 UTC m=+433.384902159"
Jul 21 06:24:56.822408 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.822379    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"]
Jul 21 06:24:56.825750 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.825732    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"
Jul 21 06:24:56.828282 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.828261    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 21 06:24:56.828466 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.828448    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vgz4n\""
Jul 21 06:24:56.836280 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.836260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"]
Jul 21 06:24:56.966294 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:56.966268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc9hn\" (UniqueName: \"kubernetes.io/projected/9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada-kube-api-access-wc9hn\") pod \"dns-operator-controller-manager-864dd78c4c-9zxc6\" (UID: \"9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"
Jul 21 06:24:57.067253 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:57.067230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc9hn\" (UniqueName: \"kubernetes.io/projected/9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada-kube-api-access-wc9hn\") pod \"dns-operator-controller-manager-864dd78c4c-9zxc6\" (UID: \"9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"
Jul 21 06:24:57.079580 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:57.079511    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc9hn\" (UniqueName: \"kubernetes.io/projected/9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada-kube-api-access-wc9hn\") pod \"dns-operator-controller-manager-864dd78c4c-9zxc6\" (UID: \"9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"
Jul 21 06:24:57.136456 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:57.136437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"
Jul 21 06:24:57.266874 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:57.266773    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"]
Jul 21 06:24:57.269606 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:24:57.269581    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9279a2dc_ca6f_4f3b_b54d_3e008ebc1ada.slice/crio-5dd64bcf17e20f1ad69d340a18f1251d1f6d5b2f57013c24c29b2e999c762239 WatchSource:0}: Error finding container 5dd64bcf17e20f1ad69d340a18f1251d1f6d5b2f57013c24c29b2e999c762239: Status 404 returned error can't find the container with id 5dd64bcf17e20f1ad69d340a18f1251d1f6d5b2f57013c24c29b2e999c762239
Jul 21 06:24:57.559758 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:57.559733    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6" event={"ID":"9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada","Type":"ContainerStarted","Data":"5dd64bcf17e20f1ad69d340a18f1251d1f6d5b2f57013c24c29b2e999c762239"}
Jul 21 06:24:59.571662 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:59.571628    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6" event={"ID":"9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada","Type":"ContainerStarted","Data":"94ed62fee5d4b49c2bce1bd5b7552d0ec8ece085b36d06a1b171fce995a3f51e"}
Jul 21 06:24:59.572096 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:59.571768    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"
Jul 21 06:24:59.588658 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:24:59.588617    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6" podStartSLOduration=1.476802237 podStartE2EDuration="3.588603584s" totalImagesPullingTime="2.111801347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:24:59.588168875 +0000 UTC m=+436.400912560" watchObservedRunningTime="2026-07-21 06:24:59.588603584 +0000 UTC m=+436.401347253"
Jul 21 06:25:00.057893 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.057860    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"]
Jul 21 06:25:00.061144 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.061128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:00.063704 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.063687    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tjq57\""
Jul 21 06:25:00.072605 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.072585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"]
Jul 21 06:25:00.197396 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.197362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr8gb\" (UniqueName: \"kubernetes.io/projected/31a3f617-f148-4e6e-94c1-104c806e40cd-kube-api-access-pr8gb\") pod \"limitador-operator-controller-manager-859d7b78bd-w77vz\" (UID: \"31a3f617-f148-4e6e-94c1-104c806e40cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:00.297840 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.297813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8gb\" (UniqueName: \"kubernetes.io/projected/31a3f617-f148-4e6e-94c1-104c806e40cd-kube-api-access-pr8gb\") pod \"limitador-operator-controller-manager-859d7b78bd-w77vz\" (UID: \"31a3f617-f148-4e6e-94c1-104c806e40cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:00.305388 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.305362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr8gb\" (UniqueName: \"kubernetes.io/projected/31a3f617-f148-4e6e-94c1-104c806e40cd-kube-api-access-pr8gb\") pod \"limitador-operator-controller-manager-859d7b78bd-w77vz\" (UID: \"31a3f617-f148-4e6e-94c1-104c806e40cd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:00.371368 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.371308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:00.501842 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.501818    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"]
Jul 21 06:25:00.504306 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:25:00.504277    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a3f617_f148_4e6e_94c1_104c806e40cd.slice/crio-b90c3b3311ba704bc98af65314366f3d46058dd40fbdf10f52bfdf384563710d WatchSource:0}: Error finding container b90c3b3311ba704bc98af65314366f3d46058dd40fbdf10f52bfdf384563710d: Status 404 returned error can't find the container with id b90c3b3311ba704bc98af65314366f3d46058dd40fbdf10f52bfdf384563710d
Jul 21 06:25:00.577039 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:00.576998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz" event={"ID":"31a3f617-f148-4e6e-94c1-104c806e40cd","Type":"ContainerStarted","Data":"b90c3b3311ba704bc98af65314366f3d46058dd40fbdf10f52bfdf384563710d"}
Jul 21 06:25:02.588472 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:02.588438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz" event={"ID":"31a3f617-f148-4e6e-94c1-104c806e40cd","Type":"ContainerStarted","Data":"a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888"}
Jul 21 06:25:02.588856 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:02.588564    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:02.606519 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:02.606475    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz" podStartSLOduration=0.965228275 podStartE2EDuration="2.606461414s" totalImagesPullingTime="1.641233139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:25:02.605574209 +0000 UTC m=+439.418317878" watchObservedRunningTime="2026-07-21 06:25:02.606461414 +0000 UTC m=+439.419205084"
Jul 21 06:25:03.241947 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:03.241916    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:25:03.242115 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:03.241987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:25:03.246651 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:03.246629    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:25:03.596814 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:03.596791    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57977fbb9b-rz4m7"
Jul 21 06:25:07.562595 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:07.562510    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2r56g"
Jul 21 06:25:10.579214 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:10.579182    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9zxc6"
Jul 21 06:25:13.595217 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:13.595182    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:14.289254 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.289223    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"]
Jul 21 06:25:14.292495 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.292479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.294959 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.294931    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 06:25:14.294959 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.294931    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 06:25:14.295125 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.294943    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jf2qz\""
Jul 21 06:25:14.300908 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.300883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"]
Jul 21 06:25:14.409897 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.409869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbhnn\" (UniqueName: \"kubernetes.io/projected/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-kube-api-access-jbhnn\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.410022 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.409900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.410022 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.409921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.511215 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.511181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbhnn\" (UniqueName: \"kubernetes.io/projected/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-kube-api-access-jbhnn\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.511215 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.511216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.511396 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.511233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.511834 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.511815    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.513749 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.513729    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.518414 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.518391    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbhnn\" (UniqueName: \"kubernetes.io/projected/dc6a04a4-80c5-4c25-a459-36b2a33cc57b-kube-api-access-jbhnn\") pod \"kuadrant-console-plugin-66b5774985-2kzb4\" (UID: \"dc6a04a4-80c5-4c25-a459-36b2a33cc57b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.602841 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.602789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"
Jul 21 06:25:14.731753 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:14.731727    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4"]
Jul 21 06:25:14.734311 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:25:14.734281    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc6a04a4_80c5_4c25_a459_36b2a33cc57b.slice/crio-c0782baf7cee8a02b8baf41a8b51f1ad9accd29a88ae6e5d07873f5fc82e34a4 WatchSource:0}: Error finding container c0782baf7cee8a02b8baf41a8b51f1ad9accd29a88ae6e5d07873f5fc82e34a4: Status 404 returned error can't find the container with id c0782baf7cee8a02b8baf41a8b51f1ad9accd29a88ae6e5d07873f5fc82e34a4
Jul 21 06:25:15.647758 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:15.647729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4" event={"ID":"dc6a04a4-80c5-4c25-a459-36b2a33cc57b","Type":"ContainerStarted","Data":"c0782baf7cee8a02b8baf41a8b51f1ad9accd29a88ae6e5d07873f5fc82e34a4"}
Jul 21 06:25:24.642447 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.642413    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"]
Jul 21 06:25:24.662602 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.662572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"]
Jul 21 06:25:24.662777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.662673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:24.665478 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.665344    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dsmhd\""
Jul 21 06:25:24.666481 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.666458    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"]
Jul 21 06:25:24.666764 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.666714    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" containerName="manager" containerID="cri-o://a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888" gracePeriod=2
Jul 21 06:25:24.678065 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.678001    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"]
Jul 21 06:25:24.686473 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.686364    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"]
Jul 21 06:25:24.686986 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.686886    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" containerName="manager"
Jul 21 06:25:24.686986 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.686907    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" containerName="manager"
Jul 21 06:25:24.687135 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.686998    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" containerName="manager"
Jul 21 06:25:24.687216 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:25:24.686880    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w77vz\" is forbidden: User \"system:node:ip-10-0-128-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-56.ec2.internal' and this object" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:24.690683 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.690664    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"
Jul 21 06:25:24.704357 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.704333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"]
Jul 21 06:25:24.706549 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.706491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49487625-2bfe-4f36-a49f-44d37fefe8dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hdmnb\" (UID: \"49487625-2bfe-4f36-a49f-44d37fefe8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:24.706668 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.706554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm7jj\" (UniqueName: \"kubernetes.io/projected/49487625-2bfe-4f36-a49f-44d37fefe8dd-kube-api-access-mm7jj\") pod \"kuadrant-operator-controller-manager-55467d9f7-hdmnb\" (UID: \"49487625-2bfe-4f36-a49f-44d37fefe8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:24.706668 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.706634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbf4x\" (UniqueName: \"kubernetes.io/projected/843f88db-efc6-4ccf-b509-e7bbbc8f64ef-kube-api-access-tbf4x\") pod \"limitador-operator-controller-manager-859d7b78bd-bdm6b\" (UID: \"843f88db-efc6-4ccf-b509-e7bbbc8f64ef\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"
Jul 21 06:25:24.720480 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:25:24.720417    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w77vz\" is forbidden: User \"system:node:ip-10-0-128-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-56.ec2.internal' and this object" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:24.807659 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.807626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49487625-2bfe-4f36-a49f-44d37fefe8dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hdmnb\" (UID: \"49487625-2bfe-4f36-a49f-44d37fefe8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:24.807805 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.807675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm7jj\" (UniqueName: \"kubernetes.io/projected/49487625-2bfe-4f36-a49f-44d37fefe8dd-kube-api-access-mm7jj\") pod \"kuadrant-operator-controller-manager-55467d9f7-hdmnb\" (UID: \"49487625-2bfe-4f36-a49f-44d37fefe8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:24.807805 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.807746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbf4x\" (UniqueName: \"kubernetes.io/projected/843f88db-efc6-4ccf-b509-e7bbbc8f64ef-kube-api-access-tbf4x\") pod \"limitador-operator-controller-manager-859d7b78bd-bdm6b\" (UID: \"843f88db-efc6-4ccf-b509-e7bbbc8f64ef\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"
Jul 21 06:25:24.808058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.808032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49487625-2bfe-4f36-a49f-44d37fefe8dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-hdmnb\" (UID: \"49487625-2bfe-4f36-a49f-44d37fefe8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:24.822045 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.822017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm7jj\" (UniqueName: \"kubernetes.io/projected/49487625-2bfe-4f36-a49f-44d37fefe8dd-kube-api-access-mm7jj\") pod \"kuadrant-operator-controller-manager-55467d9f7-hdmnb\" (UID: \"49487625-2bfe-4f36-a49f-44d37fefe8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:24.822273 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.822253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbf4x\" (UniqueName: \"kubernetes.io/projected/843f88db-efc6-4ccf-b509-e7bbbc8f64ef-kube-api-access-tbf4x\") pod \"limitador-operator-controller-manager-859d7b78bd-bdm6b\" (UID: \"843f88db-efc6-4ccf-b509-e7bbbc8f64ef\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"
Jul 21 06:25:24.980149 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:24.980069    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:25.043219 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:25.043190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"
Jul 21 06:25:36.615985 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.615949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"]
Jul 21 06:25:36.617800 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:25:36.617772    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843f88db_efc6_4ccf_b509_e7bbbc8f64ef.slice/crio-f58e3bddcf3ab2f58ce26c06ae777bfbca1ce48456fbfbc2f7c2a804cdbc7836 WatchSource:0}: Error finding container f58e3bddcf3ab2f58ce26c06ae777bfbca1ce48456fbfbc2f7c2a804cdbc7836: Status 404 returned error can't find the container with id f58e3bddcf3ab2f58ce26c06ae777bfbca1ce48456fbfbc2f7c2a804cdbc7836
Jul 21 06:25:36.618994 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.618896    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:36.621099 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:25:36.621072    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w77vz\" is forbidden: User \"system:node:ip-10-0-128-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-56.ec2.internal' and this object" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:36.635004 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.634987    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"]
Jul 21 06:25:36.637920 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:25:36.637883    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49487625_2bfe_4f36_a49f_44d37fefe8dd.slice/crio-d9cf344f2443b366134a2ccf485417f85a37c59a8588ef91a0c3db9bbe89c4a7 WatchSource:0}: Error finding container d9cf344f2443b366134a2ccf485417f85a37c59a8588ef91a0c3db9bbe89c4a7: Status 404 returned error can't find the container with id d9cf344f2443b366134a2ccf485417f85a37c59a8588ef91a0c3db9bbe89c4a7
Jul 21 06:25:36.715033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.715006    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr8gb\" (UniqueName: \"kubernetes.io/projected/31a3f617-f148-4e6e-94c1-104c806e40cd-kube-api-access-pr8gb\") pod \"31a3f617-f148-4e6e-94c1-104c806e40cd\" (UID: \"31a3f617-f148-4e6e-94c1-104c806e40cd\") "
Jul 21 06:25:36.716944 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.716896    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31a3f617-f148-4e6e-94c1-104c806e40cd-kube-api-access-pr8gb" (OuterVolumeSpecName: "kube-api-access-pr8gb") pod "31a3f617-f148-4e6e-94c1-104c806e40cd" (UID: "31a3f617-f148-4e6e-94c1-104c806e40cd"). InnerVolumeSpecName "kube-api-access-pr8gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:25:36.766730 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.766707    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4" event={"ID":"dc6a04a4-80c5-4c25-a459-36b2a33cc57b","Type":"ContainerStarted","Data":"3085585d6c8d7e300e944d658820554777b662c204c5731989fb192da44738e7"}
Jul 21 06:25:36.768228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.768201    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b" event={"ID":"843f88db-efc6-4ccf-b509-e7bbbc8f64ef","Type":"ContainerStarted","Data":"e58ae81bbf35462090a116582d51627214d0b9fd9fb51270b3fa208f879afe1c"}
Jul 21 06:25:36.768323 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.768249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b" event={"ID":"843f88db-efc6-4ccf-b509-e7bbbc8f64ef","Type":"ContainerStarted","Data":"f58e3bddcf3ab2f58ce26c06ae777bfbca1ce48456fbfbc2f7c2a804cdbc7836"}
Jul 21 06:25:36.768391 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.768320    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"
Jul 21 06:25:36.769007 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:25:36.768977    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w77vz\" is forbidden: User \"system:node:ip-10-0-128-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-56.ec2.internal' and this object" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:36.769454 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.769437    2577 generic.go:356] "Generic (PLEG): container finished" podID="31a3f617-f148-4e6e-94c1-104c806e40cd" containerID="a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888" exitCode=0
Jul 21 06:25:36.769513 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.769468    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:36.769575 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.769516    2577 scope.go:117] "RemoveContainer" containerID="a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888"
Jul 21 06:25:36.771040 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.771016    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb" event={"ID":"49487625-2bfe-4f36-a49f-44d37fefe8dd","Type":"ContainerStarted","Data":"d9cf344f2443b366134a2ccf485417f85a37c59a8588ef91a0c3db9bbe89c4a7"}
Jul 21 06:25:36.778287 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.778268    2577 scope.go:117] "RemoveContainer" containerID="a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888"
Jul 21 06:25:36.778626 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:25:36.778601    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888\": container with ID starting with a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888 not found: ID does not exist" containerID="a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888"
Jul 21 06:25:36.778706 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.778638    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888"} err="failed to get container status \"a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888\": rpc error: code = NotFound desc = could not find container \"a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888\": container with ID starting with a9331fcfe8f0741a074ceebe4b678eb307019476193a87c617f27654605b7888 not found: ID does not exist"
Jul 21 06:25:36.784524 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.784485    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2kzb4" podStartSLOduration=0.956076801 podStartE2EDuration="22.784474727s" totalImagesPullingTime="21.828397926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:25:36.783468717 +0000 UTC m=+473.596212400" watchObservedRunningTime="2026-07-21 06:25:36.784474727 +0000 UTC m=+473.597218397"
Jul 21 06:25:36.800847 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.800769    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b" podStartSLOduration=12.800753676 podStartE2EDuration="12.800753676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:25:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:25:36.800450265 +0000 UTC m=+473.613193932" watchObservedRunningTime="2026-07-21 06:25:36.800753676 +0000 UTC m=+473.613497346"
Jul 21 06:25:36.802554 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:25:36.802498    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-w77vz\" is forbidden: User \"system:node:ip-10-0-128-56.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-56.ec2.internal' and this object" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-w77vz"
Jul 21 06:25:36.816028 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:36.816005    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr8gb\" (UniqueName: \"kubernetes.io/projected/31a3f617-f148-4e6e-94c1-104c806e40cd-kube-api-access-pr8gb\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:25:37.712857 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:37.712824    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31a3f617-f148-4e6e-94c1-104c806e40cd" path="/var/lib/kubelet/pods/31a3f617-f148-4e6e-94c1-104c806e40cd/volumes"
Jul 21 06:25:40.801701 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:40.801663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb" event={"ID":"49487625-2bfe-4f36-a49f-44d37fefe8dd","Type":"ContainerStarted","Data":"1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7"}
Jul 21 06:25:40.802099 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:40.801778    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:25:40.820972 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:40.820927    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb" podStartSLOduration=12.837719117 podStartE2EDuration="16.820915804s" totalImagesPullingTime="3.983196687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:25:40.819636063 +0000 UTC m=+477.632379767" watchObservedRunningTime="2026-07-21 06:25:40.820915804 +0000 UTC m=+477.633659474"
Jul 21 06:25:47.778626 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:47.778597    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bdm6b"
Jul 21 06:25:51.808835 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:25:51.808807    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:26:04.103870 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.103841    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"]
Jul 21 06:26:04.104343 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.104036    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb" podUID="49487625-2bfe-4f36-a49f-44d37fefe8dd" containerName="manager" containerID="cri-o://1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7" gracePeriod=10
Jul 21 06:26:04.407707 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.407684    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:26:04.538488 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.538456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49487625-2bfe-4f36-a49f-44d37fefe8dd-extensions-socket-volume\") pod \"49487625-2bfe-4f36-a49f-44d37fefe8dd\" (UID: \"49487625-2bfe-4f36-a49f-44d37fefe8dd\") "
Jul 21 06:26:04.538630 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.538514    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mm7jj\" (UniqueName: \"kubernetes.io/projected/49487625-2bfe-4f36-a49f-44d37fefe8dd-kube-api-access-mm7jj\") pod \"49487625-2bfe-4f36-a49f-44d37fefe8dd\" (UID: \"49487625-2bfe-4f36-a49f-44d37fefe8dd\") "
Jul 21 06:26:04.538871 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.538840    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49487625-2bfe-4f36-a49f-44d37fefe8dd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "49487625-2bfe-4f36-a49f-44d37fefe8dd" (UID: "49487625-2bfe-4f36-a49f-44d37fefe8dd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 06:26:04.540667 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.540650    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49487625-2bfe-4f36-a49f-44d37fefe8dd-kube-api-access-mm7jj" (OuterVolumeSpecName: "kube-api-access-mm7jj") pod "49487625-2bfe-4f36-a49f-44d37fefe8dd" (UID: "49487625-2bfe-4f36-a49f-44d37fefe8dd"). InnerVolumeSpecName "kube-api-access-mm7jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:26:04.639982 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.639932    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/49487625-2bfe-4f36-a49f-44d37fefe8dd-extensions-socket-volume\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:26:04.639982 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.639956    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mm7jj\" (UniqueName: \"kubernetes.io/projected/49487625-2bfe-4f36-a49f-44d37fefe8dd-kube-api-access-mm7jj\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:26:04.905013 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.904939    2577 generic.go:356] "Generic (PLEG): container finished" podID="49487625-2bfe-4f36-a49f-44d37fefe8dd" containerID="1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7" exitCode=0
Jul 21 06:26:04.905013 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.904986    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"
Jul 21 06:26:04.905182 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.905024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb" event={"ID":"49487625-2bfe-4f36-a49f-44d37fefe8dd","Type":"ContainerDied","Data":"1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7"}
Jul 21 06:26:04.905182 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.905079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb" event={"ID":"49487625-2bfe-4f36-a49f-44d37fefe8dd","Type":"ContainerDied","Data":"d9cf344f2443b366134a2ccf485417f85a37c59a8588ef91a0c3db9bbe89c4a7"}
Jul 21 06:26:04.905182 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.905100    2577 scope.go:117] "RemoveContainer" containerID="1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7"
Jul 21 06:26:04.914474 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.914454    2577 scope.go:117] "RemoveContainer" containerID="1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7"
Jul 21 06:26:04.914750 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:26:04.914734    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7\": container with ID starting with 1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7 not found: ID does not exist" containerID="1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7"
Jul 21 06:26:04.914799 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.914758    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7"} err="failed to get container status \"1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7\": rpc error: code = NotFound desc = could not find container \"1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7\": container with ID starting with 1a2bbe0f37821a3b34c339dd7c97afd32f0c7d73cfa5afd9f3303ded586978d7 not found: ID does not exist"
Jul 21 06:26:04.925717 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.925686    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"]
Jul 21 06:26:04.930952 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:04.930931    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-hdmnb"]
Jul 21 06:26:05.713088 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:05.713053    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49487625-2bfe-4f36-a49f-44d37fefe8dd" path="/var/lib/kubelet/pods/49487625-2bfe-4f36-a49f-44d37fefe8dd/volumes"
Jul 21 06:26:11.179195 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.179160    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"]
Jul 21 06:26:11.179625 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.179606    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49487625-2bfe-4f36-a49f-44d37fefe8dd" containerName="manager"
Jul 21 06:26:11.179698 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.179636    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49487625-2bfe-4f36-a49f-44d37fefe8dd" containerName="manager"
Jul 21 06:26:11.179742 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.179724    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49487625-2bfe-4f36-a49f-44d37fefe8dd" containerName="manager"
Jul 21 06:26:11.183174 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.183155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:11.185579 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.185557    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 06:26:11.192630 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.189587    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"]
Jul 21 06:26:11.277935 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.277902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"]
Jul 21 06:26:11.296791 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.296766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/070334dd-fdd3-4ea4-bbdb-2307fd55f567-config-file\") pod \"limitador-limitador-64c94fd64f-z4z6c\" (UID: \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:11.296958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.296817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdfh7\" (UniqueName: \"kubernetes.io/projected/070334dd-fdd3-4ea4-bbdb-2307fd55f567-kube-api-access-jdfh7\") pod \"limitador-limitador-64c94fd64f-z4z6c\" (UID: \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:11.398072 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.398039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/070334dd-fdd3-4ea4-bbdb-2307fd55f567-config-file\") pod \"limitador-limitador-64c94fd64f-z4z6c\" (UID: \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:11.398204 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.398082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdfh7\" (UniqueName: \"kubernetes.io/projected/070334dd-fdd3-4ea4-bbdb-2307fd55f567-kube-api-access-jdfh7\") pod \"limitador-limitador-64c94fd64f-z4z6c\" (UID: \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:11.398692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.398672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/070334dd-fdd3-4ea4-bbdb-2307fd55f567-config-file\") pod \"limitador-limitador-64c94fd64f-z4z6c\" (UID: \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:11.405813 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.405791    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdfh7\" (UniqueName: \"kubernetes.io/projected/070334dd-fdd3-4ea4-bbdb-2307fd55f567-kube-api-access-jdfh7\") pod \"limitador-limitador-64c94fd64f-z4z6c\" (UID: \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:11.496472 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.496414    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:11.630021 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.629994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"]
Jul 21 06:26:11.632353 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:26:11.632324    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070334dd_fdd3_4ea4_bbdb_2307fd55f567.slice/crio-25896d9de808d9c1998f98005d78d4c45112d2cdaa266a112c0a218a9775707a WatchSource:0}: Error finding container 25896d9de808d9c1998f98005d78d4c45112d2cdaa266a112c0a218a9775707a: Status 404 returned error can't find the container with id 25896d9de808d9c1998f98005d78d4c45112d2cdaa266a112c0a218a9775707a
Jul 21 06:26:11.937994 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:11.937959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c" event={"ID":"070334dd-fdd3-4ea4-bbdb-2307fd55f567","Type":"ContainerStarted","Data":"25896d9de808d9c1998f98005d78d4c45112d2cdaa266a112c0a218a9775707a"}
Jul 21 06:26:14.957618 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:14.957521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c" event={"ID":"070334dd-fdd3-4ea4-bbdb-2307fd55f567","Type":"ContainerStarted","Data":"42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0"}
Jul 21 06:26:14.957974 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:14.957704    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:14.973651 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:14.973610    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c" podStartSLOduration=1.0350900219999999 podStartE2EDuration="3.973597088s" totalImagesPullingTime="2.938507066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:26:14.97131703 +0000 UTC m=+511.784060700" watchObservedRunningTime="2026-07-21 06:26:14.973597088 +0000 UTC m=+511.786340757"
Jul 21 06:26:25.962878 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:25.962852    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:29.201217 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.201181    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"]
Jul 21 06:26:29.201612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.201411    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c" podUID="070334dd-fdd3-4ea4-bbdb-2307fd55f567" containerName="limitador" containerID="cri-o://42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0" gracePeriod=30
Jul 21 06:26:29.749294 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.749264    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:29.841751 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.841727    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdfh7\" (UniqueName: \"kubernetes.io/projected/070334dd-fdd3-4ea4-bbdb-2307fd55f567-kube-api-access-jdfh7\") pod \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\" (UID: \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\") "
Jul 21 06:26:29.841912 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.841759    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/070334dd-fdd3-4ea4-bbdb-2307fd55f567-config-file\") pod \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\" (UID: \"070334dd-fdd3-4ea4-bbdb-2307fd55f567\") "
Jul 21 06:26:29.842136 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.842114    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/070334dd-fdd3-4ea4-bbdb-2307fd55f567-config-file" (OuterVolumeSpecName: "config-file") pod "070334dd-fdd3-4ea4-bbdb-2307fd55f567" (UID: "070334dd-fdd3-4ea4-bbdb-2307fd55f567"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:26:29.843920 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.843893    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/070334dd-fdd3-4ea4-bbdb-2307fd55f567-kube-api-access-jdfh7" (OuterVolumeSpecName: "kube-api-access-jdfh7") pod "070334dd-fdd3-4ea4-bbdb-2307fd55f567" (UID: "070334dd-fdd3-4ea4-bbdb-2307fd55f567"). InnerVolumeSpecName "kube-api-access-jdfh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:26:29.942672 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.942648    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdfh7\" (UniqueName: \"kubernetes.io/projected/070334dd-fdd3-4ea4-bbdb-2307fd55f567-kube-api-access-jdfh7\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:26:29.942672 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:29.942669    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/070334dd-fdd3-4ea4-bbdb-2307fd55f567-config-file\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:26:30.023837 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.023812    2577 generic.go:356] "Generic (PLEG): container finished" podID="070334dd-fdd3-4ea4-bbdb-2307fd55f567" containerID="42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0" exitCode=0
Jul 21 06:26:30.023936 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.023859    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"
Jul 21 06:26:30.023936 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.023887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c" event={"ID":"070334dd-fdd3-4ea4-bbdb-2307fd55f567","Type":"ContainerDied","Data":"42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0"}
Jul 21 06:26:30.023936 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.023928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-z4z6c" event={"ID":"070334dd-fdd3-4ea4-bbdb-2307fd55f567","Type":"ContainerDied","Data":"25896d9de808d9c1998f98005d78d4c45112d2cdaa266a112c0a218a9775707a"}
Jul 21 06:26:30.024050 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.023949    2577 scope.go:117] "RemoveContainer" containerID="42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0"
Jul 21 06:26:30.032767 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.032752    2577 scope.go:117] "RemoveContainer" containerID="42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0"
Jul 21 06:26:30.032971 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:26:30.032951    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0\": container with ID starting with 42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0 not found: ID does not exist" containerID="42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0"
Jul 21 06:26:30.033035 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.032980    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0"} err="failed to get container status \"42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0\": rpc error: code = NotFound desc = could not find container \"42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0\": container with ID starting with 42672ce97d4d55d17a4f43696eaff581c195e7f4403883153b2c996222d327d0 not found: ID does not exist"
Jul 21 06:26:30.045184 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.045164    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"]
Jul 21 06:26:30.049047 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:30.049027    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-z4z6c"]
Jul 21 06:26:31.713916 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.713882    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="070334dd-fdd3-4ea4-bbdb-2307fd55f567" path="/var/lib/kubelet/pods/070334dd-fdd3-4ea4-bbdb-2307fd55f567/volumes"
Jul 21 06:26:31.944932 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.944898    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"]
Jul 21 06:26:31.945420 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.945401    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="070334dd-fdd3-4ea4-bbdb-2307fd55f567" containerName="limitador"
Jul 21 06:26:31.945471 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.945426    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="070334dd-fdd3-4ea4-bbdb-2307fd55f567" containerName="limitador"
Jul 21 06:26:31.945565 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.945552    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="070334dd-fdd3-4ea4-bbdb-2307fd55f567" containerName="limitador"
Jul 21 06:26:31.950191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.950171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:31.953197 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.953177    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 06:26:31.953624 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.953386    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 06:26:31.953624 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.953413    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 21 06:26:31.953936 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.953911    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-rq9d8\""
Jul 21 06:26:31.954349 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:31.954331    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"]
Jul 21 06:26:32.056782 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:32.056758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73e45c23-5f96-44df-9a3e-1c782ab44d37-data\") pod \"postgres-69fb4594cf-znwrt\" (UID: \"73e45c23-5f96-44df-9a3e-1c782ab44d37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:32.056927 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:32.056801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87w2q\" (UniqueName: \"kubernetes.io/projected/73e45c23-5f96-44df-9a3e-1c782ab44d37-kube-api-access-87w2q\") pod \"postgres-69fb4594cf-znwrt\" (UID: \"73e45c23-5f96-44df-9a3e-1c782ab44d37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:32.157411 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:32.157381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73e45c23-5f96-44df-9a3e-1c782ab44d37-data\") pod \"postgres-69fb4594cf-znwrt\" (UID: \"73e45c23-5f96-44df-9a3e-1c782ab44d37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:32.157560 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:32.157419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87w2q\" (UniqueName: \"kubernetes.io/projected/73e45c23-5f96-44df-9a3e-1c782ab44d37-kube-api-access-87w2q\") pod \"postgres-69fb4594cf-znwrt\" (UID: \"73e45c23-5f96-44df-9a3e-1c782ab44d37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:32.157767 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:32.157747    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/73e45c23-5f96-44df-9a3e-1c782ab44d37-data\") pod \"postgres-69fb4594cf-znwrt\" (UID: \"73e45c23-5f96-44df-9a3e-1c782ab44d37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:32.165181 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:32.165151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87w2q\" (UniqueName: \"kubernetes.io/projected/73e45c23-5f96-44df-9a3e-1c782ab44d37-kube-api-access-87w2q\") pod \"postgres-69fb4594cf-znwrt\" (UID: \"73e45c23-5f96-44df-9a3e-1c782ab44d37\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:32.263270 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:32.263240    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:32.392885 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:32.392855    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"]
Jul 21 06:26:32.395254 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:26:32.395223    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e45c23_5f96_44df_9a3e_1c782ab44d37.slice/crio-0e403da9dbe5fcf0a3e69e75d2dee9bc5f5e0f1bca5748fce1136b9040f584d9 WatchSource:0}: Error finding container 0e403da9dbe5fcf0a3e69e75d2dee9bc5f5e0f1bca5748fce1136b9040f584d9: Status 404 returned error can't find the container with id 0e403da9dbe5fcf0a3e69e75d2dee9bc5f5e0f1bca5748fce1136b9040f584d9
Jul 21 06:26:33.040059 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:33.040017    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt" event={"ID":"73e45c23-5f96-44df-9a3e-1c782ab44d37","Type":"ContainerStarted","Data":"0e403da9dbe5fcf0a3e69e75d2dee9bc5f5e0f1bca5748fce1136b9040f584d9"}
Jul 21 06:26:42.091765 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:42.091725    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt" event={"ID":"73e45c23-5f96-44df-9a3e-1c782ab44d37","Type":"ContainerStarted","Data":"6185d3b24f37654579408ace956295644aaba4a7575441c843b65a50372ba5b5"}
Jul 21 06:26:42.092182 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:42.091899    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:42.107994 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:42.107955    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt" podStartSLOduration=2.478512393 podStartE2EDuration="11.107940733s" totalImagesPullingTime="8.62942834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:26:42.106228493 +0000 UTC m=+538.918972165" watchObservedRunningTime="2026-07-21 06:26:42.107940733 +0000 UTC m=+538.920684403"
Jul 21 06:26:48.125152 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:48.125123    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-znwrt"
Jul 21 06:26:55.074640 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.074611    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5dbc7c79cb-chjpz"]
Jul 21 06:26:55.082613 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.082579    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:55.085301 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.085275    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 06:26:55.085408 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.085391    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n5vfm\""
Jul 21 06:26:55.086050 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.086027    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 06:26:55.088655 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.088632    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dbc7c79cb-chjpz"]
Jul 21 06:26:55.151528 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.151500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert\") pod \"maas-controller-5dbc7c79cb-chjpz\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") " pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:55.151726 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.151607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbzpb\" (UniqueName: \"kubernetes.io/projected/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-kube-api-access-kbzpb\") pod \"maas-controller-5dbc7c79cb-chjpz\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") " pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:55.253003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.252973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbzpb\" (UniqueName: \"kubernetes.io/projected/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-kube-api-access-kbzpb\") pod \"maas-controller-5dbc7c79cb-chjpz\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") " pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:55.253124 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.253037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert\") pod \"maas-controller-5dbc7c79cb-chjpz\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") " pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:55.253179 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:26:55.253166    2577 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 06:26:55.253239 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:26:55.253229    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert podName:72afd087-c770-4ce7-8715-a4c8bb3cd7e6 nodeName:}" failed. No retries permitted until 2026-07-21 06:26:55.753210106 +0000 UTC m=+552.565953759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert") pod "maas-controller-5dbc7c79cb-chjpz" (UID: "72afd087-c770-4ce7-8715-a4c8bb3cd7e6") : secret "maas-controller-webhook-cert" not found
Jul 21 06:26:55.264387 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.264359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbzpb\" (UniqueName: \"kubernetes.io/projected/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-kube-api-access-kbzpb\") pod \"maas-controller-5dbc7c79cb-chjpz\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") " pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:55.271403 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.271383    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-k5j2z"]
Jul 21 06:26:55.275340 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.275322    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:55.282513 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.282491    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-k5j2z"]
Jul 21 06:26:55.353746 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.353698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t86q5\" (UniqueName: \"kubernetes.io/projected/1645c76d-4257-4d8e-a975-d5f78ede7ef9-kube-api-access-t86q5\") pod \"maas-controller-6ff745f6b9-k5j2z\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") " pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:55.353746 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.353735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert\") pod \"maas-controller-6ff745f6b9-k5j2z\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") " pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:55.454587 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.454561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t86q5\" (UniqueName: \"kubernetes.io/projected/1645c76d-4257-4d8e-a975-d5f78ede7ef9-kube-api-access-t86q5\") pod \"maas-controller-6ff745f6b9-k5j2z\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") " pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:55.454692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.454616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert\") pod \"maas-controller-6ff745f6b9-k5j2z\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") " pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:55.454807 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:26:55.454785    2577 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 21 06:26:55.454872 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:26:55.454863    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert podName:1645c76d-4257-4d8e-a975-d5f78ede7ef9 nodeName:}" failed. No retries permitted until 2026-07-21 06:26:55.954844764 +0000 UTC m=+552.767588413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert") pod "maas-controller-6ff745f6b9-k5j2z" (UID: "1645c76d-4257-4d8e-a975-d5f78ede7ef9") : secret "maas-controller-webhook-cert" not found
Jul 21 06:26:55.463288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.463267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t86q5\" (UniqueName: \"kubernetes.io/projected/1645c76d-4257-4d8e-a975-d5f78ede7ef9-kube-api-access-t86q5\") pod \"maas-controller-6ff745f6b9-k5j2z\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") " pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:55.757450 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.757373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert\") pod \"maas-controller-5dbc7c79cb-chjpz\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") " pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:55.759818 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.759799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert\") pod \"maas-controller-5dbc7c79cb-chjpz\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") " pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:55.958593 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.958566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert\") pod \"maas-controller-6ff745f6b9-k5j2z\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") " pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:55.960801 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.960769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert\") pod \"maas-controller-6ff745f6b9-k5j2z\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") " pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:55.994377 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:55.994354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:56.123132 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:56.123055    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5dbc7c79cb-chjpz"]
Jul 21 06:26:56.125301 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:26:56.125271    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72afd087_c770_4ce7_8715_a4c8bb3cd7e6.slice/crio-e4d4efeb6d98c6ded2de52ead091dd65356f349a16c67d7ece0533f856b15382 WatchSource:0}: Error finding container e4d4efeb6d98c6ded2de52ead091dd65356f349a16c67d7ece0533f856b15382: Status 404 returned error can't find the container with id e4d4efeb6d98c6ded2de52ead091dd65356f349a16c67d7ece0533f856b15382
Jul 21 06:26:56.158620 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:56.158590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz" event={"ID":"72afd087-c770-4ce7-8715-a4c8bb3cd7e6","Type":"ContainerStarted","Data":"e4d4efeb6d98c6ded2de52ead091dd65356f349a16c67d7ece0533f856b15382"}
Jul 21 06:26:56.187755 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:56.187733    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:56.319492 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:56.319354    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-k5j2z"]
Jul 21 06:26:56.322040 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:26:56.322012    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1645c76d_4257_4d8e_a975_d5f78ede7ef9.slice/crio-2e35307050bfeffc245cd04aa7ba4210630877187901aff9a8c9ebe1f9134d39 WatchSource:0}: Error finding container 2e35307050bfeffc245cd04aa7ba4210630877187901aff9a8c9ebe1f9134d39: Status 404 returned error can't find the container with id 2e35307050bfeffc245cd04aa7ba4210630877187901aff9a8c9ebe1f9134d39
Jul 21 06:26:57.169734 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:57.169657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z" event={"ID":"1645c76d-4257-4d8e-a975-d5f78ede7ef9","Type":"ContainerStarted","Data":"2e35307050bfeffc245cd04aa7ba4210630877187901aff9a8c9ebe1f9134d39"}
Jul 21 06:26:59.180659 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:59.180625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz" event={"ID":"72afd087-c770-4ce7-8715-a4c8bb3cd7e6","Type":"ContainerStarted","Data":"4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5"}
Jul 21 06:26:59.181093 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:59.180721    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:26:59.182162 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:59.182140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z" event={"ID":"1645c76d-4257-4d8e-a975-d5f78ede7ef9","Type":"ContainerStarted","Data":"4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84"}
Jul 21 06:26:59.182270 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:59.182180    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:26:59.198861 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:59.198812    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz" podStartSLOduration=1.704575322 podStartE2EDuration="4.198798545s" totalImagesPullingTime="2.494223223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:26:59.197728978 +0000 UTC m=+556.010472649" watchObservedRunningTime="2026-07-21 06:26:59.198798545 +0000 UTC m=+556.011542214"
Jul 21 06:26:59.215770 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:26:59.215727    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z" podStartSLOduration=1.9118493920000001 podStartE2EDuration="4.215712113s" totalImagesPullingTime="2.303862721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:26:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:26:59.214790904 +0000 UTC m=+556.027534575" watchObservedRunningTime="2026-07-21 06:26:59.215712113 +0000 UTC m=+556.028455783"
Jul 21 06:27:10.190058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.190020    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:27:10.190524 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.190192    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:27:10.247288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.247252    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dbc7c79cb-chjpz"]
Jul 21 06:27:10.247607 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.247554    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz" podUID="72afd087-c770-4ce7-8715-a4c8bb3cd7e6" containerName="manager" containerID="cri-o://4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5" gracePeriod=30
Jul 21 06:27:10.502238 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.502204    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:27:10.679452 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.679421    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbzpb\" (UniqueName: \"kubernetes.io/projected/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-kube-api-access-kbzpb\") pod \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") "
Jul 21 06:27:10.679631 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.679462    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert\") pod \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\" (UID: \"72afd087-c770-4ce7-8715-a4c8bb3cd7e6\") "
Jul 21 06:27:10.681790 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.681768    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-kube-api-access-kbzpb" (OuterVolumeSpecName: "kube-api-access-kbzpb") pod "72afd087-c770-4ce7-8715-a4c8bb3cd7e6" (UID: "72afd087-c770-4ce7-8715-a4c8bb3cd7e6"). InnerVolumeSpecName "kube-api-access-kbzpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:27:10.681900 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.681805    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "72afd087-c770-4ce7-8715-a4c8bb3cd7e6" (UID: "72afd087-c770-4ce7-8715-a4c8bb3cd7e6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:27:10.780860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.780835    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbzpb\" (UniqueName: \"kubernetes.io/projected/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-kube-api-access-kbzpb\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:27:10.780860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:10.780861    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/72afd087-c770-4ce7-8715-a4c8bb3cd7e6-webhook-cert\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:27:11.238288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.238209    2577 generic.go:356] "Generic (PLEG): container finished" podID="72afd087-c770-4ce7-8715-a4c8bb3cd7e6" containerID="4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5" exitCode=0
Jul 21 06:27:11.238288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.238260    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz"
Jul 21 06:27:11.238727 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.238260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz" event={"ID":"72afd087-c770-4ce7-8715-a4c8bb3cd7e6","Type":"ContainerDied","Data":"4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5"}
Jul 21 06:27:11.238727 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.238366    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5dbc7c79cb-chjpz" event={"ID":"72afd087-c770-4ce7-8715-a4c8bb3cd7e6","Type":"ContainerDied","Data":"e4d4efeb6d98c6ded2de52ead091dd65356f349a16c67d7ece0533f856b15382"}
Jul 21 06:27:11.238727 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.238394    2577 scope.go:117] "RemoveContainer" containerID="4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5"
Jul 21 06:27:11.247466 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.247449    2577 scope.go:117] "RemoveContainer" containerID="4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5"
Jul 21 06:27:11.247762 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:27:11.247743    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5\": container with ID starting with 4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5 not found: ID does not exist" containerID="4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5"
Jul 21 06:27:11.247825 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.247770    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5"} err="failed to get container status \"4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5\": rpc error: code = NotFound desc = could not find container \"4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5\": container with ID starting with 4e6a0eb7d97546295af0d43e674f39c3d9b03165c6886d1bedfff92dd40682f5 not found: ID does not exist"
Jul 21 06:27:11.258647 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.258625    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5dbc7c79cb-chjpz"]
Jul 21 06:27:11.264128 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.264109    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5dbc7c79cb-chjpz"]
Jul 21 06:27:11.713015 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:11.712986    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72afd087-c770-4ce7-8715-a4c8bb3cd7e6" path="/var/lib/kubelet/pods/72afd087-c770-4ce7-8715-a4c8bb3cd7e6/volumes"
Jul 21 06:27:30.726599 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.726563    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"]
Jul 21 06:27:30.727053 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.726902    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72afd087-c770-4ce7-8715-a4c8bb3cd7e6" containerName="manager"
Jul 21 06:27:30.727053 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.726913    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="72afd087-c770-4ce7-8715-a4c8bb3cd7e6" containerName="manager"
Jul 21 06:27:30.727053 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.726963    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="72afd087-c770-4ce7-8715-a4c8bb3cd7e6" containerName="manager"
Jul 21 06:27:30.746080 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.746051    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"]
Jul 21 06:27:30.746222 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.746174    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.748759 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.748738    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 21 06:27:30.748889 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.748777    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qn6md\""
Jul 21 06:27:30.827141 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.827107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kkvj\" (UniqueName: \"kubernetes.io/projected/f559a042-73ca-4e7a-a9d5-0e8664667042-kube-api-access-2kkvj\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.827278 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.827168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f559a042-73ca-4e7a-a9d5-0e8664667042-maas-api-tls\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.827278 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.827235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f559a042-73ca-4e7a-a9d5-0e8664667042-openshift-service-ca\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.928006 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.927982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f559a042-73ca-4e7a-a9d5-0e8664667042-maas-api-tls\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.928123 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.928028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f559a042-73ca-4e7a-a9d5-0e8664667042-openshift-service-ca\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.928123 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.928065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kkvj\" (UniqueName: \"kubernetes.io/projected/f559a042-73ca-4e7a-a9d5-0e8664667042-kube-api-access-2kkvj\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.928677 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.928637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f559a042-73ca-4e7a-a9d5-0e8664667042-openshift-service-ca\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.930403 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.930383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f559a042-73ca-4e7a-a9d5-0e8664667042-maas-api-tls\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:30.935957 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:30.935934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kkvj\" (UniqueName: \"kubernetes.io/projected/f559a042-73ca-4e7a-a9d5-0e8664667042-kube-api-access-2kkvj\") pod \"maas-api-86f46b5fc6-dv2jd\" (UID: \"f559a042-73ca-4e7a-a9d5-0e8664667042\") " pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:31.060475 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.060444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:31.200513 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.200489    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"]
Jul 21 06:27:31.204349 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:27:31.204052    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf559a042_73ca_4e7a_a9d5_0e8664667042.slice/crio-a7b5abd414ab7e237da218ebc252a8df091b222ad37fb937e5a5f750df7fc6b5 WatchSource:0}: Error finding container a7b5abd414ab7e237da218ebc252a8df091b222ad37fb937e5a5f750df7fc6b5: Status 404 returned error can't find the container with id a7b5abd414ab7e237da218ebc252a8df091b222ad37fb937e5a5f750df7fc6b5
Jul 21 06:27:31.335943 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.335861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd" event={"ID":"f559a042-73ca-4e7a-a9d5-0e8664667042","Type":"ContainerStarted","Data":"a7b5abd414ab7e237da218ebc252a8df091b222ad37fb937e5a5f750df7fc6b5"}
Jul 21 06:27:31.377082 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.377053    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2js5p"]
Jul 21 06:27:31.382343 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.382325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:31.385828 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.385810    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b6vhf\""
Jul 21 06:27:31.385937 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.385890    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 21 06:27:31.395149 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.395098    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2js5p"]
Jul 21 06:27:31.432655 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.432625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e86931e7-b7f5-4905-9b64-28b6fa7ee6f1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2js5p\" (UID: \"e86931e7-b7f5-4905-9b64-28b6fa7ee6f1\") " pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:31.432761 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.432686    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whcnr\" (UniqueName: \"kubernetes.io/projected/e86931e7-b7f5-4905-9b64-28b6fa7ee6f1-kube-api-access-whcnr\") pod \"payload-processing-5bf47cd988-2js5p\" (UID: \"e86931e7-b7f5-4905-9b64-28b6fa7ee6f1\") " pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:31.533399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.533373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e86931e7-b7f5-4905-9b64-28b6fa7ee6f1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2js5p\" (UID: \"e86931e7-b7f5-4905-9b64-28b6fa7ee6f1\") " pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:31.533515 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.533450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whcnr\" (UniqueName: \"kubernetes.io/projected/e86931e7-b7f5-4905-9b64-28b6fa7ee6f1-kube-api-access-whcnr\") pod \"payload-processing-5bf47cd988-2js5p\" (UID: \"e86931e7-b7f5-4905-9b64-28b6fa7ee6f1\") " pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:31.534121 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.534102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e86931e7-b7f5-4905-9b64-28b6fa7ee6f1-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2js5p\" (UID: \"e86931e7-b7f5-4905-9b64-28b6fa7ee6f1\") " pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:31.541818 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.541797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whcnr\" (UniqueName: \"kubernetes.io/projected/e86931e7-b7f5-4905-9b64-28b6fa7ee6f1-kube-api-access-whcnr\") pod \"payload-processing-5bf47cd988-2js5p\" (UID: \"e86931e7-b7f5-4905-9b64-28b6fa7ee6f1\") " pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:31.693438 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.693353    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:31.829938 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:31.829882    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2js5p"]
Jul 21 06:27:31.832176 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:27:31.832150    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode86931e7_b7f5_4905_9b64_28b6fa7ee6f1.slice/crio-331825d966049bbbcf6d82ed8df3bf671b5cbb0ab65d836f9b95fe3a8ae69830 WatchSource:0}: Error finding container 331825d966049bbbcf6d82ed8df3bf671b5cbb0ab65d836f9b95fe3a8ae69830: Status 404 returned error can't find the container with id 331825d966049bbbcf6d82ed8df3bf671b5cbb0ab65d836f9b95fe3a8ae69830
Jul 21 06:27:32.342833 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:32.342796    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-2js5p" event={"ID":"e86931e7-b7f5-4905-9b64-28b6fa7ee6f1","Type":"ContainerStarted","Data":"331825d966049bbbcf6d82ed8df3bf671b5cbb0ab65d836f9b95fe3a8ae69830"}
Jul 21 06:27:33.349701 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:33.349654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd" event={"ID":"f559a042-73ca-4e7a-a9d5-0e8664667042","Type":"ContainerStarted","Data":"d1701d87c14275b7823537ebc4993eb985c28f77b0d1577273dc462a1eb28f34"}
Jul 21 06:27:33.350074 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:33.349737    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:33.367388 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:33.367342    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd" podStartSLOduration=1.8913278500000001 podStartE2EDuration="3.367326354s" totalImagesPullingTime="1.475998504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:27:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:27:33.366513305 +0000 UTC m=+590.179257013" watchObservedRunningTime="2026-07-21 06:27:33.367326354 +0000 UTC m=+590.180070023"
Jul 21 06:27:35.360877 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:35.360848    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-2js5p" event={"ID":"e86931e7-b7f5-4905-9b64-28b6fa7ee6f1","Type":"ContainerStarted","Data":"40d7d32bacfb6feae0e885e111cca6b6d6291a5553e48d0efc0281b3fede7b79"}
Jul 21 06:27:35.361222 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:35.360958    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:35.377980 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:35.377938    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-2js5p" podStartSLOduration=1.8358260149999999 podStartE2EDuration="4.377920728s" totalImagesPullingTime="2.542094713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:27:35.376062171 +0000 UTC m=+592.188805856" watchObservedRunningTime="2026-07-21 06:27:35.377920728 +0000 UTC m=+592.190664399"
Jul 21 06:27:39.361363 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:39.361333    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86f46b5fc6-dv2jd"
Jul 21 06:27:44.721462 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:44.721365    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:27:44.734500 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:44.722189    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:27:46.368354 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:46.368325    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-2js5p"
Jul 21 06:27:48.896692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.896662    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"]
Jul 21 06:27:48.899957 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.899942    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:48.902520 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.902500    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 06:27:48.903869 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.903848    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-r52vr\""
Jul 21 06:27:48.903967 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.903853    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 06:27:48.903967 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.903891    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 21 06:27:48.909503 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.909484    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"]
Jul 21 06:27:48.981900 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.981870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:48.982060 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.981924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:48.982060 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.981993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ad42808-989c-4bb8-bfd0-4186b4177ce6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:48.982060 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.982056    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:48.982232 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.982171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:48.982232 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:48.982217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2nk5\" (UniqueName: \"kubernetes.io/projected/8ad42808-989c-4bb8-bfd0-4186b4177ce6-kube-api-access-l2nk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.082580 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.082527    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.082721 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.082614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.082721 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.082639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2nk5\" (UniqueName: \"kubernetes.io/projected/8ad42808-989c-4bb8-bfd0-4186b4177ce6-kube-api-access-l2nk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.082721 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.082668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.082721 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.082689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.082721 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.082712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ad42808-989c-4bb8-bfd0-4186b4177ce6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.083126 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.083096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.083242 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.083165    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.083436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.083332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.084975 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.084951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ad42808-989c-4bb8-bfd0-4186b4177ce6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.085207 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.085190    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ad42808-989c-4bb8-bfd0-4186b4177ce6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.090271 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.090251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2nk5\" (UniqueName: \"kubernetes.io/projected/8ad42808-989c-4bb8-bfd0-4186b4177ce6-kube-api-access-l2nk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8\" (UID: \"8ad42808-989c-4bb8-bfd0-4186b4177ce6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.210725 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.210661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:49.347672 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.347647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"]
Jul 21 06:27:49.349759 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:27:49.349731    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad42808_989c_4bb8_bfd0_4186b4177ce6.slice/crio-d4fa9058b979326f97bfef7d8079e38053100e79319d97031057385245f92238 WatchSource:0}: Error finding container d4fa9058b979326f97bfef7d8079e38053100e79319d97031057385245f92238: Status 404 returned error can't find the container with id d4fa9058b979326f97bfef7d8079e38053100e79319d97031057385245f92238
Jul 21 06:27:49.428941 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:49.428915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8" event={"ID":"8ad42808-989c-4bb8-bfd0-4186b4177ce6","Type":"ContainerStarted","Data":"d4fa9058b979326f97bfef7d8079e38053100e79319d97031057385245f92238"}
Jul 21 06:27:51.441392 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:51.441356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8" event={"ID":"8ad42808-989c-4bb8-bfd0-4186b4177ce6","Type":"ContainerStarted","Data":"930cade24f4e5cb35da498baa6053120e8f926219123b4cff4b7b3cd9382148c"}
Jul 21 06:27:51.459246 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:51.459203    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8" podStartSLOduration=2.33901486 podStartE2EDuration="3.459188955s" totalImagesPullingTime="1.120174095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:27:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:27:51.458948567 +0000 UTC m=+608.271692241" watchObservedRunningTime="2026-07-21 06:27:51.459188955 +0000 UTC m=+608.271932625"
Jul 21 06:27:59.211381 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:59.211346    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:59.211829 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:59.211441    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:59.223627 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:59.223605    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:27:59.490556 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:27:59.490459    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8"
Jul 21 06:28:18.200343 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.200267    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"]
Jul 21 06:28:18.203919 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.203899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.206426 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.206405    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 06:28:18.214393 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.214370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"]
Jul 21 06:28:18.222699 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.222678    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.222805 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.222739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.222868 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.222840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8zfc\" (UniqueName: \"kubernetes.io/projected/dda3c5ee-fa14-4dfe-954d-852ba14b6266-kube-api-access-r8zfc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.222928 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.222877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.222928 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.222903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.223012 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.222953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda3c5ee-fa14-4dfe-954d-852ba14b6266-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.323467 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.323433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8zfc\" (UniqueName: \"kubernetes.io/projected/dda3c5ee-fa14-4dfe-954d-852ba14b6266-kube-api-access-r8zfc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.323648 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.323472    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.323648 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.323490    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.323648 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.323557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda3c5ee-fa14-4dfe-954d-852ba14b6266-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.323648 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.323592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.323856 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.323675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.323994 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.323973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.324068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.324045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.324105 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.324074    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.325811 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.325794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dda3c5ee-fa14-4dfe-954d-852ba14b6266-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.326205 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.326187    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda3c5ee-fa14-4dfe-954d-852ba14b6266-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.330887 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.330867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8zfc\" (UniqueName: \"kubernetes.io/projected/dda3c5ee-fa14-4dfe-954d-852ba14b6266-kube-api-access-r8zfc\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx\" (UID: \"dda3c5ee-fa14-4dfe-954d-852ba14b6266\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.514059 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.514034    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:18.650018 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.649994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"]
Jul 21 06:28:18.652555 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:28:18.652510    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda3c5ee_fa14_4dfe_954d_852ba14b6266.slice/crio-f3f259b8444b0d8ce6df4e6b7eaf1570efc740f212a3c105752d99c58efad524 WatchSource:0}: Error finding container f3f259b8444b0d8ce6df4e6b7eaf1570efc740f212a3c105752d99c58efad524: Status 404 returned error can't find the container with id f3f259b8444b0d8ce6df4e6b7eaf1570efc740f212a3c105752d99c58efad524
Jul 21 06:28:18.653872 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:18.653851    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 06:28:19.579001 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:19.578964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx" event={"ID":"dda3c5ee-fa14-4dfe-954d-852ba14b6266","Type":"ContainerStarted","Data":"b8109597cf5503221bdf6d9f1b3a746616bc3106f935d91a4851e83279ce85e3"}
Jul 21 06:28:19.579438 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:19.579029    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx" event={"ID":"dda3c5ee-fa14-4dfe-954d-852ba14b6266","Type":"ContainerStarted","Data":"f3f259b8444b0d8ce6df4e6b7eaf1570efc740f212a3c105752d99c58efad524"}
Jul 21 06:28:19.595692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:19.595645    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx" podStartSLOduration=1.412272741 podStartE2EDuration="1.595632719s" totalImagesPullingTime="183.359978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:28:19.593671823 +0000 UTC m=+636.406415522" watchObservedRunningTime="2026-07-21 06:28:19.595632719 +0000 UTC m=+636.408376389"
Jul 21 06:28:28.514318 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:28.514281    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:28.514697 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:28.514345    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:28.526681 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:28.526659    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:28:28.631833 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:28:28.631806    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx"
Jul 21 06:30:29.402836 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.402800    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-k5j2z"]
Jul 21 06:30:29.403320 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.403009    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z" podUID="1645c76d-4257-4d8e-a975-d5f78ede7ef9" containerName="manager" containerID="cri-o://4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84" gracePeriod=30
Jul 21 06:30:29.656394 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.656336    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:30:29.678919 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.678888    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t86q5\" (UniqueName: \"kubernetes.io/projected/1645c76d-4257-4d8e-a975-d5f78ede7ef9-kube-api-access-t86q5\") pod \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") "
Jul 21 06:30:29.679058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.678952    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert\") pod \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\" (UID: \"1645c76d-4257-4d8e-a975-d5f78ede7ef9\") "
Jul 21 06:30:29.681258 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.681224    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1645c76d-4257-4d8e-a975-d5f78ede7ef9-kube-api-access-t86q5" (OuterVolumeSpecName: "kube-api-access-t86q5") pod "1645c76d-4257-4d8e-a975-d5f78ede7ef9" (UID: "1645c76d-4257-4d8e-a975-d5f78ede7ef9"). InnerVolumeSpecName "kube-api-access-t86q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:30:29.681358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.681258    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1645c76d-4257-4d8e-a975-d5f78ede7ef9" (UID: "1645c76d-4257-4d8e-a975-d5f78ede7ef9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:30:29.780127 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.780095    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t86q5\" (UniqueName: \"kubernetes.io/projected/1645c76d-4257-4d8e-a975-d5f78ede7ef9-kube-api-access-t86q5\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:30:29.780127 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:29.780126    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1645c76d-4257-4d8e-a975-d5f78ede7ef9-webhook-cert\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:30:30.179947 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.179915    2577 generic.go:356] "Generic (PLEG): container finished" podID="1645c76d-4257-4d8e-a975-d5f78ede7ef9" containerID="4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84" exitCode=0
Jul 21 06:30:30.180137 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.179964    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z"
Jul 21 06:30:30.180137 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.179997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z" event={"ID":"1645c76d-4257-4d8e-a975-d5f78ede7ef9","Type":"ContainerDied","Data":"4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84"}
Jul 21 06:30:30.180137 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.180049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-k5j2z" event={"ID":"1645c76d-4257-4d8e-a975-d5f78ede7ef9","Type":"ContainerDied","Data":"2e35307050bfeffc245cd04aa7ba4210630877187901aff9a8c9ebe1f9134d39"}
Jul 21 06:30:30.180137 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.180071    2577 scope.go:117] "RemoveContainer" containerID="4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84"
Jul 21 06:30:30.188855 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.188839    2577 scope.go:117] "RemoveContainer" containerID="4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84"
Jul 21 06:30:30.189104 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:30:30.189086    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84\": container with ID starting with 4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84 not found: ID does not exist" containerID="4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84"
Jul 21 06:30:30.189164 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.189111    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84"} err="failed to get container status \"4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84\": rpc error: code = NotFound desc = could not find container \"4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84\": container with ID starting with 4e78c276950be7e2c82c007331b51999296b7da36ef3956aca3df9b98a76eb84 not found: ID does not exist"
Jul 21 06:30:30.196613 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.196588    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-k5j2z"]
Jul 21 06:30:30.199674 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:30.199656    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-k5j2z"]
Jul 21 06:30:31.713309 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:30:31.713279    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1645c76d-4257-4d8e-a975-d5f78ede7ef9" path="/var/lib/kubelet/pods/1645c76d-4257-4d8e-a975-d5f78ede7ef9/volumes"
Jul 21 06:31:31.022718 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.022688    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-pgx7k"]
Jul 21 06:31:31.023263 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.023222    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1645c76d-4257-4d8e-a975-d5f78ede7ef9" containerName="manager"
Jul 21 06:31:31.023263 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.023244    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1645c76d-4257-4d8e-a975-d5f78ede7ef9" containerName="manager"
Jul 21 06:31:31.023381 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.023360    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1645c76d-4257-4d8e-a975-d5f78ede7ef9" containerName="manager"
Jul 21 06:31:31.026553 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.026509    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:31.028905 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.028888    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 06:31:31.030056 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.030040    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 06:31:31.030175 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.030146    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n5vfm\""
Jul 21 06:31:31.032933 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.032908    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-pgx7k"]
Jul 21 06:31:31.161601 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.161572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/841f7f17-f72e-4d27-bf79-b7c110e77190-webhook-cert\") pod \"maas-controller-6ff745f6b9-pgx7k\" (UID: \"841f7f17-f72e-4d27-bf79-b7c110e77190\") " pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:31.161751 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.161638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxtf8\" (UniqueName: \"kubernetes.io/projected/841f7f17-f72e-4d27-bf79-b7c110e77190-kube-api-access-gxtf8\") pod \"maas-controller-6ff745f6b9-pgx7k\" (UID: \"841f7f17-f72e-4d27-bf79-b7c110e77190\") " pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:31.262564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.262516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxtf8\" (UniqueName: \"kubernetes.io/projected/841f7f17-f72e-4d27-bf79-b7c110e77190-kube-api-access-gxtf8\") pod \"maas-controller-6ff745f6b9-pgx7k\" (UID: \"841f7f17-f72e-4d27-bf79-b7c110e77190\") " pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:31.262694 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.262617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/841f7f17-f72e-4d27-bf79-b7c110e77190-webhook-cert\") pod \"maas-controller-6ff745f6b9-pgx7k\" (UID: \"841f7f17-f72e-4d27-bf79-b7c110e77190\") " pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:31.265148 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.265129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/841f7f17-f72e-4d27-bf79-b7c110e77190-webhook-cert\") pod \"maas-controller-6ff745f6b9-pgx7k\" (UID: \"841f7f17-f72e-4d27-bf79-b7c110e77190\") " pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:31.270370 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.270350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxtf8\" (UniqueName: \"kubernetes.io/projected/841f7f17-f72e-4d27-bf79-b7c110e77190-kube-api-access-gxtf8\") pod \"maas-controller-6ff745f6b9-pgx7k\" (UID: \"841f7f17-f72e-4d27-bf79-b7c110e77190\") " pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:31.338458 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.338383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:31.475721 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:31.475695    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-pgx7k"]
Jul 21 06:31:31.477921 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:31:31.477894    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841f7f17_f72e_4d27_bf79_b7c110e77190.slice/crio-07add4350c7c0d899d64142e8161873b4e38eed331f900c6d4d1d922b602d6ac WatchSource:0}: Error finding container 07add4350c7c0d899d64142e8161873b4e38eed331f900c6d4d1d922b602d6ac: Status 404 returned error can't find the container with id 07add4350c7c0d899d64142e8161873b4e38eed331f900c6d4d1d922b602d6ac
Jul 21 06:31:32.468120 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:32.468082    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k" event={"ID":"841f7f17-f72e-4d27-bf79-b7c110e77190","Type":"ContainerStarted","Data":"5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5"}
Jul 21 06:31:32.468506 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:32.468138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k" event={"ID":"841f7f17-f72e-4d27-bf79-b7c110e77190","Type":"ContainerStarted","Data":"07add4350c7c0d899d64142e8161873b4e38eed331f900c6d4d1d922b602d6ac"}
Jul 21 06:31:32.468506 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:32.468174    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:32.484199 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:32.484153    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k" podStartSLOduration=1.064004693 podStartE2EDuration="1.484139429s" totalImagesPullingTime="420.134736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:31:32.483341693 +0000 UTC m=+829.296085364" watchObservedRunningTime="2026-07-21 06:31:32.484139429 +0000 UTC m=+829.296883098"
Jul 21 06:31:43.475424 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:43.475395    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:48.135664 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.135626    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-pgx7k"]
Jul 21 06:31:48.136125 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.135836    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k" podUID="841f7f17-f72e-4d27-bf79-b7c110e77190" containerName="manager" containerID="cri-o://5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5" gracePeriod=30
Jul 21 06:31:48.382942 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.382917    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:48.499436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.499362    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxtf8\" (UniqueName: \"kubernetes.io/projected/841f7f17-f72e-4d27-bf79-b7c110e77190-kube-api-access-gxtf8\") pod \"841f7f17-f72e-4d27-bf79-b7c110e77190\" (UID: \"841f7f17-f72e-4d27-bf79-b7c110e77190\") "
Jul 21 06:31:48.499436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.499403    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/841f7f17-f72e-4d27-bf79-b7c110e77190-webhook-cert\") pod \"841f7f17-f72e-4d27-bf79-b7c110e77190\" (UID: \"841f7f17-f72e-4d27-bf79-b7c110e77190\") "
Jul 21 06:31:48.501499 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.501468    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841f7f17-f72e-4d27-bf79-b7c110e77190-kube-api-access-gxtf8" (OuterVolumeSpecName: "kube-api-access-gxtf8") pod "841f7f17-f72e-4d27-bf79-b7c110e77190" (UID: "841f7f17-f72e-4d27-bf79-b7c110e77190"). InnerVolumeSpecName "kube-api-access-gxtf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:31:48.501646 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.501587    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841f7f17-f72e-4d27-bf79-b7c110e77190-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "841f7f17-f72e-4d27-bf79-b7c110e77190" (UID: "841f7f17-f72e-4d27-bf79-b7c110e77190"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:31:48.550513 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.550485    2577 generic.go:356] "Generic (PLEG): container finished" podID="841f7f17-f72e-4d27-bf79-b7c110e77190" containerID="5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5" exitCode=0
Jul 21 06:31:48.550622 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.550550    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k"
Jul 21 06:31:48.550622 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.550577    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k" event={"ID":"841f7f17-f72e-4d27-bf79-b7c110e77190","Type":"ContainerDied","Data":"5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5"}
Jul 21 06:31:48.550688 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.550633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-pgx7k" event={"ID":"841f7f17-f72e-4d27-bf79-b7c110e77190","Type":"ContainerDied","Data":"07add4350c7c0d899d64142e8161873b4e38eed331f900c6d4d1d922b602d6ac"}
Jul 21 06:31:48.550688 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.550663    2577 scope.go:117] "RemoveContainer" containerID="5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5"
Jul 21 06:31:48.559097 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.559082    2577 scope.go:117] "RemoveContainer" containerID="5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5"
Jul 21 06:31:48.559335 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:31:48.559319    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5\": container with ID starting with 5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5 not found: ID does not exist" containerID="5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5"
Jul 21 06:31:48.559395 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.559345    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5"} err="failed to get container status \"5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5\": rpc error: code = NotFound desc = could not find container \"5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5\": container with ID starting with 5656c0f67b433438d389850114305b0a0194474aba0ee1b09d1a83eab82953e5 not found: ID does not exist"
Jul 21 06:31:48.571876 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.571843    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-pgx7k"]
Jul 21 06:31:48.575000 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.574980    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-pgx7k"]
Jul 21 06:31:48.600062 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.600028    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxtf8\" (UniqueName: \"kubernetes.io/projected/841f7f17-f72e-4d27-bf79-b7c110e77190-kube-api-access-gxtf8\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:31:48.600062 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:48.600062    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/841f7f17-f72e-4d27-bf79-b7c110e77190-webhook-cert\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:31:49.431306 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.431276    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-n22qc"]
Jul 21 06:31:49.431819 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.431800    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841f7f17-f72e-4d27-bf79-b7c110e77190" containerName="manager"
Jul 21 06:31:49.431891 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.431823    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="841f7f17-f72e-4d27-bf79-b7c110e77190" containerName="manager"
Jul 21 06:31:49.431977 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.431965    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="841f7f17-f72e-4d27-bf79-b7c110e77190" containerName="manager"
Jul 21 06:31:49.436443 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.436423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:49.440070 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.440042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 21 06:31:49.440202 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.440181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-n5vfm\""
Jul 21 06:31:49.440423 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.440157    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 21 06:31:49.442413 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.442391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-n22qc"]
Jul 21 06:31:49.506970 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.506943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnm4w\" (UniqueName: \"kubernetes.io/projected/eef4e245-b3cc-46af-bf3d-27296f94bad9-kube-api-access-cnm4w\") pod \"maas-controller-6ff745f6b9-n22qc\" (UID: \"eef4e245-b3cc-46af-bf3d-27296f94bad9\") " pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:49.507093 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.506978    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eef4e245-b3cc-46af-bf3d-27296f94bad9-webhook-cert\") pod \"maas-controller-6ff745f6b9-n22qc\" (UID: \"eef4e245-b3cc-46af-bf3d-27296f94bad9\") " pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:49.607814 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.607786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnm4w\" (UniqueName: \"kubernetes.io/projected/eef4e245-b3cc-46af-bf3d-27296f94bad9-kube-api-access-cnm4w\") pod \"maas-controller-6ff745f6b9-n22qc\" (UID: \"eef4e245-b3cc-46af-bf3d-27296f94bad9\") " pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:49.607949 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.607818    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eef4e245-b3cc-46af-bf3d-27296f94bad9-webhook-cert\") pod \"maas-controller-6ff745f6b9-n22qc\" (UID: \"eef4e245-b3cc-46af-bf3d-27296f94bad9\") " pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:49.610306 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.610287    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eef4e245-b3cc-46af-bf3d-27296f94bad9-webhook-cert\") pod \"maas-controller-6ff745f6b9-n22qc\" (UID: \"eef4e245-b3cc-46af-bf3d-27296f94bad9\") " pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:49.615809 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.615787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnm4w\" (UniqueName: \"kubernetes.io/projected/eef4e245-b3cc-46af-bf3d-27296f94bad9-kube-api-access-cnm4w\") pod \"maas-controller-6ff745f6b9-n22qc\" (UID: \"eef4e245-b3cc-46af-bf3d-27296f94bad9\") " pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:49.713124 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.713067    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="841f7f17-f72e-4d27-bf79-b7c110e77190" path="/var/lib/kubelet/pods/841f7f17-f72e-4d27-bf79-b7c110e77190/volumes"
Jul 21 06:31:49.748172 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.748154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:49.877230 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:49.877204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ff745f6b9-n22qc"]
Jul 21 06:31:49.879320 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:31:49.879294    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef4e245_b3cc_46af_bf3d_27296f94bad9.slice/crio-b70fc57abd23d56180e190ff0448a199e58d591458f3cb4962c3a8c63b5ffb34 WatchSource:0}: Error finding container b70fc57abd23d56180e190ff0448a199e58d591458f3cb4962c3a8c63b5ffb34: Status 404 returned error can't find the container with id b70fc57abd23d56180e190ff0448a199e58d591458f3cb4962c3a8c63b5ffb34
Jul 21 06:31:50.561939 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:50.561850    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-n22qc" event={"ID":"eef4e245-b3cc-46af-bf3d-27296f94bad9","Type":"ContainerStarted","Data":"de2fcde1ce2f89b109a56f32e2b8db3417472f41f97802f3117ea419ef55b765"}
Jul 21 06:31:50.561939 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:50.561898    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ff745f6b9-n22qc" event={"ID":"eef4e245-b3cc-46af-bf3d-27296f94bad9","Type":"ContainerStarted","Data":"b70fc57abd23d56180e190ff0448a199e58d591458f3cb4962c3a8c63b5ffb34"}
Jul 21 06:31:50.562321 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:50.561945    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:31:50.579175 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:31:50.579128    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ff745f6b9-n22qc" podStartSLOduration=1.174190877 podStartE2EDuration="1.579115144s" totalImagesPullingTime="404.924267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:31:50.578012539 +0000 UTC m=+847.390756209" watchObservedRunningTime="2026-07-21 06:31:50.579115144 +0000 UTC m=+847.391858814"
Jul 21 06:32:01.568894 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:32:01.568859    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ff745f6b9-n22qc"
Jul 21 06:32:44.750837 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:32:44.750739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:32:44.758032 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:32:44.752617    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:37:44.779969 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:37:44.779944    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:37:44.783185 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:37:44.783164    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:40:32.381375 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.381341    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"]
Jul 21 06:40:32.385129 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.385108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.387678 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.387655    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-104f0ea1-kserve-self-signed-certs\""
Jul 21 06:40:32.394947 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.394927    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"]
Jul 21 06:40:32.510686 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.510656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tls-certs\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.510815 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.510692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-home\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.510815 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.510711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8tx7\" (UniqueName: \"kubernetes.io/projected/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-kube-api-access-b8tx7\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.510815 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.510731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-model-cache\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.510936 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.510826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tmp-dir\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.510936 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.510857    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-dshm\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612262 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tls-certs\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612402 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-home\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612402 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8tx7\" (UniqueName: \"kubernetes.io/projected/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-kube-api-access-b8tx7\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612402 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-model-cache\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612402 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tmp-dir\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612614 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-dshm\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612817 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-home\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612817 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tmp-dir\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.612992 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.612846    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-model-cache\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.614745 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.614723    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-dshm\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.614990 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.614975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tls-certs\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.619965 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.619948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8tx7\" (UniqueName: \"kubernetes.io/projected/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-kube-api-access-b8tx7\") pod \"e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") " pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.696197 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.696140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:32.828031 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.828008    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"]
Jul 21 06:40:32.830676 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:40:32.830649    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b8bfb8b_6938_4f0d_b9e7_def2aee6b296.slice/crio-ddfab5612a2d2e3493a37231ef715a9dfdf9c259fbbfeaacc1ac79df30ec97b0 WatchSource:0}: Error finding container ddfab5612a2d2e3493a37231ef715a9dfdf9c259fbbfeaacc1ac79df30ec97b0: Status 404 returned error can't find the container with id ddfab5612a2d2e3493a37231ef715a9dfdf9c259fbbfeaacc1ac79df30ec97b0
Jul 21 06:40:32.997739 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.997660    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g" event={"ID":"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296","Type":"ContainerStarted","Data":"afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7"}
Jul 21 06:40:32.997739 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:32.997701    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g" event={"ID":"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296","Type":"ContainerStarted","Data":"ddfab5612a2d2e3493a37231ef715a9dfdf9c259fbbfeaacc1ac79df30ec97b0"}
Jul 21 06:40:33.019240 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:33.019178    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g" podStartSLOduration=1.019160033 podStartE2EDuration="1.019160033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:40:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:40:33.018641428 +0000 UTC m=+1369.831385098" watchObservedRunningTime="2026-07-21 06:40:33.019160033 +0000 UTC m=+1369.831903703"
Jul 21 06:40:42.696958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:42.696920    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:42.697458 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:42.696981    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:42.710626 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:42.710595    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:43.056185 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:43.056151    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:40:54.394729 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:40:54.394691    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"]
Jul 21 06:41:09.417476 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.417413    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g" podUID="3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" containerName="main" containerID="cri-o://afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7" gracePeriod=45
Jul 21 06:41:09.674093 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.674034    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:41:09.818993 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.818964    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-dshm\") pod \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") "
Jul 21 06:41:09.819148 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.819030    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tmp-dir\") pod \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") "
Jul 21 06:41:09.819148 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.819053    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8tx7\" (UniqueName: \"kubernetes.io/projected/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-kube-api-access-b8tx7\") pod \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") "
Jul 21 06:41:09.819148 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.819093    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tls-certs\") pod \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") "
Jul 21 06:41:09.819148 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.819108    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-home\") pod \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") "
Jul 21 06:41:09.819148 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.819126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-model-cache\") pod \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\" (UID: \"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296\") "
Jul 21 06:41:09.819420 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.819332    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" (UID: "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 06:41:09.819420 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.819381    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-home" (OuterVolumeSpecName: "home") pod "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" (UID: "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 06:41:09.819516 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.819500    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" (UID: "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 06:41:09.821313 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.821282    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" (UID: "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:41:09.821428 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.821326    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-kube-api-access-b8tx7" (OuterVolumeSpecName: "kube-api-access-b8tx7") pod "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" (UID: "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296"). InnerVolumeSpecName "kube-api-access-b8tx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:41:09.821428 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.821331    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-dshm" (OuterVolumeSpecName: "dshm") pod "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" (UID: "3b8bfb8b-6938-4f0d-b9e7-def2aee6b296"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 06:41:09.920553 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.920509    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tls-certs\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:41:09.920553 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.920551    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-home\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:41:09.920701 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.920561    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-model-cache\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:41:09.920701 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.920570    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-dshm\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:41:09.920701 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.920577    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-tmp-dir\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:41:09.920701 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:09.920585    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8tx7\" (UniqueName: \"kubernetes.io/projected/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296-kube-api-access-b8tx7\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:41:10.172222 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.172185    2577 generic.go:356] "Generic (PLEG): container finished" podID="3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" containerID="afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7" exitCode=0
Jul 21 06:41:10.172419 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.172231    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"
Jul 21 06:41:10.172419 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.172271    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g" event={"ID":"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296","Type":"ContainerDied","Data":"afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7"}
Jul 21 06:41:10.172419 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.172319    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g" event={"ID":"3b8bfb8b-6938-4f0d-b9e7-def2aee6b296","Type":"ContainerDied","Data":"ddfab5612a2d2e3493a37231ef715a9dfdf9c259fbbfeaacc1ac79df30ec97b0"}
Jul 21 06:41:10.172419 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.172339    2577 scope.go:117] "RemoveContainer" containerID="afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7"
Jul 21 06:41:10.181493 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.181474    2577 scope.go:117] "RemoveContainer" containerID="afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7"
Jul 21 06:41:10.181754 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:41:10.181732    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7\": container with ID starting with afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7 not found: ID does not exist" containerID="afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7"
Jul 21 06:41:10.181855 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.181760    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7"} err="failed to get container status \"afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7\": rpc error: code = NotFound desc = could not find container \"afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7\": container with ID starting with afb5f8618c884c9803447a3bb4dead5881383b6fee878c088a28f0c6b9fb53e7 not found: ID does not exist"
Jul 21 06:41:10.194320 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.194296    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"]
Jul 21 06:41:10.197886 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:10.197867    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-104f0ea1-kserve-749cb8c6b7-6976g"]
Jul 21 06:41:11.713978 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:41:11.713933    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" path="/var/lib/kubelet/pods/3b8bfb8b-6938-4f0d-b9e7-def2aee6b296/volumes"
Jul 21 06:42:44.817682 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:42:44.817570    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:42:44.821715 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:42:44.820785    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:44:13.668688 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.668644    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"]
Jul 21 06:44:13.669569 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.669521    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" containerName="main"
Jul 21 06:44:13.669709 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.669577    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" containerName="main"
Jul 21 06:44:13.669769 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.669760    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b8bfb8b-6938-4f0d-b9e7-def2aee6b296" containerName="main"
Jul 21 06:44:13.674287 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.674262    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:13.676777 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.676751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"]
Jul 21 06:44:13.677781 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.677762    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-93c1870b-serving-cert\""
Jul 21 06:44:13.723209 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.723182    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04157fa-37d9-4ade-b898-f2036991b915-openshift-service-ca\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:13.723349 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.723223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvcsm\" (UniqueName: \"kubernetes.io/projected/b04157fa-37d9-4ade-b898-f2036991b915-kube-api-access-hvcsm\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:13.723349 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.723246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:13.824613 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.824582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04157fa-37d9-4ade-b898-f2036991b915-openshift-service-ca\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:13.824743 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.824630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvcsm\" (UniqueName: \"kubernetes.io/projected/b04157fa-37d9-4ade-b898-f2036991b915-kube-api-access-hvcsm\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:13.824743 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.824666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:13.824863 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:44:13.824808    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-serving-cert: secret "maas-api-e2e-ait-93c1870b-serving-cert" not found
Jul 21 06:44:13.824917 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:44:13.824886    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls podName:b04157fa-37d9-4ade-b898-f2036991b915 nodeName:}" failed. No retries permitted until 2026-07-21 06:44:14.32486546 +0000 UTC m=+1591.137609124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls") pod "maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q" (UID: "b04157fa-37d9-4ade-b898-f2036991b915") : secret "maas-api-e2e-ait-93c1870b-serving-cert" not found
Jul 21 06:44:13.825247 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.825227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04157fa-37d9-4ade-b898-f2036991b915-openshift-service-ca\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:13.835313 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:13.835286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvcsm\" (UniqueName: \"kubernetes.io/projected/b04157fa-37d9-4ade-b898-f2036991b915-kube-api-access-hvcsm\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:14.327708 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:14.327675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:14.330158 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:14.330138    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls\") pod \"maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:14.588410 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:14.588324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:14.722743 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:14.722722    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"]
Jul 21 06:44:14.724793 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:44:14.724759    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04157fa_37d9_4ade_b898_f2036991b915.slice/crio-785df618a0c359bf8c5f8f91fc4af7a5d1f1b6a5099022aa154b80e1104efb2b WatchSource:0}: Error finding container 785df618a0c359bf8c5f8f91fc4af7a5d1f1b6a5099022aa154b80e1104efb2b: Status 404 returned error can't find the container with id 785df618a0c359bf8c5f8f91fc4af7a5d1f1b6a5099022aa154b80e1104efb2b
Jul 21 06:44:14.726730 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:14.726707    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 06:44:15.047366 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:15.047332    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q" event={"ID":"b04157fa-37d9-4ade-b898-f2036991b915","Type":"ContainerStarted","Data":"785df618a0c359bf8c5f8f91fc4af7a5d1f1b6a5099022aa154b80e1104efb2b"}
Jul 21 06:44:16.053804 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:16.053769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q" event={"ID":"b04157fa-37d9-4ade-b898-f2036991b915","Type":"ContainerStarted","Data":"ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99"}
Jul 21 06:44:16.054164 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:16.053840    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:16.071078 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:16.071036    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q" podStartSLOduration=2.594573716 podStartE2EDuration="3.071020418s" totalImagesPullingTime="476.446702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:44:16.068956363 +0000 UTC m=+1592.881700047" watchObservedRunningTime="2026-07-21 06:44:16.071020418 +0000 UTC m=+1592.883764088"
Jul 21 06:44:22.064352 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:22.064325    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:49.698787 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:49.698700    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"]
Jul 21 06:44:49.699386 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:49.699350    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q" podUID="b04157fa-37d9-4ade-b898-f2036991b915" containerName="maas-api" containerID="cri-o://ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99" gracePeriod=30
Jul 21 06:44:49.958032 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:49.957976    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:50.013633 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.013613    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04157fa-37d9-4ade-b898-f2036991b915-openshift-service-ca\") pod \"b04157fa-37d9-4ade-b898-f2036991b915\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") "
Jul 21 06:44:50.013765 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.013638    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls\") pod \"b04157fa-37d9-4ade-b898-f2036991b915\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") "
Jul 21 06:44:50.013765 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.013689    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvcsm\" (UniqueName: \"kubernetes.io/projected/b04157fa-37d9-4ade-b898-f2036991b915-kube-api-access-hvcsm\") pod \"b04157fa-37d9-4ade-b898-f2036991b915\" (UID: \"b04157fa-37d9-4ade-b898-f2036991b915\") "
Jul 21 06:44:50.013911 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.013888    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04157fa-37d9-4ade-b898-f2036991b915-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b04157fa-37d9-4ade-b898-f2036991b915" (UID: "b04157fa-37d9-4ade-b898-f2036991b915"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:44:50.015895 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.015870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b04157fa-37d9-4ade-b898-f2036991b915" (UID: "b04157fa-37d9-4ade-b898-f2036991b915"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:44:50.015999 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.015904    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04157fa-37d9-4ade-b898-f2036991b915-kube-api-access-hvcsm" (OuterVolumeSpecName: "kube-api-access-hvcsm") pod "b04157fa-37d9-4ade-b898-f2036991b915" (UID: "b04157fa-37d9-4ade-b898-f2036991b915"). InnerVolumeSpecName "kube-api-access-hvcsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:44:50.115135 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.115111    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b04157fa-37d9-4ade-b898-f2036991b915-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:44:50.115221 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.115138    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b04157fa-37d9-4ade-b898-f2036991b915-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:44:50.115221 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.115154    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvcsm\" (UniqueName: \"kubernetes.io/projected/b04157fa-37d9-4ade-b898-f2036991b915-kube-api-access-hvcsm\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:44:50.214725 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.214662    2577 generic.go:356] "Generic (PLEG): container finished" podID="b04157fa-37d9-4ade-b898-f2036991b915" containerID="ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99" exitCode=0
Jul 21 06:44:50.214725 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.214704    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"
Jul 21 06:44:50.214863 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.214739    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q" event={"ID":"b04157fa-37d9-4ade-b898-f2036991b915","Type":"ContainerDied","Data":"ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99"}
Jul 21 06:44:50.214863 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.214790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q" event={"ID":"b04157fa-37d9-4ade-b898-f2036991b915","Type":"ContainerDied","Data":"785df618a0c359bf8c5f8f91fc4af7a5d1f1b6a5099022aa154b80e1104efb2b"}
Jul 21 06:44:50.214863 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.214813    2577 scope.go:117] "RemoveContainer" containerID="ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99"
Jul 21 06:44:50.223495 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.223477    2577 scope.go:117] "RemoveContainer" containerID="ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99"
Jul 21 06:44:50.223755 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:44:50.223735    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99\": container with ID starting with ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99 not found: ID does not exist" containerID="ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99"
Jul 21 06:44:50.223825 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.223768    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99"} err="failed to get container status \"ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99\": rpc error: code = NotFound desc = could not find container \"ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99\": container with ID starting with ea5809a3df55d7a5667c23b7a57dec651404ed4571bceb7aa668285afee5af99 not found: ID does not exist"
Jul 21 06:44:50.235454 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.235437    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"]
Jul 21 06:44:50.237179 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:50.237159    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-93c1870b-76b5cbf57b-7rh5q"]
Jul 21 06:44:51.713593 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:51.713558    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04157fa-37d9-4ade-b898-f2036991b915" path="/var/lib/kubelet/pods/b04157fa-37d9-4ade-b898-f2036991b915/volumes"
Jul 21 06:44:59.140145 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.140108    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"]
Jul 21 06:44:59.140756 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.140472    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04157fa-37d9-4ade-b898-f2036991b915" containerName="maas-api"
Jul 21 06:44:59.140756 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.140485    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04157fa-37d9-4ade-b898-f2036991b915" containerName="maas-api"
Jul 21 06:44:59.140756 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.140573    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04157fa-37d9-4ade-b898-f2036991b915" containerName="maas-api"
Jul 21 06:44:59.145059 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.145021    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.147870 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.147847    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-72493889-serving-cert\""
Jul 21 06:44:59.150958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.150934    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"]
Jul 21 06:44:59.186565 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.186529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.186676 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.186575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5fww\" (UniqueName: \"kubernetes.io/projected/31e4b563-0ea0-4846-a6e6-132dfc376c4a-kube-api-access-q5fww\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.186676 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.186622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4b563-0ea0-4846-a6e6-132dfc376c4a-openshift-service-ca\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.287791 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.287766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.287894 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.287797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5fww\" (UniqueName: \"kubernetes.io/projected/31e4b563-0ea0-4846-a6e6-132dfc376c4a-kube-api-access-q5fww\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.287894 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.287852    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4b563-0ea0-4846-a6e6-132dfc376c4a-openshift-service-ca\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.287978 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:44:59.287940    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-serving-cert: secret "maas-api-e2e-migrate-72493889-serving-cert" not found
Jul 21 06:44:59.288029 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:44:59.288018    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls podName:31e4b563-0ea0-4846-a6e6-132dfc376c4a nodeName:}" failed. No retries permitted until 2026-07-21 06:44:59.787997899 +0000 UTC m=+1636.600741551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls") pod "maas-api-e2e-migrate-72493889-5968ccc548-jkqpz" (UID: "31e4b563-0ea0-4846-a6e6-132dfc376c4a") : secret "maas-api-e2e-migrate-72493889-serving-cert" not found
Jul 21 06:44:59.288387 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.288371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4b563-0ea0-4846-a6e6-132dfc376c4a-openshift-service-ca\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.297038 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.297021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5fww\" (UniqueName: \"kubernetes.io/projected/31e4b563-0ea0-4846-a6e6-132dfc376c4a-kube-api-access-q5fww\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.792701 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.792672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:44:59.795241 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:44:59.795217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls\") pod \"maas-api-e2e-migrate-72493889-5968ccc548-jkqpz\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:45:00.059040 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.058956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:45:00.126916 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.126887    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p"]
Jul 21 06:45:00.130740 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.130718    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"]
Jul 21 06:45:00.130854 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.130841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p"
Jul 21 06:45:00.133415 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.133396    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 06:45:00.135270 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.135248    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"
Jul 21 06:45:00.137162 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.137102    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p"]
Jul 21 06:45:00.141203 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.141178    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"]
Jul 21 06:45:00.146100 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.146082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p"
Jul 21 06:45:00.155420 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.155399    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"
Jul 21 06:45:00.304703 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.304475    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p"]
Jul 21 06:45:00.308665 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:45:00.308633    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69ad42d_1001_48c0_8cff_29babad7e79e.slice/crio-4029936948e7f2e89dd4b2e66d2915df2c4c5c4dac86b2ef8c062a30b6009cec WatchSource:0}: Error finding container 4029936948e7f2e89dd4b2e66d2915df2c4c5c4dac86b2ef8c062a30b6009cec: Status 404 returned error can't find the container with id 4029936948e7f2e89dd4b2e66d2915df2c4c5c4dac86b2ef8c062a30b6009cec
Jul 21 06:45:00.330324 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.330304    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"]
Jul 21 06:45:00.332123 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:45:00.332104    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf476be7a_d44d_42d6_a546_6f168d6d84aa.slice/crio-4a48a6db8781525ccee1694ce16077f5157fa1da2d7f27a2190767f6cc5bf664 WatchSource:0}: Error finding container 4a48a6db8781525ccee1694ce16077f5157fa1da2d7f27a2190767f6cc5bf664: Status 404 returned error can't find the container with id 4a48a6db8781525ccee1694ce16077f5157fa1da2d7f27a2190767f6cc5bf664
Jul 21 06:45:00.423710 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:00.423684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"]
Jul 21 06:45:00.425406 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:45:00.425383    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e4b563_0ea0_4846_a6e6_132dfc376c4a.slice/crio-4de90899ea836ad93d7677b2f38eebe66f9215a28712a0b8d0730e91d225df70 WatchSource:0}: Error finding container 4de90899ea836ad93d7677b2f38eebe66f9215a28712a0b8d0730e91d225df70: Status 404 returned error can't find the container with id 4de90899ea836ad93d7677b2f38eebe66f9215a28712a0b8d0730e91d225df70
Jul 21 06:45:01.270085 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:01.270001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" event={"ID":"f476be7a-d44d-42d6-a546-6f168d6d84aa","Type":"ContainerStarted","Data":"4a48a6db8781525ccee1694ce16077f5157fa1da2d7f27a2190767f6cc5bf664"}
Jul 21 06:45:01.272337 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:01.272179    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz" event={"ID":"31e4b563-0ea0-4846-a6e6-132dfc376c4a","Type":"ContainerStarted","Data":"a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff"}
Jul 21 06:45:01.272337 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:01.272229    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz" event={"ID":"31e4b563-0ea0-4846-a6e6-132dfc376c4a","Type":"ContainerStarted","Data":"4de90899ea836ad93d7677b2f38eebe66f9215a28712a0b8d0730e91d225df70"}
Jul 21 06:45:01.272529 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:01.272393    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:45:01.274493 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:01.274467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p" event={"ID":"d69ad42d-1001-48c0-8cff-29babad7e79e","Type":"ContainerStarted","Data":"4029936948e7f2e89dd4b2e66d2915df2c4c5c4dac86b2ef8c062a30b6009cec"}
Jul 21 06:45:01.294568 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:01.294476    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz" podStartSLOduration=1.777173757 podStartE2EDuration="2.294456841s" totalImagesPullingTime="517.283084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:44:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:45:01.290447185 +0000 UTC m=+1638.103190863" watchObservedRunningTime="2026-07-21 06:45:01.294456841 +0000 UTC m=+1638.107200512"
Jul 21 06:45:03.286381 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:03.286347    2577 generic.go:356] "Generic (PLEG): container finished" podID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerID="3aa6a35fae1fd2991c2128be4893186ce20062abe373c3bec85f2f5940e18e34" exitCode=7
Jul 21 06:45:03.286733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:03.286424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" event={"ID":"f476be7a-d44d-42d6-a546-6f168d6d84aa","Type":"ContainerDied","Data":"3aa6a35fae1fd2991c2128be4893186ce20062abe373c3bec85f2f5940e18e34"}
Jul 21 06:45:03.286733 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:03.286585    2577 scope.go:117] "RemoveContainer" containerID="3aa6a35fae1fd2991c2128be4893186ce20062abe373c3bec85f2f5940e18e34"
Jul 21 06:45:03.287992 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:03.287966    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p" event={"ID":"d69ad42d-1001-48c0-8cff-29babad7e79e","Type":"ContainerStarted","Data":"30678d305dcd4c3b7a7daa575731405b59d8775b3faecd0bc3593b0a5639c1fd"}
Jul 21 06:45:03.318765 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:03.318726    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p" podStartSLOduration=1.118850577 podStartE2EDuration="3.318712724s" totalImagesPullingTime="2.199862147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:45:03.317525852 +0000 UTC m=+1640.130269523" watchObservedRunningTime="2026-07-21 06:45:03.318712724 +0000 UTC m=+1640.131456394"
Jul 21 06:45:04.294226 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:04.294179    2577 generic.go:356] "Generic (PLEG): container finished" podID="d69ad42d-1001-48c0-8cff-29babad7e79e" containerID="30678d305dcd4c3b7a7daa575731405b59d8775b3faecd0bc3593b0a5639c1fd" exitCode=0
Jul 21 06:45:04.294689 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:04.294260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p" event={"ID":"d69ad42d-1001-48c0-8cff-29babad7e79e","Type":"ContainerDied","Data":"30678d305dcd4c3b7a7daa575731405b59d8775b3faecd0bc3593b0a5639c1fd"}
Jul 21 06:45:04.296222 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:04.296199    2577 generic.go:356] "Generic (PLEG): container finished" podID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerID="e2dc25eedb59b9fe1afcaa3abe04d71811076ae06777f25e411c7664cd03a12b" exitCode=7
Jul 21 06:45:04.296360 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:04.296232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" event={"ID":"f476be7a-d44d-42d6-a546-6f168d6d84aa","Type":"ContainerDied","Data":"e2dc25eedb59b9fe1afcaa3abe04d71811076ae06777f25e411c7664cd03a12b"}
Jul 21 06:45:04.296360 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:04.296273    2577 scope.go:117] "RemoveContainer" containerID="3aa6a35fae1fd2991c2128be4893186ce20062abe373c3bec85f2f5940e18e34"
Jul 21 06:45:04.296443 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:04.296399    2577 scope.go:117] "RemoveContainer" containerID="e2dc25eedb59b9fe1afcaa3abe04d71811076ae06777f25e411c7664cd03a12b"
Jul 21 06:45:04.296663 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:45:04.296643    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th_odh-ai-gateway-infra(f476be7a-d44d-42d6-a546-6f168d6d84aa)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa"
Jul 21 06:45:05.302134 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:05.302110    2577 scope.go:117] "RemoveContainer" containerID="e2dc25eedb59b9fe1afcaa3abe04d71811076ae06777f25e411c7664cd03a12b"
Jul 21 06:45:05.302598 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:45:05.302360    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th_odh-ai-gateway-infra(f476be7a-d44d-42d6-a546-6f168d6d84aa)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa"
Jul 21 06:45:05.435788 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:05.435759    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p"
Jul 21 06:45:05.748659 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:45:05.748632    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69ad42d_1001_48c0_8cff_29babad7e79e.slice\": RecentStats: unable to find data in memory cache]"
Jul 21 06:45:06.308109 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:06.308077    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p"
Jul 21 06:45:06.308109 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:06.308102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743605-lqb6p" event={"ID":"d69ad42d-1001-48c0-8cff-29babad7e79e","Type":"ContainerDied","Data":"4029936948e7f2e89dd4b2e66d2915df2c4c5c4dac86b2ef8c062a30b6009cec"}
Jul 21 06:45:06.308510 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:06.308167    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4029936948e7f2e89dd4b2e66d2915df2c4c5c4dac86b2ef8c062a30b6009cec"
Jul 21 06:45:07.285787 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:07.285762    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:45:16.708601 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:16.708573    2577 scope.go:117] "RemoveContainer" containerID="e2dc25eedb59b9fe1afcaa3abe04d71811076ae06777f25e411c7664cd03a12b"
Jul 21 06:45:17.365108 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:17.365074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" event={"ID":"f476be7a-d44d-42d6-a546-6f168d6d84aa","Type":"ContainerStarted","Data":"f5afe2b1f7629de4bc524c2c83ef1d5eb1d9a83d2418a0253bfe55de971ba06f"}
Jul 21 06:45:17.384397 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:17.384349    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" podStartSLOduration=15.203270366 podStartE2EDuration="17.384334113s" totalImagesPullingTime="2.181063747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:45:17.383787033 +0000 UTC m=+1654.196530708" watchObservedRunningTime="2026-07-21 06:45:17.384334113 +0000 UTC m=+1654.197077783"
Jul 21 06:45:18.372838 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:18.372808    2577 generic.go:356] "Generic (PLEG): container finished" podID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerID="f5afe2b1f7629de4bc524c2c83ef1d5eb1d9a83d2418a0253bfe55de971ba06f" exitCode=0
Jul 21 06:45:18.373233 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:18.372886    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" event={"ID":"f476be7a-d44d-42d6-a546-6f168d6d84aa","Type":"ContainerDied","Data":"f5afe2b1f7629de4bc524c2c83ef1d5eb1d9a83d2418a0253bfe55de971ba06f"}
Jul 21 06:45:18.373233 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:18.372963    2577 scope.go:117] "RemoveContainer" containerID="e2dc25eedb59b9fe1afcaa3abe04d71811076ae06777f25e411c7664cd03a12b"
Jul 21 06:45:18.397911 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:18.397889    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"]
Jul 21 06:45:19.518483 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:19.518458    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"
Jul 21 06:45:20.386442 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:20.386416    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"
Jul 21 06:45:20.386625 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:20.386443    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th" event={"ID":"f476be7a-d44d-42d6-a546-6f168d6d84aa","Type":"ContainerDied","Data":"4a48a6db8781525ccee1694ce16077f5157fa1da2d7f27a2190767f6cc5bf664"}
Jul 21 06:45:20.386625 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:20.386515    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a48a6db8781525ccee1694ce16077f5157fa1da2d7f27a2190767f6cc5bf664"
Jul 21 06:45:20.448850 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:20.448823    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"]
Jul 21 06:45:20.461256 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:20.461229    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-72493889-29743605-r72th"]
Jul 21 06:45:21.714134 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:21.714093    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" path="/var/lib/kubelet/pods/f476be7a-d44d-42d6-a546-6f168d6d84aa/volumes"
Jul 21 06:45:34.525249 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.525219    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"]
Jul 21 06:45:34.525734 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.525419    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz" podUID="31e4b563-0ea0-4846-a6e6-132dfc376c4a" containerName="maas-api" containerID="cri-o://a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff" gracePeriod=30
Jul 21 06:45:34.776752 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.776693    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:45:34.889893 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.889863    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls\") pod \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") "
Jul 21 06:45:34.890058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.889914    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4b563-0ea0-4846-a6e6-132dfc376c4a-openshift-service-ca\") pod \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") "
Jul 21 06:45:34.890058 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.889982    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5fww\" (UniqueName: \"kubernetes.io/projected/31e4b563-0ea0-4846-a6e6-132dfc376c4a-kube-api-access-q5fww\") pod \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\" (UID: \"31e4b563-0ea0-4846-a6e6-132dfc376c4a\") "
Jul 21 06:45:34.890375 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.890348    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31e4b563-0ea0-4846-a6e6-132dfc376c4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31e4b563-0ea0-4846-a6e6-132dfc376c4a" (UID: "31e4b563-0ea0-4846-a6e6-132dfc376c4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:45:34.892042 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.892016    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31e4b563-0ea0-4846-a6e6-132dfc376c4a-kube-api-access-q5fww" (OuterVolumeSpecName: "kube-api-access-q5fww") pod "31e4b563-0ea0-4846-a6e6-132dfc376c4a" (UID: "31e4b563-0ea0-4846-a6e6-132dfc376c4a"). InnerVolumeSpecName "kube-api-access-q5fww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:45:34.892126 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.892084    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31e4b563-0ea0-4846-a6e6-132dfc376c4a" (UID: "31e4b563-0ea0-4846-a6e6-132dfc376c4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:45:34.991382 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.991354    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5fww\" (UniqueName: \"kubernetes.io/projected/31e4b563-0ea0-4846-a6e6-132dfc376c4a-kube-api-access-q5fww\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:45:34.991382 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.991380    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31e4b563-0ea0-4846-a6e6-132dfc376c4a-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:45:34.991528 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:34.991389    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31e4b563-0ea0-4846-a6e6-132dfc376c4a-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:45:35.472703 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.472674    2577 generic.go:356] "Generic (PLEG): container finished" podID="31e4b563-0ea0-4846-a6e6-132dfc376c4a" containerID="a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff" exitCode=0
Jul 21 06:45:35.472860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.472724    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz" event={"ID":"31e4b563-0ea0-4846-a6e6-132dfc376c4a","Type":"ContainerDied","Data":"a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff"}
Jul 21 06:45:35.472860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.472732    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"
Jul 21 06:45:35.472860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.472769    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz" event={"ID":"31e4b563-0ea0-4846-a6e6-132dfc376c4a","Type":"ContainerDied","Data":"4de90899ea836ad93d7677b2f38eebe66f9215a28712a0b8d0730e91d225df70"}
Jul 21 06:45:35.472860 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.472791    2577 scope.go:117] "RemoveContainer" containerID="a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff"
Jul 21 06:45:35.480963 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.480938    2577 scope.go:117] "RemoveContainer" containerID="a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff"
Jul 21 06:45:35.481283 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:45:35.481264    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff\": container with ID starting with a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff not found: ID does not exist" containerID="a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff"
Jul 21 06:45:35.481357 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.481294    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff"} err="failed to get container status \"a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff\": rpc error: code = NotFound desc = could not find container \"a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff\": container with ID starting with a7d8b144c650fb1b18bf8972181d5fb92a9842fe010f9c1c24b2b634ff522bff not found: ID does not exist"
Jul 21 06:45:35.509844 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.509825    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"]
Jul 21 06:45:35.513203 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.513182    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-72493889-5968ccc548-jkqpz"]
Jul 21 06:45:35.714228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:35.714194    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e4b563-0ea0-4846-a6e6-132dfc376c4a" path="/var/lib/kubelet/pods/31e4b563-0ea0-4846-a6e6-132dfc376c4a/volumes"
Jul 21 06:45:42.248602 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.248567    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"]
Jul 21 06:45:42.248982 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.248970    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e4b563-0ea0-4846-a6e6-132dfc376c4a" containerName="maas-api"
Jul 21 06:45:42.248982 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.248983    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e4b563-0ea0-4846-a6e6-132dfc376c4a" containerName="maas-api"
Jul 21 06:45:42.249068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.248992    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:45:42.249068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.248997    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:45:42.249068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.249010    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d69ad42d-1001-48c0-8cff-29babad7e79e" containerName="cleanup"
Jul 21 06:45:42.249068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.249016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69ad42d-1001-48c0-8cff-29babad7e79e" containerName="cleanup"
Jul 21 06:45:42.249068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.249031    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:45:42.249068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.249037    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:45:42.249250 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.249112    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:45:42.249250 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.249120    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:45:42.249250 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.249127    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e4b563-0ea0-4846-a6e6-132dfc376c4a" containerName="maas-api"
Jul 21 06:45:42.249250 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.249133    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d69ad42d-1001-48c0-8cff-29babad7e79e" containerName="cleanup"
Jul 21 06:45:42.257003 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.256973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.259732 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.259704    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-281e53fe-serving-cert\""
Jul 21 06:45:42.261919 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.261887    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"]
Jul 21 06:45:42.355479 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.355435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.355479 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.355475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-openshift-service-ca\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.355794 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.355500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl59z\" (UniqueName: \"kubernetes.io/projected/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-kube-api-access-jl59z\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.456649 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.456604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.456841 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.456647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-openshift-service-ca\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.456841 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.456688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl59z\" (UniqueName: \"kubernetes.io/projected/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-kube-api-access-jl59z\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.456841 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:45:42.456767    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-serving-cert: secret "maas-api-e2e-ait-281e53fe-serving-cert" not found
Jul 21 06:45:42.457028 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:45:42.456844    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls podName:808e6d9c-7a87-4d7f-990a-2d7953ff11b8 nodeName:}" failed. No retries permitted until 2026-07-21 06:45:42.956820453 +0000 UTC m=+1679.769564110 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls") pod "maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr" (UID: "808e6d9c-7a87-4d7f-990a-2d7953ff11b8") : secret "maas-api-e2e-ait-281e53fe-serving-cert" not found
Jul 21 06:45:42.457358 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.457337    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-openshift-service-ca\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.470598 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.470563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl59z\" (UniqueName: \"kubernetes.io/projected/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-kube-api-access-jl59z\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.961881 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.961842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:42.964381 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:42.964354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls\") pod \"maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:43.170758 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:43.170716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:43.345212 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:43.345171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"]
Jul 21 06:45:43.347685 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:45:43.347653    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod808e6d9c_7a87_4d7f_990a_2d7953ff11b8.slice/crio-f46c4bf11ad35b3dcc6ace3424c6e8a3e1cf46c7b0ed5ccd9804f7e8f2d3724f WatchSource:0}: Error finding container f46c4bf11ad35b3dcc6ace3424c6e8a3e1cf46c7b0ed5ccd9804f7e8f2d3724f: Status 404 returned error can't find the container with id f46c4bf11ad35b3dcc6ace3424c6e8a3e1cf46c7b0ed5ccd9804f7e8f2d3724f
Jul 21 06:45:43.512661 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:43.512516    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr" event={"ID":"808e6d9c-7a87-4d7f-990a-2d7953ff11b8","Type":"ContainerStarted","Data":"f46c4bf11ad35b3dcc6ace3424c6e8a3e1cf46c7b0ed5ccd9804f7e8f2d3724f"}
Jul 21 06:45:44.518517 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:44.518477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr" event={"ID":"808e6d9c-7a87-4d7f-990a-2d7953ff11b8","Type":"ContainerStarted","Data":"2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17"}
Jul 21 06:45:44.518986 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:44.518575    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:45:44.551923 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:44.551877    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr" podStartSLOduration=1.9811192960000001 podStartE2EDuration="2.551864008s" totalImagesPullingTime="570.744712ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:45:44.548736069 +0000 UTC m=+1681.361479738" watchObservedRunningTime="2026-07-21 06:45:44.551864008 +0000 UTC m=+1681.364607678"
Jul 21 06:45:50.529124 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:45:50.529096    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:46:07.982825 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:07.982739    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"]
Jul 21 06:46:07.983288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:07.983158    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:46:07.983288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:07.983172    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:46:07.983288 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:07.983242    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f476be7a-d44d-42d6-a546-6f168d6d84aa" containerName="cleanup"
Jul 21 06:46:07.986425 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:07.986409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"
Jul 21 06:46:07.988873 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:07.988852    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 06:46:07.992340 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:07.992320    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"]
Jul 21 06:46:08.065526 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:08.065498    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a566b084-eaea-4f2d-8725-c0d8cf89bcb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-281e53fe-zct69\" (UID: \"a566b084-eaea-4f2d-8725-c0d8cf89bcb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"
Jul 21 06:46:08.166636 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:08.166603    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a566b084-eaea-4f2d-8725-c0d8cf89bcb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-281e53fe-zct69\" (UID: \"a566b084-eaea-4f2d-8725-c0d8cf89bcb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"
Jul 21 06:46:08.167289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:08.167267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a566b084-eaea-4f2d-8725-c0d8cf89bcb9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-281e53fe-zct69\" (UID: \"a566b084-eaea-4f2d-8725-c0d8cf89bcb9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"
Jul 21 06:46:08.298737 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:08.298707    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"
Jul 21 06:46:08.434988 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:08.434798    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"]
Jul 21 06:46:08.437999 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:46:08.437971    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda566b084_eaea_4f2d_8725_c0d8cf89bcb9.slice/crio-77bdd5febeb5b4a88c02714580e6983a7552ae5de79f3b09f54687a04703b37b WatchSource:0}: Error finding container 77bdd5febeb5b4a88c02714580e6983a7552ae5de79f3b09f54687a04703b37b: Status 404 returned error can't find the container with id 77bdd5febeb5b4a88c02714580e6983a7552ae5de79f3b09f54687a04703b37b
Jul 21 06:46:08.635017 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:08.634957    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69" event={"ID":"a566b084-eaea-4f2d-8725-c0d8cf89bcb9","Type":"ContainerStarted","Data":"77bdd5febeb5b4a88c02714580e6983a7552ae5de79f3b09f54687a04703b37b"}
Jul 21 06:46:09.641680 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:09.641648    2577 generic.go:356] "Generic (PLEG): container finished" podID="a566b084-eaea-4f2d-8725-c0d8cf89bcb9" containerID="7e93ae7af5940faff849f2c21a88811b59199e8e9e58ee266a1c903818a197e4" exitCode=0
Jul 21 06:46:09.642033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:09.641685    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69" event={"ID":"a566b084-eaea-4f2d-8725-c0d8cf89bcb9","Type":"ContainerDied","Data":"7e93ae7af5940faff849f2c21a88811b59199e8e9e58ee266a1c903818a197e4"}
Jul 21 06:46:10.778029 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:10.778003    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"
Jul 21 06:46:10.892039 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:10.892011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a566b084-eaea-4f2d-8725-c0d8cf89bcb9-maas-api-service-ca\") pod \"a566b084-eaea-4f2d-8725-c0d8cf89bcb9\" (UID: \"a566b084-eaea-4f2d-8725-c0d8cf89bcb9\") "
Jul 21 06:46:10.892326 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:10.892303    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a566b084-eaea-4f2d-8725-c0d8cf89bcb9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a566b084-eaea-4f2d-8725-c0d8cf89bcb9" (UID: "a566b084-eaea-4f2d-8725-c0d8cf89bcb9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:46:10.992821 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:10.992764    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a566b084-eaea-4f2d-8725-c0d8cf89bcb9-maas-api-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:46:11.653115 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:11.653085    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"
Jul 21 06:46:11.653305 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:11.653125    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69" event={"ID":"a566b084-eaea-4f2d-8725-c0d8cf89bcb9","Type":"ContainerDied","Data":"77bdd5febeb5b4a88c02714580e6983a7552ae5de79f3b09f54687a04703b37b"}
Jul 21 06:46:11.653305 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:11.653168    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77bdd5febeb5b4a88c02714580e6983a7552ae5de79f3b09f54687a04703b37b"
Jul 21 06:46:18.389043 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.389012    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"]
Jul 21 06:46:18.389515 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.389208    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr" podUID="808e6d9c-7a87-4d7f-990a-2d7953ff11b8" containerName="maas-api" containerID="cri-o://2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17" gracePeriod=30
Jul 21 06:46:18.633340 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.633312    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:46:18.685987 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.685906    2577 generic.go:356] "Generic (PLEG): container finished" podID="808e6d9c-7a87-4d7f-990a-2d7953ff11b8" containerID="2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17" exitCode=0
Jul 21 06:46:18.685987 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.685945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr" event={"ID":"808e6d9c-7a87-4d7f-990a-2d7953ff11b8","Type":"ContainerDied","Data":"2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17"}
Jul 21 06:46:18.685987 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.685983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr" event={"ID":"808e6d9c-7a87-4d7f-990a-2d7953ff11b8","Type":"ContainerDied","Data":"f46c4bf11ad35b3dcc6ace3424c6e8a3e1cf46c7b0ed5ccd9804f7e8f2d3724f"}
Jul 21 06:46:18.686211 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.686007    2577 scope.go:117] "RemoveContainer" containerID="2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17"
Jul 21 06:46:18.686211 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.685946    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"
Jul 21 06:46:18.694448 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.694431    2577 scope.go:117] "RemoveContainer" containerID="2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17"
Jul 21 06:46:18.694737 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:46:18.694718    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17\": container with ID starting with 2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17 not found: ID does not exist" containerID="2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17"
Jul 21 06:46:18.694809 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.694744    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17"} err="failed to get container status \"2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17\": rpc error: code = NotFound desc = could not find container \"2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17\": container with ID starting with 2e60b05bbeb12d3816b33049ec9cd56b559aa15b5b9bfa1aaa22d129d7cb3e17 not found: ID does not exist"
Jul 21 06:46:18.756747 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.756725    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl59z\" (UniqueName: \"kubernetes.io/projected/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-kube-api-access-jl59z\") pod \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") "
Jul 21 06:46:18.756842 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.756827    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls\") pod \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") "
Jul 21 06:46:18.756881 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.756852    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-openshift-service-ca\") pod \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\" (UID: \"808e6d9c-7a87-4d7f-990a-2d7953ff11b8\") "
Jul 21 06:46:18.757228 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.757201    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "808e6d9c-7a87-4d7f-990a-2d7953ff11b8" (UID: "808e6d9c-7a87-4d7f-990a-2d7953ff11b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:46:18.758828 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.758807    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-kube-api-access-jl59z" (OuterVolumeSpecName: "kube-api-access-jl59z") pod "808e6d9c-7a87-4d7f-990a-2d7953ff11b8" (UID: "808e6d9c-7a87-4d7f-990a-2d7953ff11b8"). InnerVolumeSpecName "kube-api-access-jl59z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:46:18.758930 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.758912    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "808e6d9c-7a87-4d7f-990a-2d7953ff11b8" (UID: "808e6d9c-7a87-4d7f-990a-2d7953ff11b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:46:18.863402 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.857770    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:46:18.863402 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.857808    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:46:18.863613 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:18.863467    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl59z\" (UniqueName: \"kubernetes.io/projected/808e6d9c-7a87-4d7f-990a-2d7953ff11b8-kube-api-access-jl59z\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:46:19.008169 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:19.008142    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"]
Jul 21 06:46:19.011651 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:19.011631    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-281e53fe-646cbc8458-ch9lr"]
Jul 21 06:46:19.714374 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:19.714334    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="808e6d9c-7a87-4d7f-990a-2d7953ff11b8" path="/var/lib/kubelet/pods/808e6d9c-7a87-4d7f-990a-2d7953ff11b8/volumes"
Jul 21 06:46:23.062895 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:23.062857    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"]
Jul 21 06:46:23.065573 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:23.065508    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-281e53fe-zct69"]
Jul 21 06:46:23.713970 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:23.713934    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a566b084-eaea-4f2d-8725-c0d8cf89bcb9" path="/var/lib/kubelet/pods/a566b084-eaea-4f2d-8725-c0d8cf89bcb9/volumes"
Jul 21 06:46:27.433143 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.433109    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"]
Jul 21 06:46:27.433681 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.433664    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="808e6d9c-7a87-4d7f-990a-2d7953ff11b8" containerName="maas-api"
Jul 21 06:46:27.433758 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.433683    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="808e6d9c-7a87-4d7f-990a-2d7953ff11b8" containerName="maas-api"
Jul 21 06:46:27.433758 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.433708    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a566b084-eaea-4f2d-8725-c0d8cf89bcb9" containerName="revoke-keys"
Jul 21 06:46:27.433758 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.433716    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a566b084-eaea-4f2d-8725-c0d8cf89bcb9" containerName="revoke-keys"
Jul 21 06:46:27.433914 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.433806    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a566b084-eaea-4f2d-8725-c0d8cf89bcb9" containerName="revoke-keys"
Jul 21 06:46:27.433914 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.433821    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="808e6d9c-7a87-4d7f-990a-2d7953ff11b8" containerName="maas-api"
Jul 21 06:46:27.438267 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.438237    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:27.440731 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.440708    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-584a4a02-serving-cert\""
Jul 21 06:46:27.448330 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.448303    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"]
Jul 21 06:46:27.545647 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.545610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrbh\" (UniqueName: \"kubernetes.io/projected/14b44faa-aa3c-4df8-b611-7cad77b00342-kube-api-access-brrbh\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:27.545853 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.545681    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b44faa-aa3c-4df8-b611-7cad77b00342-openshift-service-ca\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:27.545853 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.545720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:27.646931 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.646892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b44faa-aa3c-4df8-b611-7cad77b00342-openshift-service-ca\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:27.647139 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.646946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:27.647139 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.647038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrbh\" (UniqueName: \"kubernetes.io/projected/14b44faa-aa3c-4df8-b611-7cad77b00342-kube-api-access-brrbh\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:27.647139 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:46:27.647125    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-serving-cert: secret "maas-api-e2e-derive-584a4a02-serving-cert" not found
Jul 21 06:46:27.647283 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:46:27.647205    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls podName:14b44faa-aa3c-4df8-b611-7cad77b00342 nodeName:}" failed. No retries permitted until 2026-07-21 06:46:28.147187409 +0000 UTC m=+1724.959931058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls") pod "maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm" (UID: "14b44faa-aa3c-4df8-b611-7cad77b00342") : secret "maas-api-e2e-derive-584a4a02-serving-cert" not found
Jul 21 06:46:27.647587 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.647567    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b44faa-aa3c-4df8-b611-7cad77b00342-openshift-service-ca\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:27.656026 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:27.655998    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrbh\" (UniqueName: \"kubernetes.io/projected/14b44faa-aa3c-4df8-b611-7cad77b00342-kube-api-access-brrbh\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:28.151972 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:28.151934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:28.154794 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:28.154768    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls\") pod \"maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:28.351091 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:28.351049    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:28.700243 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:28.700075    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"]
Jul 21 06:46:28.702919 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:46:28.702891    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b44faa_aa3c_4df8_b611_7cad77b00342.slice/crio-1b2044a6602e1422281c2d999bfc82cdfeb4f875b5c116f840f8aba5898242d4 WatchSource:0}: Error finding container 1b2044a6602e1422281c2d999bfc82cdfeb4f875b5c116f840f8aba5898242d4: Status 404 returned error can't find the container with id 1b2044a6602e1422281c2d999bfc82cdfeb4f875b5c116f840f8aba5898242d4
Jul 21 06:46:28.741099 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:28.741060    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm" event={"ID":"14b44faa-aa3c-4df8-b611-7cad77b00342","Type":"ContainerStarted","Data":"1b2044a6602e1422281c2d999bfc82cdfeb4f875b5c116f840f8aba5898242d4"}
Jul 21 06:46:29.749104 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:29.749064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm" event={"ID":"14b44faa-aa3c-4df8-b611-7cad77b00342","Type":"ContainerStarted","Data":"73c9831f7c4b991b1457a4400d38e580f88b193932ed76c39e7eebf1bab554dd"}
Jul 21 06:46:29.749485 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:29.749172    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:46:29.765435 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:29.765380    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm" podStartSLOduration=2.223129025 podStartE2EDuration="2.765360096s" totalImagesPullingTime="542.231071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:46:29.764925727 +0000 UTC m=+1726.577669398" watchObservedRunningTime="2026-07-21 06:46:29.765360096 +0000 UTC m=+1726.578103766"
Jul 21 06:46:35.761114 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:46:35.761080    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:47:02.741089 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:02.741051    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"]
Jul 21 06:47:02.741596 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:02.741276    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm" podUID="14b44faa-aa3c-4df8-b611-7cad77b00342" containerName="maas-api" containerID="cri-o://73c9831f7c4b991b1457a4400d38e580f88b193932ed76c39e7eebf1bab554dd" gracePeriod=30
Jul 21 06:47:02.915956 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:02.915918    2577 generic.go:356] "Generic (PLEG): container finished" podID="14b44faa-aa3c-4df8-b611-7cad77b00342" containerID="73c9831f7c4b991b1457a4400d38e580f88b193932ed76c39e7eebf1bab554dd" exitCode=0
Jul 21 06:47:02.916105 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:02.916044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm" event={"ID":"14b44faa-aa3c-4df8-b611-7cad77b00342","Type":"ContainerDied","Data":"73c9831f7c4b991b1457a4400d38e580f88b193932ed76c39e7eebf1bab554dd"}
Jul 21 06:47:02.993812 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:02.993747    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:47:03.080797 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.080753    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b44faa-aa3c-4df8-b611-7cad77b00342-openshift-service-ca\") pod \"14b44faa-aa3c-4df8-b611-7cad77b00342\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") "
Jul 21 06:47:03.080797 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.080802    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brrbh\" (UniqueName: \"kubernetes.io/projected/14b44faa-aa3c-4df8-b611-7cad77b00342-kube-api-access-brrbh\") pod \"14b44faa-aa3c-4df8-b611-7cad77b00342\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") "
Jul 21 06:47:03.081068 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.080842    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls\") pod \"14b44faa-aa3c-4df8-b611-7cad77b00342\" (UID: \"14b44faa-aa3c-4df8-b611-7cad77b00342\") "
Jul 21 06:47:03.081137 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.081102    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14b44faa-aa3c-4df8-b611-7cad77b00342-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "14b44faa-aa3c-4df8-b611-7cad77b00342" (UID: "14b44faa-aa3c-4df8-b611-7cad77b00342"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:47:03.083104 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.083078    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "14b44faa-aa3c-4df8-b611-7cad77b00342" (UID: "14b44faa-aa3c-4df8-b611-7cad77b00342"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:47:03.083217 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.083171    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14b44faa-aa3c-4df8-b611-7cad77b00342-kube-api-access-brrbh" (OuterVolumeSpecName: "kube-api-access-brrbh") pod "14b44faa-aa3c-4df8-b611-7cad77b00342" (UID: "14b44faa-aa3c-4df8-b611-7cad77b00342"). InnerVolumeSpecName "kube-api-access-brrbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:47:03.181819 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.181784    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b44faa-aa3c-4df8-b611-7cad77b00342-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:47:03.181819 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.181813    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b44faa-aa3c-4df8-b611-7cad77b00342-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:47:03.181819 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.181824    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brrbh\" (UniqueName: \"kubernetes.io/projected/14b44faa-aa3c-4df8-b611-7cad77b00342-kube-api-access-brrbh\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:47:03.922689 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.922662    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"
Jul 21 06:47:03.923076 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.922666    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm" event={"ID":"14b44faa-aa3c-4df8-b611-7cad77b00342","Type":"ContainerDied","Data":"1b2044a6602e1422281c2d999bfc82cdfeb4f875b5c116f840f8aba5898242d4"}
Jul 21 06:47:03.923076 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.922815    2577 scope.go:117] "RemoveContainer" containerID="73c9831f7c4b991b1457a4400d38e580f88b193932ed76c39e7eebf1bab554dd"
Jul 21 06:47:03.937812 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.937782    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"]
Jul 21 06:47:03.941653 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:03.941630    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-584a4a02-5f7557c5dc-r2dnm"]
Jul 21 06:47:05.715621 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:05.715579    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14b44faa-aa3c-4df8-b611-7cad77b00342" path="/var/lib/kubelet/pods/14b44faa-aa3c-4df8-b611-7cad77b00342/volumes"
Jul 21 06:47:44.847146 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:44.847026    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:47:44.853055 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:47:44.850108    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:48:49.094843 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.094807    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"]
Jul 21 06:48:49.095361 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.095210    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14b44faa-aa3c-4df8-b611-7cad77b00342" containerName="maas-api"
Jul 21 06:48:49.095361 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.095222    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="14b44faa-aa3c-4df8-b611-7cad77b00342" containerName="maas-api"
Jul 21 06:48:49.095361 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.095301    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="14b44faa-aa3c-4df8-b611-7cad77b00342" containerName="maas-api"
Jul 21 06:48:49.098439 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.098419    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.101620 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.101596    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e51ee93a-serving-cert\""
Jul 21 06:48:49.107657 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.107637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"]
Jul 21 06:48:49.116108 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.116081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dw5m\" (UniqueName: \"kubernetes.io/projected/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-kube-api-access-7dw5m\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.116239 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.116220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-openshift-service-ca\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.116311 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.116297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.217550 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.217498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.217686 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.217551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dw5m\" (UniqueName: \"kubernetes.io/projected/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-kube-api-access-7dw5m\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.217686 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.217646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-openshift-service-ca\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.217686 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:48:49.217646    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-serving-cert: secret "maas-api-e2e-mt-e51ee93a-serving-cert" not found
Jul 21 06:48:49.217855 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:48:49.217725    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls podName:1819948e-cc7c-4ef1-abba-bc69aec8cc1d nodeName:}" failed. No retries permitted until 2026-07-21 06:48:49.717705327 +0000 UTC m=+1866.530449001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls") pod "maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz" (UID: "1819948e-cc7c-4ef1-abba-bc69aec8cc1d") : secret "maas-api-e2e-mt-e51ee93a-serving-cert" not found
Jul 21 06:48:49.218271 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.218255    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-openshift-service-ca\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.231431 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.231403    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dw5m\" (UniqueName: \"kubernetes.io/projected/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-kube-api-access-7dw5m\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.722876 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.722849    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:49.725448 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:49.725417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls\") pod \"maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:50.010784 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:50.010689    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:50.146508 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:50.146483    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"]
Jul 21 06:48:50.149091 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:48:50.149054    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1819948e_cc7c_4ef1_abba_bc69aec8cc1d.slice/crio-ddf88b6c4b2317c148cfd28be8b57df35e41f043fbf6fd469f4f20f5e123b1ec WatchSource:0}: Error finding container ddf88b6c4b2317c148cfd28be8b57df35e41f043fbf6fd469f4f20f5e123b1ec: Status 404 returned error can't find the container with id ddf88b6c4b2317c148cfd28be8b57df35e41f043fbf6fd469f4f20f5e123b1ec
Jul 21 06:48:50.442905 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:50.442866    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz" event={"ID":"1819948e-cc7c-4ef1-abba-bc69aec8cc1d","Type":"ContainerStarted","Data":"ddf88b6c4b2317c148cfd28be8b57df35e41f043fbf6fd469f4f20f5e123b1ec"}
Jul 21 06:48:51.449165 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:51.449130    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz" event={"ID":"1819948e-cc7c-4ef1-abba-bc69aec8cc1d","Type":"ContainerStarted","Data":"92b334316bd6a586828900fb89de48c4cd050ca5403b6909d73ed4bac331b51a"}
Jul 21 06:48:51.449585 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:51.449244    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:48:51.466317 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:51.466271    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz" podStartSLOduration=1.82330345 podStartE2EDuration="2.466260072s" totalImagesPullingTime="642.956622ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:48:51.465649294 +0000 UTC m=+1868.278392965" watchObservedRunningTime="2026-07-21 06:48:51.466260072 +0000 UTC m=+1868.279003741"
Jul 21 06:48:57.459185 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:48:57.459153    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:49:11.371664 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.371574    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"]
Jul 21 06:49:11.372112 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.371853    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz" podUID="1819948e-cc7c-4ef1-abba-bc69aec8cc1d" containerName="maas-api" containerID="cri-o://92b334316bd6a586828900fb89de48c4cd050ca5403b6909d73ed4bac331b51a" gracePeriod=30
Jul 21 06:49:11.552626 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.552593    2577 generic.go:356] "Generic (PLEG): container finished" podID="1819948e-cc7c-4ef1-abba-bc69aec8cc1d" containerID="92b334316bd6a586828900fb89de48c4cd050ca5403b6909d73ed4bac331b51a" exitCode=0
Jul 21 06:49:11.552794 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.552681    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz" event={"ID":"1819948e-cc7c-4ef1-abba-bc69aec8cc1d","Type":"ContainerDied","Data":"92b334316bd6a586828900fb89de48c4cd050ca5403b6909d73ed4bac331b51a"}
Jul 21 06:49:11.608511 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.608484    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:49:11.705959 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.705904    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls\") pod \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") "
Jul 21 06:49:11.706060 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.705973    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-openshift-service-ca\") pod \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") "
Jul 21 06:49:11.706060 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.706029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dw5m\" (UniqueName: \"kubernetes.io/projected/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-kube-api-access-7dw5m\") pod \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\" (UID: \"1819948e-cc7c-4ef1-abba-bc69aec8cc1d\") "
Jul 21 06:49:11.706360 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.706331    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1819948e-cc7c-4ef1-abba-bc69aec8cc1d" (UID: "1819948e-cc7c-4ef1-abba-bc69aec8cc1d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:49:11.708141 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.708116    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1819948e-cc7c-4ef1-abba-bc69aec8cc1d" (UID: "1819948e-cc7c-4ef1-abba-bc69aec8cc1d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:49:11.708293 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.708279    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-kube-api-access-7dw5m" (OuterVolumeSpecName: "kube-api-access-7dw5m") pod "1819948e-cc7c-4ef1-abba-bc69aec8cc1d" (UID: "1819948e-cc7c-4ef1-abba-bc69aec8cc1d"). InnerVolumeSpecName "kube-api-access-7dw5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:49:11.807478 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.807444    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dw5m\" (UniqueName: \"kubernetes.io/projected/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-kube-api-access-7dw5m\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:49:11.807478 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.807479    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:49:11.807635 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:11.807490    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1819948e-cc7c-4ef1-abba-bc69aec8cc1d-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:49:12.559178 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:12.559153    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"
Jul 21 06:49:12.559564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:12.559192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz" event={"ID":"1819948e-cc7c-4ef1-abba-bc69aec8cc1d","Type":"ContainerDied","Data":"ddf88b6c4b2317c148cfd28be8b57df35e41f043fbf6fd469f4f20f5e123b1ec"}
Jul 21 06:49:12.559564 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:12.559252    2577 scope.go:117] "RemoveContainer" containerID="92b334316bd6a586828900fb89de48c4cd050ca5403b6909d73ed4bac331b51a"
Jul 21 06:49:12.577181 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:12.577160    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"]
Jul 21 06:49:12.581031 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:12.581012    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e51ee93a-dcddd6ccb-2l7cz"]
Jul 21 06:49:13.713234 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:13.713198    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1819948e-cc7c-4ef1-abba-bc69aec8cc1d" path="/var/lib/kubelet/pods/1819948e-cc7c-4ef1-abba-bc69aec8cc1d/volumes"
Jul 21 06:49:48.434477 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.434436    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"]
Jul 21 06:49:48.434922 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.434822    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1819948e-cc7c-4ef1-abba-bc69aec8cc1d" containerName="maas-api"
Jul 21 06:49:48.434922 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.434835    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1819948e-cc7c-4ef1-abba-bc69aec8cc1d" containerName="maas-api"
Jul 21 06:49:48.434922 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.434909    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1819948e-cc7c-4ef1-abba-bc69aec8cc1d" containerName="maas-api"
Jul 21 06:49:48.438103 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.438084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.442886 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.442866    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1ae2daad-serving-cert\""
Jul 21 06:49:48.455597 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.455567    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"]
Jul 21 06:49:48.552503 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.552465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a01de6-aaf4-4678-a87f-048ce439deb9-maas-api-tls\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.552688 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.552517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a01de6-aaf4-4678-a87f-048ce439deb9-openshift-service-ca\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.552688 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.552613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8lvr\" (UniqueName: \"kubernetes.io/projected/64a01de6-aaf4-4678-a87f-048ce439deb9-kube-api-access-l8lvr\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.653199 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.653161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a01de6-aaf4-4678-a87f-048ce439deb9-maas-api-tls\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.653367 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.653215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a01de6-aaf4-4678-a87f-048ce439deb9-openshift-service-ca\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.653367 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.653278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8lvr\" (UniqueName: \"kubernetes.io/projected/64a01de6-aaf4-4678-a87f-048ce439deb9-kube-api-access-l8lvr\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.653985 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.653963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a01de6-aaf4-4678-a87f-048ce439deb9-openshift-service-ca\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.655845 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.655827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a01de6-aaf4-4678-a87f-048ce439deb9-maas-api-tls\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.675995 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.675974    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8lvr\" (UniqueName: \"kubernetes.io/projected/64a01de6-aaf4-4678-a87f-048ce439deb9-kube-api-access-l8lvr\") pod \"maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.749029 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.748950    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:48.890398 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.890187    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"]
Jul 21 06:49:48.893141 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:49:48.893116    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a01de6_aaf4_4678_a87f_048ce439deb9.slice/crio-e9aab2a8c156cc1bbf81b987c6271bdddecde08b1959157a7b12efaf12a47be0 WatchSource:0}: Error finding container e9aab2a8c156cc1bbf81b987c6271bdddecde08b1959157a7b12efaf12a47be0: Status 404 returned error can't find the container with id e9aab2a8c156cc1bbf81b987c6271bdddecde08b1959157a7b12efaf12a47be0
Jul 21 06:49:48.894710 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:48.894687    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 06:49:49.742829 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:49.742737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp" event={"ID":"64a01de6-aaf4-4678-a87f-048ce439deb9","Type":"ContainerStarted","Data":"d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c"}
Jul 21 06:49:49.742829 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:49.742787    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp" event={"ID":"64a01de6-aaf4-4678-a87f-048ce439deb9","Type":"ContainerStarted","Data":"e9aab2a8c156cc1bbf81b987c6271bdddecde08b1959157a7b12efaf12a47be0"}
Jul 21 06:49:49.743257 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:49.742846    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:55.753788 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:55.753697    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:49:55.782920 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:49:55.782865    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp" podStartSLOduration=7.18892235 podStartE2EDuration="7.7828483s" totalImagesPullingTime="593.92595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:49:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:49:49.774434319 +0000 UTC m=+1926.587177988" watchObservedRunningTime="2026-07-21 06:49:55.7828483 +0000 UTC m=+1932.595591970"
Jul 21 06:50:52.161811 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.161599    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"]
Jul 21 06:50:52.162761 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.162722    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp" podUID="64a01de6-aaf4-4678-a87f-048ce439deb9" containerName="maas-api" containerID="cri-o://d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c" gracePeriod=30
Jul 21 06:50:52.427912 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.427889    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:50:52.441725 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.441695    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a01de6-aaf4-4678-a87f-048ce439deb9-openshift-service-ca\") pod \"64a01de6-aaf4-4678-a87f-048ce439deb9\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") "
Jul 21 06:50:52.441875 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.441770    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8lvr\" (UniqueName: \"kubernetes.io/projected/64a01de6-aaf4-4678-a87f-048ce439deb9-kube-api-access-l8lvr\") pod \"64a01de6-aaf4-4678-a87f-048ce439deb9\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") "
Jul 21 06:50:52.441875 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.441822    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a01de6-aaf4-4678-a87f-048ce439deb9-maas-api-tls\") pod \"64a01de6-aaf4-4678-a87f-048ce439deb9\" (UID: \"64a01de6-aaf4-4678-a87f-048ce439deb9\") "
Jul 21 06:50:52.442083 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.442056    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a01de6-aaf4-4678-a87f-048ce439deb9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64a01de6-aaf4-4678-a87f-048ce439deb9" (UID: "64a01de6-aaf4-4678-a87f-048ce439deb9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:50:52.443923 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.443895    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64a01de6-aaf4-4678-a87f-048ce439deb9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64a01de6-aaf4-4678-a87f-048ce439deb9" (UID: "64a01de6-aaf4-4678-a87f-048ce439deb9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:50:52.444035 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.443923    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a01de6-aaf4-4678-a87f-048ce439deb9-kube-api-access-l8lvr" (OuterVolumeSpecName: "kube-api-access-l8lvr") pod "64a01de6-aaf4-4678-a87f-048ce439deb9" (UID: "64a01de6-aaf4-4678-a87f-048ce439deb9"). InnerVolumeSpecName "kube-api-access-l8lvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:50:52.543299 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.543263    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8lvr\" (UniqueName: \"kubernetes.io/projected/64a01de6-aaf4-4678-a87f-048ce439deb9-kube-api-access-l8lvr\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:50:52.543299 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.543295    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a01de6-aaf4-4678-a87f-048ce439deb9-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:50:52.543495 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:52.543307    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a01de6-aaf4-4678-a87f-048ce439deb9-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:50:53.056686 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.056646    2577 generic.go:356] "Generic (PLEG): container finished" podID="64a01de6-aaf4-4678-a87f-048ce439deb9" containerID="d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c" exitCode=0
Jul 21 06:50:53.056856 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.056693    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"
Jul 21 06:50:53.056856 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.056731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp" event={"ID":"64a01de6-aaf4-4678-a87f-048ce439deb9","Type":"ContainerDied","Data":"d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c"}
Jul 21 06:50:53.056856 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.056783    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp" event={"ID":"64a01de6-aaf4-4678-a87f-048ce439deb9","Type":"ContainerDied","Data":"e9aab2a8c156cc1bbf81b987c6271bdddecde08b1959157a7b12efaf12a47be0"}
Jul 21 06:50:53.056856 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.056806    2577 scope.go:117] "RemoveContainer" containerID="d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c"
Jul 21 06:50:53.066333 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.066323    2577 scope.go:117] "RemoveContainer" containerID="d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c"
Jul 21 06:50:53.066629 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:50:53.066604    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c\": container with ID starting with d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c not found: ID does not exist" containerID="d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c"
Jul 21 06:50:53.066737 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.066635    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c"} err="failed to get container status \"d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c\": rpc error: code = NotFound desc = could not find container \"d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c\": container with ID starting with d7f813b620588df13517fc4fb53c63b5d8566f74d9c6dbcf89af2448b764975c not found: ID does not exist"
Jul 21 06:50:53.077961 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.077936    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"]
Jul 21 06:50:53.082650 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.082622    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1ae2daad-b94679df7-hl6qp"]
Jul 21 06:50:53.713698 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:50:53.713667    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a01de6-aaf4-4678-a87f-048ce439deb9" path="/var/lib/kubelet/pods/64a01de6-aaf4-4678-a87f-048ce439deb9/volumes"
Jul 21 06:51:43.885227 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:51:43.885189    2577 scope.go:117] "RemoveContainer" containerID="f5afe2b1f7629de4bc524c2c83ef1d5eb1d9a83d2418a0253bfe55de971ba06f"
Jul 21 06:52:43.908286 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:43.908252    2577 scope.go:117] "RemoveContainer" containerID="7e93ae7af5940faff849f2c21a88811b59199e8e9e58ee266a1c903818a197e4"
Jul 21 06:52:44.875436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:44.875335    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:52:44.881832 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:44.879162    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:52:51.356410 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.356373    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"]
Jul 21 06:52:51.356831 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.356782    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a01de6-aaf4-4678-a87f-048ce439deb9" containerName="maas-api"
Jul 21 06:52:51.356831 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.356795    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a01de6-aaf4-4678-a87f-048ce439deb9" containerName="maas-api"
Jul 21 06:52:51.356917 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.356872    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a01de6-aaf4-4678-a87f-048ce439deb9" containerName="maas-api"
Jul 21 06:52:51.360050 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.360034    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.363116 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.363097    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-6d945c-serving-cert\""
Jul 21 06:52:51.371929 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.371904    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"]
Jul 21 06:52:51.384888 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.384860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgmqq\" (UniqueName: \"kubernetes.io/projected/a07f9c2a-02c8-442b-b559-c652244f499c-kube-api-access-tgmqq\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.385021 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.384897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.385021 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.384917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07f9c2a-02c8-442b-b559-c652244f499c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.485441 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.485406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgmqq\" (UniqueName: \"kubernetes.io/projected/a07f9c2a-02c8-442b-b559-c652244f499c-kube-api-access-tgmqq\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.485441 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.485444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.485694 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.485462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07f9c2a-02c8-442b-b559-c652244f499c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.485694 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:52:51.485581    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-serving-cert: secret "maas-api-e2e-inf-a-6d945c-serving-cert" not found
Jul 21 06:52:51.485694 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:52:51.485661    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls podName:a07f9c2a-02c8-442b-b559-c652244f499c nodeName:}" failed. No retries permitted until 2026-07-21 06:52:51.985637332 +0000 UTC m=+2108.798380983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls") pod "maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp" (UID: "a07f9c2a-02c8-442b-b559-c652244f499c") : secret "maas-api-e2e-inf-a-6d945c-serving-cert" not found
Jul 21 06:52:51.486241 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.486222    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07f9c2a-02c8-442b-b559-c652244f499c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.494855 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.494834    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgmqq\" (UniqueName: \"kubernetes.io/projected/a07f9c2a-02c8-442b-b559-c652244f499c-kube-api-access-tgmqq\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.990778 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.990737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:51.993284 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:51.993258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls\") pod \"maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:52.270416 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:52.270382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:52.408040 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:52.408009    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"]
Jul 21 06:52:52.410550 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:52:52.410507    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda07f9c2a_02c8_442b_b559_c652244f499c.slice/crio-1ef64c930a81ab8144ad72d5b9111a0e0fa21a5c506dd48d9cf280fc8ae05230 WatchSource:0}: Error finding container 1ef64c930a81ab8144ad72d5b9111a0e0fa21a5c506dd48d9cf280fc8ae05230: Status 404 returned error can't find the container with id 1ef64c930a81ab8144ad72d5b9111a0e0fa21a5c506dd48d9cf280fc8ae05230
Jul 21 06:52:52.661497 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:52.661409    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp" event={"ID":"a07f9c2a-02c8-442b-b559-c652244f499c","Type":"ContainerStarted","Data":"1ef64c930a81ab8144ad72d5b9111a0e0fa21a5c506dd48d9cf280fc8ae05230"}
Jul 21 06:52:53.667892 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:53.667851    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp" event={"ID":"a07f9c2a-02c8-442b-b559-c652244f499c","Type":"ContainerStarted","Data":"9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad"}
Jul 21 06:52:53.668364 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:53.668012    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:52:53.687919 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:53.687867    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp" podStartSLOduration=2.287077519 podStartE2EDuration="2.687852476s" totalImagesPullingTime="400.774957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:52:53.685001612 +0000 UTC m=+2110.497745281" watchObservedRunningTime="2026-07-21 06:52:53.687852476 +0000 UTC m=+2110.500596145"
Jul 21 06:52:59.409917 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.409862    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"]
Jul 21 06:52:59.414273 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.414248    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.419888 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.419860    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-11b68c-serving-cert\""
Jul 21 06:52:59.435717 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.435688    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"]
Jul 21 06:52:59.454102 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.454056    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-openshift-service-ca\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.454429 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.454109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jkt2\" (UniqueName: \"kubernetes.io/projected/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-kube-api-access-4jkt2\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.454429 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.454268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.555269 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.555226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.555481 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.555312    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-openshift-service-ca\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.555481 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.555345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jkt2\" (UniqueName: \"kubernetes.io/projected/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-kube-api-access-4jkt2\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.555481 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:52:59.555395    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-serving-cert: secret "maas-api-e2e-inf-b-11b68c-serving-cert" not found
Jul 21 06:52:59.555481 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:52:59.555469    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls podName:c6848b66-d7c8-45aa-bfc9-76280c7c4d88 nodeName:}" failed. No retries permitted until 2026-07-21 06:53:00.05544775 +0000 UTC m=+2116.868191399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls") pod "maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5" (UID: "c6848b66-d7c8-45aa-bfc9-76280c7c4d88") : secret "maas-api-e2e-inf-b-11b68c-serving-cert" not found
Jul 21 06:52:59.556045 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.556026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-openshift-service-ca\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.566599 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.566577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jkt2\" (UniqueName: \"kubernetes.io/projected/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-kube-api-access-4jkt2\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:52:59.678289 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:52:59.678211    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:53:00.059752 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:00.059719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:53:00.062522 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:00.062498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls\") pod \"maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:53:00.326344 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:00.326269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:53:00.469497 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:00.469471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"]
Jul 21 06:53:00.471806 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:53:00.471770    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6848b66_d7c8_45aa_bfc9_76280c7c4d88.slice/crio-8227931982a252f6ecb044ee00ffc02a00a9c06fb4f63253c3954505d2383f4f WatchSource:0}: Error finding container 8227931982a252f6ecb044ee00ffc02a00a9c06fb4f63253c3954505d2383f4f: Status 404 returned error can't find the container with id 8227931982a252f6ecb044ee00ffc02a00a9c06fb4f63253c3954505d2383f4f
Jul 21 06:53:00.707481 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:00.707398    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5" event={"ID":"c6848b66-d7c8-45aa-bfc9-76280c7c4d88","Type":"ContainerStarted","Data":"8227931982a252f6ecb044ee00ffc02a00a9c06fb4f63253c3954505d2383f4f"}
Jul 21 06:53:01.714436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:01.714402    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5" event={"ID":"c6848b66-d7c8-45aa-bfc9-76280c7c4d88","Type":"ContainerStarted","Data":"71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36"}
Jul 21 06:53:01.714842 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:01.714449    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:53:01.730886 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:01.730841    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5" podStartSLOduration=2.2707840409999998 podStartE2EDuration="2.73082562s" totalImagesPullingTime="460.041579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:53:01.729488325 +0000 UTC m=+2118.542231995" watchObservedRunningTime="2026-07-21 06:53:01.73082562 +0000 UTC m=+2118.543569290"
Jul 21 06:53:07.724204 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:53:07.724175    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:54:45.331813 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.331760    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"]
Jul 21 06:54:45.335369 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.335352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"
Jul 21 06:54:45.337938 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.337917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 06:54:45.346974 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.346931    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"]
Jul 21 06:54:45.395478 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.395440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0893b513-eef3-478c-b134-948bc0ac764e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk\" (UID: \"0893b513-eef3-478c-b134-948bc0ac764e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"
Jul 21 06:54:45.496103 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.496070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0893b513-eef3-478c-b134-948bc0ac764e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk\" (UID: \"0893b513-eef3-478c-b134-948bc0ac764e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"
Jul 21 06:54:45.496728 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.496704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0893b513-eef3-478c-b134-948bc0ac764e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk\" (UID: \"0893b513-eef3-478c-b134-948bc0ac764e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"
Jul 21 06:54:45.653369 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.653282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"
Jul 21 06:54:45.794253 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:45.794226    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"]
Jul 21 06:54:45.796684 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:54:45.796657    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0893b513_eef3_478c_b134_948bc0ac764e.slice/crio-e1284b06b2bc7c74eb018d28192e15082bf6848c9628b59500313b36a0979fff WatchSource:0}: Error finding container e1284b06b2bc7c74eb018d28192e15082bf6848c9628b59500313b36a0979fff: Status 404 returned error can't find the container with id e1284b06b2bc7c74eb018d28192e15082bf6848c9628b59500313b36a0979fff
Jul 21 06:54:46.223995 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:46.223897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk" event={"ID":"0893b513-eef3-478c-b134-948bc0ac764e","Type":"ContainerStarted","Data":"18f54fd052dbe1dbb8acd3d9a9099ea5bd2db10ad590dd921a3dfa2479b7f314"}
Jul 21 06:54:46.223995 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:46.223957    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk" event={"ID":"0893b513-eef3-478c-b134-948bc0ac764e","Type":"ContainerStarted","Data":"e1284b06b2bc7c74eb018d28192e15082bf6848c9628b59500313b36a0979fff"}
Jul 21 06:54:46.242064 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:46.242016    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk" podStartSLOduration=1.24200122 podStartE2EDuration="1.24200122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:54:46.241897381 +0000 UTC m=+2223.054641051" watchObservedRunningTime="2026-07-21 06:54:46.24200122 +0000 UTC m=+2223.054744912"
Jul 21 06:54:47.231200 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:47.231171    2577 generic.go:356] "Generic (PLEG): container finished" podID="0893b513-eef3-478c-b134-948bc0ac764e" containerID="18f54fd052dbe1dbb8acd3d9a9099ea5bd2db10ad590dd921a3dfa2479b7f314" exitCode=0
Jul 21 06:54:47.231609 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:47.231241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk" event={"ID":"0893b513-eef3-478c-b134-948bc0ac764e","Type":"ContainerDied","Data":"18f54fd052dbe1dbb8acd3d9a9099ea5bd2db10ad590dd921a3dfa2479b7f314"}
Jul 21 06:54:48.372864 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:48.372834    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"
Jul 21 06:54:48.522167 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:48.522126    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0893b513-eef3-478c-b134-948bc0ac764e-maas-api-service-ca\") pod \"0893b513-eef3-478c-b134-948bc0ac764e\" (UID: \"0893b513-eef3-478c-b134-948bc0ac764e\") "
Jul 21 06:54:48.522568 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:48.522515    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0893b513-eef3-478c-b134-948bc0ac764e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0893b513-eef3-478c-b134-948bc0ac764e" (UID: "0893b513-eef3-478c-b134-948bc0ac764e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:54:48.623304 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:48.623272    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0893b513-eef3-478c-b134-948bc0ac764e-maas-api-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:54:49.242339 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:49.242312    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"
Jul 21 06:54:49.242518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:49.242310    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk" event={"ID":"0893b513-eef3-478c-b134-948bc0ac764e","Type":"ContainerDied","Data":"e1284b06b2bc7c74eb018d28192e15082bf6848c9628b59500313b36a0979fff"}
Jul 21 06:54:49.242518 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:49.242430    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1284b06b2bc7c74eb018d28192e15082bf6848c9628b59500313b36a0979fff"
Jul 21 06:54:55.792166 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:55.792134    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"]
Jul 21 06:54:55.792612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:55.792335    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp" podUID="a07f9c2a-02c8-442b-b559-c652244f499c" containerName="maas-api" containerID="cri-o://9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad" gracePeriod=30
Jul 21 06:54:56.036232 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.036209    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:54:56.192506 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.192428    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls\") pod \"a07f9c2a-02c8-442b-b559-c652244f499c\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") "
Jul 21 06:54:56.192682 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.192508    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgmqq\" (UniqueName: \"kubernetes.io/projected/a07f9c2a-02c8-442b-b559-c652244f499c-kube-api-access-tgmqq\") pod \"a07f9c2a-02c8-442b-b559-c652244f499c\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") "
Jul 21 06:54:56.192682 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.192583    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07f9c2a-02c8-442b-b559-c652244f499c-openshift-service-ca\") pod \"a07f9c2a-02c8-442b-b559-c652244f499c\" (UID: \"a07f9c2a-02c8-442b-b559-c652244f499c\") "
Jul 21 06:54:56.192890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.192855    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a07f9c2a-02c8-442b-b559-c652244f499c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a07f9c2a-02c8-442b-b559-c652244f499c" (UID: "a07f9c2a-02c8-442b-b559-c652244f499c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:54:56.194796 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.194772    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a07f9c2a-02c8-442b-b559-c652244f499c" (UID: "a07f9c2a-02c8-442b-b559-c652244f499c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:54:56.194923 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.194839    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a07f9c2a-02c8-442b-b559-c652244f499c-kube-api-access-tgmqq" (OuterVolumeSpecName: "kube-api-access-tgmqq") pod "a07f9c2a-02c8-442b-b559-c652244f499c" (UID: "a07f9c2a-02c8-442b-b559-c652244f499c"). InnerVolumeSpecName "kube-api-access-tgmqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:54:56.276306 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.276275    2577 generic.go:356] "Generic (PLEG): container finished" podID="a07f9c2a-02c8-442b-b559-c652244f499c" containerID="9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad" exitCode=0
Jul 21 06:54:56.276452 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.276323    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"
Jul 21 06:54:56.276452 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.276336    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp" event={"ID":"a07f9c2a-02c8-442b-b559-c652244f499c","Type":"ContainerDied","Data":"9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad"}
Jul 21 06:54:56.276452 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.276378    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp" event={"ID":"a07f9c2a-02c8-442b-b559-c652244f499c","Type":"ContainerDied","Data":"1ef64c930a81ab8144ad72d5b9111a0e0fa21a5c506dd48d9cf280fc8ae05230"}
Jul 21 06:54:56.276452 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.276397    2577 scope.go:117] "RemoveContainer" containerID="9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad"
Jul 21 06:54:56.285769 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.285751    2577 scope.go:117] "RemoveContainer" containerID="9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad"
Jul 21 06:54:56.286003 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:54:56.285987    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad\": container with ID starting with 9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad not found: ID does not exist" containerID="9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad"
Jul 21 06:54:56.286065 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.286010    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad"} err="failed to get container status \"9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad\": rpc error: code = NotFound desc = could not find container \"9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad\": container with ID starting with 9d9b1c2205c662f845f9fd264ae58c46df14e8f88b232b4d8c6c243bd31a9fad not found: ID does not exist"
Jul 21 06:54:56.294116 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.294095    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgmqq\" (UniqueName: \"kubernetes.io/projected/a07f9c2a-02c8-442b-b559-c652244f499c-kube-api-access-tgmqq\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:54:56.294203 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.294119    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a07f9c2a-02c8-442b-b559-c652244f499c-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:54:56.294203 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.294128    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a07f9c2a-02c8-442b-b559-c652244f499c-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:54:56.298851 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.298827    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"]
Jul 21 06:54:56.304872 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:56.304853    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-6d945c-5f56c9796f-8n8dp"]
Jul 21 06:54:57.713651 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:54:57.713619    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a07f9c2a-02c8-442b-b559-c652244f499c" path="/var/lib/kubelet/pods/a07f9c2a-02c8-442b-b559-c652244f499c/volumes"
Jul 21 06:55:00.492157 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:00.492121    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"]
Jul 21 06:55:00.496896 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:00.496864    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-6d945c-5n5rk"]
Jul 21 06:55:01.713734 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:01.713704    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0893b513-eef3-478c-b134-948bc0ac764e" path="/var/lib/kubelet/pods/0893b513-eef3-478c-b134-948bc0ac764e/volumes"
Jul 21 06:55:08.204507 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.204413    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"]
Jul 21 06:55:08.205059 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.205038    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a07f9c2a-02c8-442b-b559-c652244f499c" containerName="maas-api"
Jul 21 06:55:08.205103 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.205064    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a07f9c2a-02c8-442b-b559-c652244f499c" containerName="maas-api"
Jul 21 06:55:08.205103 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.205086    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0893b513-eef3-478c-b134-948bc0ac764e" containerName="revoke-keys"
Jul 21 06:55:08.205103 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.205094    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0893b513-eef3-478c-b134-948bc0ac764e" containerName="revoke-keys"
Jul 21 06:55:08.205200 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.205181    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a07f9c2a-02c8-442b-b559-c652244f499c" containerName="maas-api"
Jul 21 06:55:08.205200 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.205194    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0893b513-eef3-478c-b134-948bc0ac764e" containerName="revoke-keys"
Jul 21 06:55:08.209805 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.209785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"
Jul 21 06:55:08.212594 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.212568    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 06:55:08.224890 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.224869    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"]
Jul 21 06:55:08.303792 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.303758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee6c911-4765-4d3a-8b13-c3431d6b9bbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp\" (UID: \"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"
Jul 21 06:55:08.405144 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.405108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee6c911-4765-4d3a-8b13-c3431d6b9bbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp\" (UID: \"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"
Jul 21 06:55:08.405786 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.405769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee6c911-4765-4d3a-8b13-c3431d6b9bbb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp\" (UID: \"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"
Jul 21 06:55:08.520338 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.520309    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"
Jul 21 06:55:08.692938 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:08.692805    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"]
Jul 21 06:55:08.695794 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:55:08.695747    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee6c911_4765_4d3a_8b13_c3431d6b9bbb.slice/crio-ce855da52567f0179e401b10efcf90c2230a0646805b6c4ed8fe795532663308 WatchSource:0}: Error finding container ce855da52567f0179e401b10efcf90c2230a0646805b6c4ed8fe795532663308: Status 404 returned error can't find the container with id ce855da52567f0179e401b10efcf90c2230a0646805b6c4ed8fe795532663308
Jul 21 06:55:09.340118 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:09.340078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp" event={"ID":"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb","Type":"ContainerStarted","Data":"2aeb75d827961cce53e0f4ddb20a603d11562a860460a638fccb6b3d9ad64fbc"}
Jul 21 06:55:09.340562 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:09.340131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp" event={"ID":"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb","Type":"ContainerStarted","Data":"ce855da52567f0179e401b10efcf90c2230a0646805b6c4ed8fe795532663308"}
Jul 21 06:55:09.366779 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:09.366730    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp" podStartSLOduration=1.3667125119999999 podStartE2EDuration="1.366712512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:55:09.364352798 +0000 UTC m=+2246.177096468" watchObservedRunningTime="2026-07-21 06:55:09.366712512 +0000 UTC m=+2246.179456181"
Jul 21 06:55:10.347076 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:10.347037    2577 generic.go:356] "Generic (PLEG): container finished" podID="6ee6c911-4765-4d3a-8b13-c3431d6b9bbb" containerID="2aeb75d827961cce53e0f4ddb20a603d11562a860460a638fccb6b3d9ad64fbc" exitCode=0
Jul 21 06:55:10.347444 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:10.347083    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp" event={"ID":"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb","Type":"ContainerDied","Data":"2aeb75d827961cce53e0f4ddb20a603d11562a860460a638fccb6b3d9ad64fbc"}
Jul 21 06:55:11.484744 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:11.484717    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"
Jul 21 06:55:11.533066 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:11.533033    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee6c911-4765-4d3a-8b13-c3431d6b9bbb-maas-api-service-ca\") pod \"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb\" (UID: \"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb\") "
Jul 21 06:55:11.533369 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:11.533345    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ee6c911-4765-4d3a-8b13-c3431d6b9bbb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6ee6c911-4765-4d3a-8b13-c3431d6b9bbb" (UID: "6ee6c911-4765-4d3a-8b13-c3431d6b9bbb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:55:11.634249 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:11.634167    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ee6c911-4765-4d3a-8b13-c3431d6b9bbb-maas-api-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:55:12.357456 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:12.357415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp" event={"ID":"6ee6c911-4765-4d3a-8b13-c3431d6b9bbb","Type":"ContainerDied","Data":"ce855da52567f0179e401b10efcf90c2230a0646805b6c4ed8fe795532663308"}
Jul 21 06:55:12.357644 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:12.357469    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce855da52567f0179e401b10efcf90c2230a0646805b6c4ed8fe795532663308"
Jul 21 06:55:12.357644 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:12.357433    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"
Jul 21 06:55:19.045562 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.045494    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"]
Jul 21 06:55:19.046132 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.045753    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5" podUID="c6848b66-d7c8-45aa-bfc9-76280c7c4d88" containerName="maas-api" containerID="cri-o://71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36" gracePeriod=30
Jul 21 06:55:19.310226 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.310151    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:55:19.396042 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.396007    2577 generic.go:356] "Generic (PLEG): container finished" podID="c6848b66-d7c8-45aa-bfc9-76280c7c4d88" containerID="71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36" exitCode=0
Jul 21 06:55:19.396209 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.396060    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"
Jul 21 06:55:19.396209 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.396097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5" event={"ID":"c6848b66-d7c8-45aa-bfc9-76280c7c4d88","Type":"ContainerDied","Data":"71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36"}
Jul 21 06:55:19.396209 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.396157    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5" event={"ID":"c6848b66-d7c8-45aa-bfc9-76280c7c4d88","Type":"ContainerDied","Data":"8227931982a252f6ecb044ee00ffc02a00a9c06fb4f63253c3954505d2383f4f"}
Jul 21 06:55:19.396209 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.396188    2577 scope.go:117] "RemoveContainer" containerID="71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36"
Jul 21 06:55:19.402702 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.401650    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-openshift-service-ca\") pod \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") "
Jul 21 06:55:19.402702 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.401694    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jkt2\" (UniqueName: \"kubernetes.io/projected/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-kube-api-access-4jkt2\") pod \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") "
Jul 21 06:55:19.402702 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.401786    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls\") pod \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\" (UID: \"c6848b66-d7c8-45aa-bfc9-76280c7c4d88\") "
Jul 21 06:55:19.402950 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.402716    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c6848b66-d7c8-45aa-bfc9-76280c7c4d88" (UID: "c6848b66-d7c8-45aa-bfc9-76280c7c4d88"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:55:19.405151 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.405125    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c6848b66-d7c8-45aa-bfc9-76280c7c4d88" (UID: "c6848b66-d7c8-45aa-bfc9-76280c7c4d88"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:55:19.405390 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.405364    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-kube-api-access-4jkt2" (OuterVolumeSpecName: "kube-api-access-4jkt2") pod "c6848b66-d7c8-45aa-bfc9-76280c7c4d88" (UID: "c6848b66-d7c8-45aa-bfc9-76280c7c4d88"). InnerVolumeSpecName "kube-api-access-4jkt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:55:19.409020 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.408935    2577 scope.go:117] "RemoveContainer" containerID="71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36"
Jul 21 06:55:19.409434 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:55:19.409395    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36\": container with ID starting with 71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36 not found: ID does not exist" containerID="71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36"
Jul 21 06:55:19.409528 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.409444    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36"} err="failed to get container status \"71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36\": rpc error: code = NotFound desc = could not find container \"71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36\": container with ID starting with 71bd9e2285e3846b8d21be0f34cac944a156c7a86c8cdd661919e9bab333cb36 not found: ID does not exist"
Jul 21 06:55:19.503126 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.503095    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:55:19.503126 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.503122    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jkt2\" (UniqueName: \"kubernetes.io/projected/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-kube-api-access-4jkt2\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:55:19.503340 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.503135    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6848b66-d7c8-45aa-bfc9-76280c7c4d88-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:55:19.728345 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.728307    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"]
Jul 21 06:55:19.737189 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:19.737161    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-11b68c-79bf64bb7d-s7tg5"]
Jul 21 06:55:21.714205 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:21.714171    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6848b66-d7c8-45aa-bfc9-76280c7c4d88" path="/var/lib/kubelet/pods/c6848b66-d7c8-45aa-bfc9-76280c7c4d88/volumes"
Jul 21 06:55:23.314270 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:23.314231    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"]
Jul 21 06:55:23.318809 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:23.318786    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-11b68c-pd4xp"]
Jul 21 06:55:23.714392 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:23.714317    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ee6c911-4765-4d3a-8b13-c3431d6b9bbb" path="/var/lib/kubelet/pods/6ee6c911-4765-4d3a-8b13-c3431d6b9bbb/volumes"
Jul 21 06:55:34.430153 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.430116    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"]
Jul 21 06:55:34.430676 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.430660    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ee6c911-4765-4d3a-8b13-c3431d6b9bbb" containerName="revoke-keys"
Jul 21 06:55:34.430732 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.430678    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ee6c911-4765-4d3a-8b13-c3431d6b9bbb" containerName="revoke-keys"
Jul 21 06:55:34.430732 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.430718    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6848b66-d7c8-45aa-bfc9-76280c7c4d88" containerName="maas-api"
Jul 21 06:55:34.430732 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.430726    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6848b66-d7c8-45aa-bfc9-76280c7c4d88" containerName="maas-api"
Jul 21 06:55:34.430887 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.430814    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ee6c911-4765-4d3a-8b13-c3431d6b9bbb" containerName="revoke-keys"
Jul 21 06:55:34.430887 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.430828    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6848b66-d7c8-45aa-bfc9-76280c7c4d88" containerName="maas-api"
Jul 21 06:55:34.435692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.435672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:34.438691 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.438670    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-915db7-serving-cert\""
Jul 21 06:55:34.448645 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.448612    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"]
Jul 21 06:55:34.535482 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.535442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzm44\" (UniqueName: \"kubernetes.io/projected/02a59273-9f62-49d0-ae93-598588a56c6d-kube-api-access-mzm44\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:34.535724 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.535506    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a59273-9f62-49d0-ae93-598588a56c6d-openshift-service-ca\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:34.535724 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.535617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:34.636778 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.636745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzm44\" (UniqueName: \"kubernetes.io/projected/02a59273-9f62-49d0-ae93-598588a56c6d-kube-api-access-mzm44\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:34.636992 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.636807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a59273-9f62-49d0-ae93-598588a56c6d-openshift-service-ca\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:34.636992 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.636846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:34.636992 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:55:34.636963    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-serving-cert: secret "maas-api-e2e-api-a-915db7-serving-cert" not found
Jul 21 06:55:34.637166 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:55:34.637023    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls podName:02a59273-9f62-49d0-ae93-598588a56c6d nodeName:}" failed. No retries permitted until 2026-07-21 06:55:35.137005931 +0000 UTC m=+2271.949749579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls") pod "maas-api-e2e-api-a-915db7-8576949579-qwhr8" (UID: "02a59273-9f62-49d0-ae93-598588a56c6d") : secret "maas-api-e2e-api-a-915db7-serving-cert" not found
Jul 21 06:55:34.637485 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.637465    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a59273-9f62-49d0-ae93-598588a56c6d-openshift-service-ca\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:34.647236 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:34.647207    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzm44\" (UniqueName: \"kubernetes.io/projected/02a59273-9f62-49d0-ae93-598588a56c6d-kube-api-access-mzm44\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:35.140846 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:35.140809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:35.143448 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:35.143415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls\") pod \"maas-api-e2e-api-a-915db7-8576949579-qwhr8\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:35.348838 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:35.348803    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:35.535067 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:35.535039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"]
Jul 21 06:55:35.536981 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:55:35.536956    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a59273_9f62_49d0_ae93_598588a56c6d.slice/crio-bfec2635b0ffa8f9162e256efe179d3a72b6aa5e8595022c8f3c268d3c4d639d WatchSource:0}: Error finding container bfec2635b0ffa8f9162e256efe179d3a72b6aa5e8595022c8f3c268d3c4d639d: Status 404 returned error can't find the container with id bfec2635b0ffa8f9162e256efe179d3a72b6aa5e8595022c8f3c268d3c4d639d
Jul 21 06:55:35.538373 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:35.538354    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 06:55:36.483360 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:36.483262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8" event={"ID":"02a59273-9f62-49d0-ae93-598588a56c6d","Type":"ContainerStarted","Data":"3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405"}
Jul 21 06:55:36.483360 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:36.483323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8" event={"ID":"02a59273-9f62-49d0-ae93-598588a56c6d","Type":"ContainerStarted","Data":"bfec2635b0ffa8f9162e256efe179d3a72b6aa5e8595022c8f3c268d3c4d639d"}
Jul 21 06:55:36.483623 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:36.483396    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:36.511465 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:36.511410    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8" podStartSLOduration=1.919164827 podStartE2EDuration="2.511395514s" totalImagesPullingTime="592.230687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:55:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:55:36.511126364 +0000 UTC m=+2273.323870033" watchObservedRunningTime="2026-07-21 06:55:36.511395514 +0000 UTC m=+2273.324139184"
Jul 21 06:55:42.494159 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:42.494121    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:55:42.864496 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:42.864459    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"]
Jul 21 06:55:42.868231 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:42.868213    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:42.880657 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:42.880633    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-c77bc7-serving-cert\""
Jul 21 06:55:42.903326 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:42.903298    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"]
Jul 21 06:55:43.012134 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.012095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26355d21-5a44-42ad-b40c-14085bd1df58-openshift-service-ca\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.012328 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.012170    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2hbl\" (UniqueName: \"kubernetes.io/projected/26355d21-5a44-42ad-b40c-14085bd1df58-kube-api-access-r2hbl\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.012328 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.012205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26355d21-5a44-42ad-b40c-14085bd1df58-maas-api-tls\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.112984 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.112949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2hbl\" (UniqueName: \"kubernetes.io/projected/26355d21-5a44-42ad-b40c-14085bd1df58-kube-api-access-r2hbl\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.113160 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.113006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26355d21-5a44-42ad-b40c-14085bd1df58-maas-api-tls\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.113160 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.113069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26355d21-5a44-42ad-b40c-14085bd1df58-openshift-service-ca\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.113759 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.113736    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26355d21-5a44-42ad-b40c-14085bd1df58-openshift-service-ca\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.115670 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.115614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26355d21-5a44-42ad-b40c-14085bd1df58-maas-api-tls\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.127071 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.127049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2hbl\" (UniqueName: \"kubernetes.io/projected/26355d21-5a44-42ad-b40c-14085bd1df58-kube-api-access-r2hbl\") pod \"maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.178270 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.178230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:43.326717 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.326677    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"]
Jul 21 06:55:43.332914 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:55:43.332887    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26355d21_5a44_42ad_b40c_14085bd1df58.slice/crio-e8642395d000936e86b08deb3cd33ae00e01be385526f501890cc7619cf59514 WatchSource:0}: Error finding container e8642395d000936e86b08deb3cd33ae00e01be385526f501890cc7619cf59514: Status 404 returned error can't find the container with id e8642395d000936e86b08deb3cd33ae00e01be385526f501890cc7619cf59514
Jul 21 06:55:43.519117 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:43.519080    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5" event={"ID":"26355d21-5a44-42ad-b40c-14085bd1df58","Type":"ContainerStarted","Data":"e8642395d000936e86b08deb3cd33ae00e01be385526f501890cc7619cf59514"}
Jul 21 06:55:44.525659 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:44.525621    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5" event={"ID":"26355d21-5a44-42ad-b40c-14085bd1df58","Type":"ContainerStarted","Data":"04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e"}
Jul 21 06:55:44.526115 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:44.525720    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:50.535303 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:50.535273    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:55:50.580090 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:50.580038    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5" podStartSLOduration=8.231689134 podStartE2EDuration="8.580023633s" totalImagesPullingTime="348.334499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:55:44.561111499 +0000 UTC m=+2281.373855171" watchObservedRunningTime="2026-07-21 06:55:50.580023633 +0000 UTC m=+2287.392767348"
Jul 21 06:55:55.478472 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.478437    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"]
Jul 21 06:55:55.482083 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.482063    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"
Jul 21 06:55:55.487888 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.487864    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 06:55:55.502262 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.502225    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"]
Jul 21 06:55:55.628958 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.628919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/816973b4-6866-4f79-aa0a-d0634883622c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-915db7-92qtc\" (UID: \"816973b4-6866-4f79-aa0a-d0634883622c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"
Jul 21 06:55:55.730265 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.730191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/816973b4-6866-4f79-aa0a-d0634883622c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-915db7-92qtc\" (UID: \"816973b4-6866-4f79-aa0a-d0634883622c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"
Jul 21 06:55:55.730871 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.730853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/816973b4-6866-4f79-aa0a-d0634883622c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-915db7-92qtc\" (UID: \"816973b4-6866-4f79-aa0a-d0634883622c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"
Jul 21 06:55:55.794302 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.794274    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"
Jul 21 06:55:55.946276 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:55.946245    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"]
Jul 21 06:55:55.949866 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:55:55.949837    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816973b4_6866_4f79_aa0a_d0634883622c.slice/crio-b2db78ccede70a41ac0087f2f8944dd8f35cbff572fce0fc597ed8f70d21c62b WatchSource:0}: Error finding container b2db78ccede70a41ac0087f2f8944dd8f35cbff572fce0fc597ed8f70d21c62b: Status 404 returned error can't find the container with id b2db78ccede70a41ac0087f2f8944dd8f35cbff572fce0fc597ed8f70d21c62b
Jul 21 06:55:56.587135 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:56.587037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc" event={"ID":"816973b4-6866-4f79-aa0a-d0634883622c","Type":"ContainerStarted","Data":"715180de724a30103d13e1ef9714c0f43e019d0901c80a280e931f3bbea3d176"}
Jul 21 06:55:56.587135 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:56.587091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc" event={"ID":"816973b4-6866-4f79-aa0a-d0634883622c","Type":"ContainerStarted","Data":"b2db78ccede70a41ac0087f2f8944dd8f35cbff572fce0fc597ed8f70d21c62b"}
Jul 21 06:55:56.608225 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:56.608176    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc" podStartSLOduration=1.608160757 podStartE2EDuration="1.608160757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:55:56.606456658 +0000 UTC m=+2293.419200339" watchObservedRunningTime="2026-07-21 06:55:56.608160757 +0000 UTC m=+2293.420904429"
Jul 21 06:55:57.593554 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:57.593500    2577 generic.go:356] "Generic (PLEG): container finished" podID="816973b4-6866-4f79-aa0a-d0634883622c" containerID="715180de724a30103d13e1ef9714c0f43e019d0901c80a280e931f3bbea3d176" exitCode=0
Jul 21 06:55:57.593927 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:57.593590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc" event={"ID":"816973b4-6866-4f79-aa0a-d0634883622c","Type":"ContainerDied","Data":"715180de724a30103d13e1ef9714c0f43e019d0901c80a280e931f3bbea3d176"}
Jul 21 06:55:58.732715 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:58.732682    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"
Jul 21 06:55:58.861516 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:58.861419    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/816973b4-6866-4f79-aa0a-d0634883622c-maas-api-service-ca\") pod \"816973b4-6866-4f79-aa0a-d0634883622c\" (UID: \"816973b4-6866-4f79-aa0a-d0634883622c\") "
Jul 21 06:55:58.861856 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:58.861834    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/816973b4-6866-4f79-aa0a-d0634883622c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "816973b4-6866-4f79-aa0a-d0634883622c" (UID: "816973b4-6866-4f79-aa0a-d0634883622c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:55:58.962423 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:58.962388    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/816973b4-6866-4f79-aa0a-d0634883622c-maas-api-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:55:59.604724 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:59.604697    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"
Jul 21 06:55:59.604906 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:59.604692    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc" event={"ID":"816973b4-6866-4f79-aa0a-d0634883622c","Type":"ContainerDied","Data":"b2db78ccede70a41ac0087f2f8944dd8f35cbff572fce0fc597ed8f70d21c62b"}
Jul 21 06:55:59.604906 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:55:59.604816    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2db78ccede70a41ac0087f2f8944dd8f35cbff572fce0fc597ed8f70d21c62b"
Jul 21 06:56:10.660691 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.660659    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"]
Jul 21 06:56:10.661164 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.660866    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8" podUID="02a59273-9f62-49d0-ae93-598588a56c6d" containerName="maas-api" containerID="cri-o://3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405" gracePeriod=30
Jul 21 06:56:10.911242 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.911182    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:56:10.968797 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.968771    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzm44\" (UniqueName: \"kubernetes.io/projected/02a59273-9f62-49d0-ae93-598588a56c6d-kube-api-access-mzm44\") pod \"02a59273-9f62-49d0-ae93-598588a56c6d\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") "
Jul 21 06:56:10.968965 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.968817    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a59273-9f62-49d0-ae93-598588a56c6d-openshift-service-ca\") pod \"02a59273-9f62-49d0-ae93-598588a56c6d\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") "
Jul 21 06:56:10.968965 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.968921    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls\") pod \"02a59273-9f62-49d0-ae93-598588a56c6d\" (UID: \"02a59273-9f62-49d0-ae93-598588a56c6d\") "
Jul 21 06:56:10.969199 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.969174    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a59273-9f62-49d0-ae93-598588a56c6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02a59273-9f62-49d0-ae93-598588a56c6d" (UID: "02a59273-9f62-49d0-ae93-598588a56c6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:56:10.969357 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.969340    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a59273-9f62-49d0-ae93-598588a56c6d-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:56:10.971213 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.971180    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02a59273-9f62-49d0-ae93-598588a56c6d" (UID: "02a59273-9f62-49d0-ae93-598588a56c6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:56:10.971310 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:10.971247    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02a59273-9f62-49d0-ae93-598588a56c6d-kube-api-access-mzm44" (OuterVolumeSpecName: "kube-api-access-mzm44") pod "02a59273-9f62-49d0-ae93-598588a56c6d" (UID: "02a59273-9f62-49d0-ae93-598588a56c6d"). InnerVolumeSpecName "kube-api-access-mzm44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:56:11.070209 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.070173    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02a59273-9f62-49d0-ae93-598588a56c6d-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:56:11.070209 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.070201    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzm44\" (UniqueName: \"kubernetes.io/projected/02a59273-9f62-49d0-ae93-598588a56c6d-kube-api-access-mzm44\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:56:11.669137 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.669105    2577 generic.go:356] "Generic (PLEG): container finished" podID="02a59273-9f62-49d0-ae93-598588a56c6d" containerID="3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405" exitCode=0
Jul 21 06:56:11.669137 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.669141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8" event={"ID":"02a59273-9f62-49d0-ae93-598588a56c6d","Type":"ContainerDied","Data":"3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405"}
Jul 21 06:56:11.669709 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.669151    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"
Jul 21 06:56:11.669709 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.669194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8" event={"ID":"02a59273-9f62-49d0-ae93-598588a56c6d","Type":"ContainerDied","Data":"bfec2635b0ffa8f9162e256efe179d3a72b6aa5e8595022c8f3c268d3c4d639d"}
Jul 21 06:56:11.669709 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.669215    2577 scope.go:117] "RemoveContainer" containerID="3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405"
Jul 21 06:56:11.678499 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.678480    2577 scope.go:117] "RemoveContainer" containerID="3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405"
Jul 21 06:56:11.678790 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:56:11.678772    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405\": container with ID starting with 3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405 not found: ID does not exist" containerID="3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405"
Jul 21 06:56:11.678859 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.678798    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405"} err="failed to get container status \"3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405\": rpc error: code = NotFound desc = could not find container \"3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405\": container with ID starting with 3c262e99a707dd096f4609a855a1b7ec380841bec54a3ca3282c00420ff9b405 not found: ID does not exist"
Jul 21 06:56:11.693246 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.693218    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"]
Jul 21 06:56:11.697283 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.697263    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-915db7-8576949579-qwhr8"]
Jul 21 06:56:11.721280 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:11.721248    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a59273-9f62-49d0-ae93-598588a56c6d" path="/var/lib/kubelet/pods/02a59273-9f62-49d0-ae93-598588a56c6d/volumes"
Jul 21 06:56:15.581741 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:15.581710    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"]
Jul 21 06:56:15.584547 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:15.584506    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-915db7-92qtc"]
Jul 21 06:56:15.713721 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:15.713687    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816973b4-6866-4f79-aa0a-d0634883622c" path="/var/lib/kubelet/pods/816973b4-6866-4f79-aa0a-d0634883622c/volumes"
Jul 21 06:56:23.198113 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.198064    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"]
Jul 21 06:56:23.198638 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.198592    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a59273-9f62-49d0-ae93-598588a56c6d" containerName="maas-api"
Jul 21 06:56:23.198638 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.198607    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a59273-9f62-49d0-ae93-598588a56c6d" containerName="maas-api"
Jul 21 06:56:23.198638 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.198615    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816973b4-6866-4f79-aa0a-d0634883622c" containerName="revoke-keys"
Jul 21 06:56:23.198638 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.198620    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="816973b4-6866-4f79-aa0a-d0634883622c" containerName="revoke-keys"
Jul 21 06:56:23.198782 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.198690    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a59273-9f62-49d0-ae93-598588a56c6d" containerName="maas-api"
Jul 21 06:56:23.198782 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.198699    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="816973b4-6866-4f79-aa0a-d0634883622c" containerName="revoke-keys"
Jul 21 06:56:23.204259 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.204220    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"
Jul 21 06:56:23.207626 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.207602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 06:56:23.210680 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.210623    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"]
Jul 21 06:56:23.273014 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.272980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59447d9f-a642-462f-8b74-03473a6325b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq\" (UID: \"59447d9f-a642-462f-8b74-03473a6325b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"
Jul 21 06:56:23.373964 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.373930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59447d9f-a642-462f-8b74-03473a6325b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq\" (UID: \"59447d9f-a642-462f-8b74-03473a6325b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"
Jul 21 06:56:23.374595 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.374577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59447d9f-a642-462f-8b74-03473a6325b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq\" (UID: \"59447d9f-a642-462f-8b74-03473a6325b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"
Jul 21 06:56:23.518304 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.518279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"
Jul 21 06:56:23.662002 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.661974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"]
Jul 21 06:56:23.663636 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:56:23.663607    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59447d9f_a642_462f_8b74_03473a6325b3.slice/crio-c616cdc4c6f78f1ecf83556bfa91fe70c22fba6dbef08e934641acd7bd083dac WatchSource:0}: Error finding container c616cdc4c6f78f1ecf83556bfa91fe70c22fba6dbef08e934641acd7bd083dac: Status 404 returned error can't find the container with id c616cdc4c6f78f1ecf83556bfa91fe70c22fba6dbef08e934641acd7bd083dac
Jul 21 06:56:23.732077 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:23.732044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq" event={"ID":"59447d9f-a642-462f-8b74-03473a6325b3","Type":"ContainerStarted","Data":"c616cdc4c6f78f1ecf83556bfa91fe70c22fba6dbef08e934641acd7bd083dac"}
Jul 21 06:56:24.738033 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:24.737948    2577 generic.go:356] "Generic (PLEG): container finished" podID="59447d9f-a642-462f-8b74-03473a6325b3" containerID="8f2f60377fd96e216f51db4ee783a424cd7a990b273e9f0bc8f78e835521e3ca" exitCode=0
Jul 21 06:56:24.738390 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:24.738034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq" event={"ID":"59447d9f-a642-462f-8b74-03473a6325b3","Type":"ContainerDied","Data":"8f2f60377fd96e216f51db4ee783a424cd7a990b273e9f0bc8f78e835521e3ca"}
Jul 21 06:56:25.881621 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:25.881597    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"
Jul 21 06:56:26.000612 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:26.000502    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59447d9f-a642-462f-8b74-03473a6325b3-maas-api-service-ca\") pod \"59447d9f-a642-462f-8b74-03473a6325b3\" (UID: \"59447d9f-a642-462f-8b74-03473a6325b3\") "
Jul 21 06:56:26.000852 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:26.000829    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59447d9f-a642-462f-8b74-03473a6325b3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59447d9f-a642-462f-8b74-03473a6325b3" (UID: "59447d9f-a642-462f-8b74-03473a6325b3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:56:26.101886 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:26.101852    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59447d9f-a642-462f-8b74-03473a6325b3-maas-api-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:56:26.748983 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:26.748944    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq" event={"ID":"59447d9f-a642-462f-8b74-03473a6325b3","Type":"ContainerDied","Data":"c616cdc4c6f78f1ecf83556bfa91fe70c22fba6dbef08e934641acd7bd083dac"}
Jul 21 06:56:26.749189 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:26.748999    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c616cdc4c6f78f1ecf83556bfa91fe70c22fba6dbef08e934641acd7bd083dac"
Jul 21 06:56:26.749189 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:26.748954    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"
Jul 21 06:56:38.740785 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:38.740711    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"]
Jul 21 06:56:38.741163 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:38.740967    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5" podUID="26355d21-5a44-42ad-b40c-14085bd1df58" containerName="maas-api" containerID="cri-o://04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e" gracePeriod=30
Jul 21 06:56:39.013177 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.013142    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:56:39.118261 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.118217    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26355d21-5a44-42ad-b40c-14085bd1df58-openshift-service-ca\") pod \"26355d21-5a44-42ad-b40c-14085bd1df58\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") "
Jul 21 06:56:39.118436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.118273    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26355d21-5a44-42ad-b40c-14085bd1df58-maas-api-tls\") pod \"26355d21-5a44-42ad-b40c-14085bd1df58\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") "
Jul 21 06:56:39.118436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.118328    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2hbl\" (UniqueName: \"kubernetes.io/projected/26355d21-5a44-42ad-b40c-14085bd1df58-kube-api-access-r2hbl\") pod \"26355d21-5a44-42ad-b40c-14085bd1df58\" (UID: \"26355d21-5a44-42ad-b40c-14085bd1df58\") "
Jul 21 06:56:39.118692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.118669    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26355d21-5a44-42ad-b40c-14085bd1df58-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26355d21-5a44-42ad-b40c-14085bd1df58" (UID: "26355d21-5a44-42ad-b40c-14085bd1df58"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 06:56:39.120577 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.120555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26355d21-5a44-42ad-b40c-14085bd1df58-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26355d21-5a44-42ad-b40c-14085bd1df58" (UID: "26355d21-5a44-42ad-b40c-14085bd1df58"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 06:56:39.120800 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.120779    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26355d21-5a44-42ad-b40c-14085bd1df58-kube-api-access-r2hbl" (OuterVolumeSpecName: "kube-api-access-r2hbl") pod "26355d21-5a44-42ad-b40c-14085bd1df58" (UID: "26355d21-5a44-42ad-b40c-14085bd1df58"). InnerVolumeSpecName "kube-api-access-r2hbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 06:56:39.219389 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.219358    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26355d21-5a44-42ad-b40c-14085bd1df58-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:56:39.219389 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.219384    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26355d21-5a44-42ad-b40c-14085bd1df58-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:56:39.219389 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.219395    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2hbl\" (UniqueName: \"kubernetes.io/projected/26355d21-5a44-42ad-b40c-14085bd1df58-kube-api-access-r2hbl\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 06:56:39.825855 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.825818    2577 generic.go:356] "Generic (PLEG): container finished" podID="26355d21-5a44-42ad-b40c-14085bd1df58" containerID="04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e" exitCode=0
Jul 21 06:56:39.826354 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.825867    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"
Jul 21 06:56:39.826354 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.825905    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5" event={"ID":"26355d21-5a44-42ad-b40c-14085bd1df58","Type":"ContainerDied","Data":"04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e"}
Jul 21 06:56:39.826354 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.825976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5" event={"ID":"26355d21-5a44-42ad-b40c-14085bd1df58","Type":"ContainerDied","Data":"e8642395d000936e86b08deb3cd33ae00e01be385526f501890cc7619cf59514"}
Jul 21 06:56:39.826354 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.826013    2577 scope.go:117] "RemoveContainer" containerID="04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e"
Jul 21 06:56:39.834901 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.834878    2577 scope.go:117] "RemoveContainer" containerID="04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e"
Jul 21 06:56:39.835150 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:56:39.835131    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e\": container with ID starting with 04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e not found: ID does not exist" containerID="04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e"
Jul 21 06:56:39.835206 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.835163    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e"} err="failed to get container status \"04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e\": rpc error: code = NotFound desc = could not find container \"04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e\": container with ID starting with 04f7b6d1b0b4fbe50b9bd169937b3b88b5661fe831a874ad1f744e178c79000e not found: ID does not exist"
Jul 21 06:56:39.845970 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.845946    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"]
Jul 21 06:56:39.850552 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:39.850511    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c77bc7-6bbd57b7c-78rp5"]
Jul 21 06:56:41.714399 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:41.714362    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26355d21-5a44-42ad-b40c-14085bd1df58" path="/var/lib/kubelet/pods/26355d21-5a44-42ad-b40c-14085bd1df58/volumes"
Jul 21 06:56:43.315570 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:43.315519    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"]
Jul 21 06:56:43.322214 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:43.322184    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-c77bc7-tr4vq"]
Jul 21 06:56:43.714094 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:43.714011    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59447d9f-a642-462f-8b74-03473a6325b3" path="/var/lib/kubelet/pods/59447d9f-a642-462f-8b74-03473a6325b3/volumes"
Jul 21 06:56:55.098945 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.098906    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"]
Jul 21 06:56:55.099404 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.099325    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59447d9f-a642-462f-8b74-03473a6325b3" containerName="revoke-keys"
Jul 21 06:56:55.099404 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.099337    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="59447d9f-a642-462f-8b74-03473a6325b3" containerName="revoke-keys"
Jul 21 06:56:55.099404 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.099346    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26355d21-5a44-42ad-b40c-14085bd1df58" containerName="maas-api"
Jul 21 06:56:55.099404 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.099352    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="26355d21-5a44-42ad-b40c-14085bd1df58" containerName="maas-api"
Jul 21 06:56:55.099574 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.099413    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="26355d21-5a44-42ad-b40c-14085bd1df58" containerName="maas-api"
Jul 21 06:56:55.099574 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.099421    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="59447d9f-a642-462f-8b74-03473a6325b3" containerName="revoke-keys"
Jul 21 06:56:55.102740 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.102716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.105667 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.105646    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-08eb3e-serving-cert\""
Jul 21 06:56:55.126504 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.126479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"]
Jul 21 06:56:55.165692 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.165661    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxqnp\" (UniqueName: \"kubernetes.io/projected/8555e38d-4da1-4d21-b938-c23fd0445501-kube-api-access-zxqnp\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.165839 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.165743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8555e38d-4da1-4d21-b938-c23fd0445501-openshift-service-ca\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.165839 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.165775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.266350 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.266319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8555e38d-4da1-4d21-b938-c23fd0445501-openshift-service-ca\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.266591 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.266364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.266591 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.266406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxqnp\" (UniqueName: \"kubernetes.io/projected/8555e38d-4da1-4d21-b938-c23fd0445501-kube-api-access-zxqnp\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.266591 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:56:55.266569    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-serving-cert: secret "maas-api-e2e-shared-a-08eb3e-serving-cert" not found
Jul 21 06:56:55.266772 ip-10-0-128-56 kubenswrapper[2577]: E0721 06:56:55.266642    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls podName:8555e38d-4da1-4d21-b938-c23fd0445501 nodeName:}" failed. No retries permitted until 2026-07-21 06:56:55.766620125 +0000 UTC m=+2352.579363791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls") pod "maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr" (UID: "8555e38d-4da1-4d21-b938-c23fd0445501") : secret "maas-api-e2e-shared-a-08eb3e-serving-cert" not found
Jul 21 06:56:55.267069 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.267049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8555e38d-4da1-4d21-b938-c23fd0445501-openshift-service-ca\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.281625 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.281601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxqnp\" (UniqueName: \"kubernetes.io/projected/8555e38d-4da1-4d21-b938-c23fd0445501-kube-api-access-zxqnp\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.771448 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.771415    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:55.774103 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:55.774078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls\") pod \"maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:56.013202 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:56.013172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:56.161870 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:56.161841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"]
Jul 21 06:56:56.163721 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:56:56.163691    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8555e38d_4da1_4d21_b938_c23fd0445501.slice/crio-a6327517d9ab0913691b22242eb98167ec9c38c3384e40206b42dd81fce79a42 WatchSource:0}: Error finding container a6327517d9ab0913691b22242eb98167ec9c38c3384e40206b42dd81fce79a42: Status 404 returned error can't find the container with id a6327517d9ab0913691b22242eb98167ec9c38c3384e40206b42dd81fce79a42
Jul 21 06:56:56.919562 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:56.919503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr" event={"ID":"8555e38d-4da1-4d21-b938-c23fd0445501","Type":"ContainerStarted","Data":"13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e"}
Jul 21 06:56:56.919774 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:56.919570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr" event={"ID":"8555e38d-4da1-4d21-b938-c23fd0445501","Type":"ContainerStarted","Data":"a6327517d9ab0913691b22242eb98167ec9c38c3384e40206b42dd81fce79a42"}
Jul 21 06:56:56.919774 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:56.919592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:56:56.945368 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:56:56.945315    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr" podStartSLOduration=1.607435367 podStartE2EDuration="1.945300248s" totalImagesPullingTime="337.864881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:56:56.944260958 +0000 UTC m=+2353.757004639" watchObservedRunningTime="2026-07-21 06:56:56.945300248 +0000 UTC m=+2353.758043918"
Jul 21 06:57:02.929719 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:02.929693    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 06:57:03.047381 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.047349    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"]
Jul 21 06:57:03.051867 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.051843    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.054844 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.054822    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-bddf64-serving-cert\""
Jul 21 06:57:03.138584 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.138548    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"]
Jul 21 06:57:03.142526 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.142490    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4fdcff-9324-44b5-84dd-991c28905625-maas-api-tls\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.142736 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.142637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4fdcff-9324-44b5-84dd-991c28905625-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.142736 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.142682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqw26\" (UniqueName: \"kubernetes.io/projected/ae4fdcff-9324-44b5-84dd-991c28905625-kube-api-access-fqw26\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.243436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.243354    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4fdcff-9324-44b5-84dd-991c28905625-maas-api-tls\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.243436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.243397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4fdcff-9324-44b5-84dd-991c28905625-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.243436 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.243421    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqw26\" (UniqueName: \"kubernetes.io/projected/ae4fdcff-9324-44b5-84dd-991c28905625-kube-api-access-fqw26\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.244088 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.244066    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4fdcff-9324-44b5-84dd-991c28905625-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.246038 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.246006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4fdcff-9324-44b5-84dd-991c28905625-maas-api-tls\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.267005 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.266976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqw26\" (UniqueName: \"kubernetes.io/projected/ae4fdcff-9324-44b5-84dd-991c28905625-kube-api-access-fqw26\") pod \"maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.363050 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.363024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.502182 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.502086    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"]
Jul 21 06:57:03.505081 ip-10-0-128-56 kubenswrapper[2577]: W0721 06:57:03.505045    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4fdcff_9324_44b5_84dd_991c28905625.slice/crio-7a77b1f47af80295b43eb12284793dc93221c3dee27976a1524024601a06ba0c WatchSource:0}: Error finding container 7a77b1f47af80295b43eb12284793dc93221c3dee27976a1524024601a06ba0c: Status 404 returned error can't find the container with id 7a77b1f47af80295b43eb12284793dc93221c3dee27976a1524024601a06ba0c
Jul 21 06:57:03.956953 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.956916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s" event={"ID":"ae4fdcff-9324-44b5-84dd-991c28905625","Type":"ContainerStarted","Data":"e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734"}
Jul 21 06:57:03.957363 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.956976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s" event={"ID":"ae4fdcff-9324-44b5-84dd-991c28905625","Type":"ContainerStarted","Data":"7a77b1f47af80295b43eb12284793dc93221c3dee27976a1524024601a06ba0c"}
Jul 21 06:57:03.957363 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.957054    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:03.980250 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:03.980200    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s" podStartSLOduration=0.636238255 podStartE2EDuration="980.182527ms" totalImagesPullingTime="343.944272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 06:57:03.977828844 +0000 UTC m=+2360.790572514" watchObservedRunningTime="2026-07-21 06:57:03.980182527 +0000 UTC m=+2360.792926199"
Jul 21 06:57:09.967751 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:09.967726    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 06:57:44.907124 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:44.907018    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:57:44.912255 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:57:44.912233    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rg9sr_3f9a35c0-171f-424d-8492-501cb9217aa1/ovn-acl-logging/0.log"
Jul 21 06:59:59.604361 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.604284    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"]
Jul 21 06:59:59.607993 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.607977    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.611850 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.611812    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-08eb3e\"/\"kube-root-ca.crt\""
Jul 21 06:59:59.611850 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.611838    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-08eb3e\"/\"openshift-service-ca.crt\""
Jul 21 06:59:59.611850 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.611823    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-08eb3e\"/\"default-dockercfg-z9xv6\""
Jul 21 06:59:59.612089 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.611859    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-08eb3e\"/\"sub-test-model-08eb3e-kserve-self-signed-certs\""
Jul 21 06:59:59.619850 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.619823    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"]
Jul 21 06:59:59.666001 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.665971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-home\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.666170 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.666029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tls-certs\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.666170 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.666101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tmp-dir\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.666253 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.666178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-dshm\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.666253 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.666224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-model-cache\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.666318 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.666260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdttw\" (UniqueName: \"kubernetes.io/projected/7054face-6b3c-419a-a2d8-2bfef79eb7cd-kube-api-access-kdttw\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.767749 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.767716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-dshm\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.767920 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.767758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-model-cache\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.767920 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.767789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdttw\" (UniqueName: \"kubernetes.io/projected/7054face-6b3c-419a-a2d8-2bfef79eb7cd-kube-api-access-kdttw\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.767920 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.767830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-home\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.767920 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.767892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tls-certs\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.768086 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.767930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tmp-dir\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.768223 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.768201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-model-cache\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.768265 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.768213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-home\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.768330 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.768308    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tmp-dir\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.770191 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.770164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-dshm\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.770509 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.770490    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tls-certs\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.777095 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.777074    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdttw\" (UniqueName: \"kubernetes.io/projected/7054face-6b3c-419a-a2d8-2bfef79eb7cd-kube-api-access-kdttw\") pod \"sub-test-model-08eb3e-kserve-5546db8dd9-drtr8\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") " pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 06:59:59.917910 ip-10-0-128-56 kubenswrapper[2577]: I0721 06:59:59.917825    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 07:00:00.059487 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.059463    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"]
Jul 21 07:00:00.061842 ip-10-0-128-56 kubenswrapper[2577]: W0721 07:00:00.061811    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7054face_6b3c_419a_a2d8_2bfef79eb7cd.slice/crio-5ec500bdfa6c2e469c2be913b41568ef577c4d249b48ce3e0ca7b811dc923bd2 WatchSource:0}: Error finding container 5ec500bdfa6c2e469c2be913b41568ef577c4d249b48ce3e0ca7b811dc923bd2: Status 404 returned error can't find the container with id 5ec500bdfa6c2e469c2be913b41568ef577c4d249b48ce3e0ca7b811dc923bd2
Jul 21 07:00:00.193799 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.193723    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"]
Jul 21 07:00:00.197296 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.197280    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"
Jul 21 07:00:00.201042 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.201013    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 07:00:00.203424 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.203361    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98"]
Jul 21 07:00:00.206775 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.206757    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"]
Jul 21 07:00:00.206876 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.206860    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98"
Jul 21 07:00:00.210225 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.208051    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"
Jul 21 07:00:00.213655 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.212437    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"
Jul 21 07:00:00.225783 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.225755    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98"
Jul 21 07:00:00.233037 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.232994    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98"]
Jul 21 07:00:00.237302 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.236896    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"]
Jul 21 07:00:00.237302 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.236940    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"
Jul 21 07:00:00.267014 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.266956    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"]
Jul 21 07:00:00.412062 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.412031    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"]
Jul 21 07:00:00.414133 ip-10-0-128-56 kubenswrapper[2577]: W0721 07:00:00.414090    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a70485_7fe7_470f_824f_391780a16012.slice/crio-922d2c1b6bd3bc5155280a84d07b8dc9e5cb9db96bbcad56bcb6a9f788495d90 WatchSource:0}: Error finding container 922d2c1b6bd3bc5155280a84d07b8dc9e5cb9db96bbcad56bcb6a9f788495d90: Status 404 returned error can't find the container with id 922d2c1b6bd3bc5155280a84d07b8dc9e5cb9db96bbcad56bcb6a9f788495d90
Jul 21 07:00:00.423612 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.423587    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98"]
Jul 21 07:00:00.430139 ip-10-0-128-56 kubenswrapper[2577]: W0721 07:00:00.430098    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1acf1a_56ab_4875_b6e0_db7161b1f7f5.slice/crio-0bc892198bfca76c1cd34f3fbe52ea1e31222717315b2d196d9a88c66474d3b7 WatchSource:0}: Error finding container 0bc892198bfca76c1cd34f3fbe52ea1e31222717315b2d196d9a88c66474d3b7: Status 404 returned error can't find the container with id 0bc892198bfca76c1cd34f3fbe52ea1e31222717315b2d196d9a88c66474d3b7
Jul 21 07:00:00.440556 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.440497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"]
Jul 21 07:00:00.450896 ip-10-0-128-56 kubenswrapper[2577]: W0721 07:00:00.450873    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71936f57_90b8_4383_b5be_4cbb0b3150c7.slice/crio-e02a4c324131f2428a0fee45bcc15730f91de419e47e61f7aa730eca854e417c WatchSource:0}: Error finding container e02a4c324131f2428a0fee45bcc15730f91de419e47e61f7aa730eca854e417c: Status 404 returned error can't find the container with id e02a4c324131f2428a0fee45bcc15730f91de419e47e61f7aa730eca854e417c
Jul 21 07:00:00.853711 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.853675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8" event={"ID":"7054face-6b3c-419a-a2d8-2bfef79eb7cd","Type":"ContainerStarted","Data":"4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026"}
Jul 21 07:00:00.854139 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.853719    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8" event={"ID":"7054face-6b3c-419a-a2d8-2bfef79eb7cd","Type":"ContainerStarted","Data":"5ec500bdfa6c2e469c2be913b41568ef577c4d249b48ce3e0ca7b811dc923bd2"}
Jul 21 07:00:00.855314 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.855289    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98" event={"ID":"4a1acf1a-56ab-4875-b6e0-db7161b1f7f5","Type":"ContainerStarted","Data":"bba98957ab98bc54b45faa3420a31875bcd734cb2a79a762d372ddd2206bdea5"}
Jul 21 07:00:00.855442 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.855340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98" event={"ID":"4a1acf1a-56ab-4875-b6e0-db7161b1f7f5","Type":"ContainerStarted","Data":"0bc892198bfca76c1cd34f3fbe52ea1e31222717315b2d196d9a88c66474d3b7"}
Jul 21 07:00:00.856746 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.856704    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb" event={"ID":"71936f57-90b8-4383-b5be-4cbb0b3150c7","Type":"ContainerStarted","Data":"55a5e667be12732f3acaee4af281e735dec33e6369e95b8b33e1fe600da5cfd3"}
Jul 21 07:00:00.856837 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.856759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb" event={"ID":"71936f57-90b8-4383-b5be-4cbb0b3150c7","Type":"ContainerStarted","Data":"e02a4c324131f2428a0fee45bcc15730f91de419e47e61f7aa730eca854e417c"}
Jul 21 07:00:00.858235 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.858213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb" event={"ID":"f7a70485-7fe7-470f-824f-391780a16012","Type":"ContainerStarted","Data":"eba182746ce7389c0c552055b2e1c694d9241593b052a462ebfd4ad5f669239d"}
Jul 21 07:00:00.858327 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.858257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb" event={"ID":"f7a70485-7fe7-470f-824f-391780a16012","Type":"ContainerStarted","Data":"922d2c1b6bd3bc5155280a84d07b8dc9e5cb9db96bbcad56bcb6a9f788495d90"}
Jul 21 07:00:00.873751 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.873702    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8" podStartSLOduration=1.8736856560000001 podStartE2EDuration="1.873685656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 06:59:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:00:00.872484602 +0000 UTC m=+2537.685228276" watchObservedRunningTime="2026-07-21 07:00:00.873685656 +0000 UTC m=+2537.686429326"
Jul 21 07:00:00.888164 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.888123    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98" podStartSLOduration=0.888110358 podStartE2EDuration="888.110358ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:00:00.885703727 +0000 UTC m=+2537.698447400" watchObservedRunningTime="2026-07-21 07:00:00.888110358 +0000 UTC m=+2537.700854059"
Jul 21 07:00:00.900722 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.900682    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb" podStartSLOduration=0.900670426 podStartE2EDuration="900.670426ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:00:00.899882613 +0000 UTC m=+2537.712626286" watchObservedRunningTime="2026-07-21 07:00:00.900670426 +0000 UTC m=+2537.713414143"
Jul 21 07:00:00.915153 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:00.915116    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb" podStartSLOduration=0.915104818 podStartE2EDuration="915.104818ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 07:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:00:00.913390698 +0000 UTC m=+2537.726134381" watchObservedRunningTime="2026-07-21 07:00:00.915104818 +0000 UTC m=+2537.727848522"
Jul 21 07:00:01.864781 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:01.864749    2577 generic.go:356] "Generic (PLEG): container finished" podID="71936f57-90b8-4383-b5be-4cbb0b3150c7" containerID="55a5e667be12732f3acaee4af281e735dec33e6369e95b8b33e1fe600da5cfd3" exitCode=0
Jul 21 07:00:01.865221 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:01.864825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb" event={"ID":"71936f57-90b8-4383-b5be-4cbb0b3150c7","Type":"ContainerDied","Data":"55a5e667be12732f3acaee4af281e735dec33e6369e95b8b33e1fe600da5cfd3"}
Jul 21 07:00:01.866339 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:01.866316    2577 generic.go:356] "Generic (PLEG): container finished" podID="f7a70485-7fe7-470f-824f-391780a16012" containerID="eba182746ce7389c0c552055b2e1c694d9241593b052a462ebfd4ad5f669239d" exitCode=0
Jul 21 07:00:01.866462 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:01.866391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb" event={"ID":"f7a70485-7fe7-470f-824f-391780a16012","Type":"ContainerDied","Data":"eba182746ce7389c0c552055b2e1c694d9241593b052a462ebfd4ad5f669239d"}
Jul 21 07:00:01.867993 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:01.867972    2577 generic.go:356] "Generic (PLEG): container finished" podID="4a1acf1a-56ab-4875-b6e0-db7161b1f7f5" containerID="bba98957ab98bc54b45faa3420a31875bcd734cb2a79a762d372ddd2206bdea5" exitCode=0
Jul 21 07:00:01.868091 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:01.868054    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98" event={"ID":"4a1acf1a-56ab-4875-b6e0-db7161b1f7f5","Type":"ContainerDied","Data":"bba98957ab98bc54b45faa3420a31875bcd734cb2a79a762d372ddd2206bdea5"}
Jul 21 07:00:03.064003 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.063966    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"
Jul 21 07:00:03.067288 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.067263    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98"
Jul 21 07:00:03.070479 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.070459    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"
Jul 21 07:00:03.878858 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.878825    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"
Jul 21 07:00:03.879048 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.878825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb" event={"ID":"71936f57-90b8-4383-b5be-4cbb0b3150c7","Type":"ContainerDied","Data":"e02a4c324131f2428a0fee45bcc15730f91de419e47e61f7aa730eca854e417c"}
Jul 21 07:00:03.879048 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.878971    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e02a4c324131f2428a0fee45bcc15730f91de419e47e61f7aa730eca854e417c"
Jul 21 07:00:03.880151 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.880121    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"
Jul 21 07:00:03.880305 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.880145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb" event={"ID":"f7a70485-7fe7-470f-824f-391780a16012","Type":"ContainerDied","Data":"922d2c1b6bd3bc5155280a84d07b8dc9e5cb9db96bbcad56bcb6a9f788495d90"}
Jul 21 07:00:03.880305 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.880185    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="922d2c1b6bd3bc5155280a84d07b8dc9e5cb9db96bbcad56bcb6a9f788495d90"
Jul 21 07:00:03.881588 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.881565    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98" event={"ID":"4a1acf1a-56ab-4875-b6e0-db7161b1f7f5","Type":"ContainerDied","Data":"0bc892198bfca76c1cd34f3fbe52ea1e31222717315b2d196d9a88c66474d3b7"}
Jul 21 07:00:03.881692 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.881605    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bc892198bfca76c1cd34f3fbe52ea1e31222717315b2d196d9a88c66474d3b7"
Jul 21 07:00:03.881692 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:03.881570    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743620-66q98"
Jul 21 07:00:09.918840 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:09.918790    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 07:00:09.918840 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:09.918853    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 07:00:09.931595 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:09.931569    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 07:00:10.931089 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:10.931062    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 07:00:44.828478 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:44.828442    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"]
Jul 21 07:00:45.939178 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.939141    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"]
Jul 21 07:00:45.940514 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940401    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1acf1a-56ab-4875-b6e0-db7161b1f7f5" containerName="cleanup"
Jul 21 07:00:45.940514 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940426    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1acf1a-56ab-4875-b6e0-db7161b1f7f5" containerName="cleanup"
Jul 21 07:00:45.940514 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940449    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a70485-7fe7-470f-824f-391780a16012" containerName="cleanup"
Jul 21 07:00:45.940514 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940459    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a70485-7fe7-470f-824f-391780a16012" containerName="cleanup"
Jul 21 07:00:45.940514 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940478    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71936f57-90b8-4383-b5be-4cbb0b3150c7" containerName="cleanup"
Jul 21 07:00:45.940514 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940485    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="71936f57-90b8-4383-b5be-4cbb0b3150c7" containerName="cleanup"
Jul 21 07:00:45.940922 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940622    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7a70485-7fe7-470f-824f-391780a16012" containerName="cleanup"
Jul 21 07:00:45.940922 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940636    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1acf1a-56ab-4875-b6e0-db7161b1f7f5" containerName="cleanup"
Jul 21 07:00:45.940922 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.940646    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="71936f57-90b8-4383-b5be-4cbb0b3150c7" containerName="cleanup"
Jul 21 07:00:45.945587 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.945564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"]
Jul 21 07:00:45.945765 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.945650    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"
Jul 21 07:00:45.948492 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:45.948473    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 07:00:46.096267 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:46.096231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95e47ed-43ef-42d1-87c2-6d01112a84c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb\" (UID: \"d95e47ed-43ef-42d1-87c2-6d01112a84c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"
Jul 21 07:00:46.197872 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:46.197774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95e47ed-43ef-42d1-87c2-6d01112a84c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb\" (UID: \"d95e47ed-43ef-42d1-87c2-6d01112a84c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"
Jul 21 07:00:46.198451 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:46.198426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95e47ed-43ef-42d1-87c2-6d01112a84c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb\" (UID: \"d95e47ed-43ef-42d1-87c2-6d01112a84c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"
Jul 21 07:00:46.257460 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:46.257428    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"
Jul 21 07:00:46.400234 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:46.400207    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"]
Jul 21 07:00:47.108622 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:47.108590    2577 generic.go:356] "Generic (PLEG): container finished" podID="d95e47ed-43ef-42d1-87c2-6d01112a84c0" containerID="ab56bbb43459361cbe998a91f9acb602888bed5af8c99d12a7880eae8bac4ad9" exitCode=0
Jul 21 07:00:47.109017 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:47.108651    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb" event={"ID":"d95e47ed-43ef-42d1-87c2-6d01112a84c0","Type":"ContainerDied","Data":"ab56bbb43459361cbe998a91f9acb602888bed5af8c99d12a7880eae8bac4ad9"}
Jul 21 07:00:47.109017 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:47.108694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb" event={"ID":"d95e47ed-43ef-42d1-87c2-6d01112a84c0","Type":"ContainerStarted","Data":"c077bfa02a2c45886e68c4c436b9ccb94600b29f458b8862e274716af06e8cb4"}
Jul 21 07:00:48.249435 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:48.249412    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"
Jul 21 07:00:48.318836 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:48.318805    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95e47ed-43ef-42d1-87c2-6d01112a84c0-maas-api-service-ca\") pod \"d95e47ed-43ef-42d1-87c2-6d01112a84c0\" (UID: \"d95e47ed-43ef-42d1-87c2-6d01112a84c0\") "
Jul 21 07:00:48.319165 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:48.319143    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d95e47ed-43ef-42d1-87c2-6d01112a84c0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d95e47ed-43ef-42d1-87c2-6d01112a84c0" (UID: "d95e47ed-43ef-42d1-87c2-6d01112a84c0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 07:00:48.419957 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:48.419880    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95e47ed-43ef-42d1-87c2-6d01112a84c0-maas-api-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:00:49.121546 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:49.121507    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"
Jul 21 07:00:49.121727 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:49.121564    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb" event={"ID":"d95e47ed-43ef-42d1-87c2-6d01112a84c0","Type":"ContainerDied","Data":"c077bfa02a2c45886e68c4c436b9ccb94600b29f458b8862e274716af06e8cb4"}
Jul 21 07:00:49.121727 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:49.121614    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c077bfa02a2c45886e68c4c436b9ccb94600b29f458b8862e274716af06e8cb4"
Jul 21 07:00:56.476808 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.476772    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"]
Jul 21 07:00:56.477260 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.477063    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr" podUID="8555e38d-4da1-4d21-b938-c23fd0445501" containerName="maas-api" containerID="cri-o://13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e" gracePeriod=30
Jul 21 07:00:56.507675 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.507632    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"]
Jul 21 07:00:56.509976 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.509949    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-08eb3e-29743620-s5ntb"]
Jul 21 07:00:56.730904 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.730851    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 07:00:56.893924 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.893891    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxqnp\" (UniqueName: \"kubernetes.io/projected/8555e38d-4da1-4d21-b938-c23fd0445501-kube-api-access-zxqnp\") pod \"8555e38d-4da1-4d21-b938-c23fd0445501\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") "
Jul 21 07:00:56.894096 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.893941    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls\") pod \"8555e38d-4da1-4d21-b938-c23fd0445501\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") "
Jul 21 07:00:56.894096 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.894049    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8555e38d-4da1-4d21-b938-c23fd0445501-openshift-service-ca\") pod \"8555e38d-4da1-4d21-b938-c23fd0445501\" (UID: \"8555e38d-4da1-4d21-b938-c23fd0445501\") "
Jul 21 07:00:56.894392 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.894363    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8555e38d-4da1-4d21-b938-c23fd0445501-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8555e38d-4da1-4d21-b938-c23fd0445501" (UID: "8555e38d-4da1-4d21-b938-c23fd0445501"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 07:00:56.896087 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.896059    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8555e38d-4da1-4d21-b938-c23fd0445501-kube-api-access-zxqnp" (OuterVolumeSpecName: "kube-api-access-zxqnp") pod "8555e38d-4da1-4d21-b938-c23fd0445501" (UID: "8555e38d-4da1-4d21-b938-c23fd0445501"). InnerVolumeSpecName "kube-api-access-zxqnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 07:00:56.896180 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.896136    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8555e38d-4da1-4d21-b938-c23fd0445501" (UID: "8555e38d-4da1-4d21-b938-c23fd0445501"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 07:00:56.995474 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.995379    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8555e38d-4da1-4d21-b938-c23fd0445501-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:00:56.995474 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.995415    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxqnp\" (UniqueName: \"kubernetes.io/projected/8555e38d-4da1-4d21-b938-c23fd0445501-kube-api-access-zxqnp\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:00:56.995474 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:56.995435    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8555e38d-4da1-4d21-b938-c23fd0445501-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:00:57.165143 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.165108    2577 generic.go:356] "Generic (PLEG): container finished" podID="8555e38d-4da1-4d21-b938-c23fd0445501" containerID="13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e" exitCode=0
Jul 21 07:00:57.165341 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.165168    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"
Jul 21 07:00:57.165341 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.165192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr" event={"ID":"8555e38d-4da1-4d21-b938-c23fd0445501","Type":"ContainerDied","Data":"13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e"}
Jul 21 07:00:57.165341 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.165246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr" event={"ID":"8555e38d-4da1-4d21-b938-c23fd0445501","Type":"ContainerDied","Data":"a6327517d9ab0913691b22242eb98167ec9c38c3384e40206b42dd81fce79a42"}
Jul 21 07:00:57.165341 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.165271    2577 scope.go:117] "RemoveContainer" containerID="13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e"
Jul 21 07:00:57.175131 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.175114    2577 scope.go:117] "RemoveContainer" containerID="13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e"
Jul 21 07:00:57.175413 ip-10-0-128-56 kubenswrapper[2577]: E0721 07:00:57.175391    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e\": container with ID starting with 13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e not found: ID does not exist" containerID="13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e"
Jul 21 07:00:57.175478 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.175421    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e"} err="failed to get container status \"13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e\": rpc error: code = NotFound desc = could not find container \"13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e\": container with ID starting with 13ce7312bca1245a63482c8106b4a2dc496fedfcf73a2aff1b8326d76b06f74e not found: ID does not exist"
Jul 21 07:00:57.187250 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.187231    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"]
Jul 21 07:00:57.193070 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.193048    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-08eb3e-fd8768759-nzdtr"]
Jul 21 07:00:57.713944 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.713910    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71936f57-90b8-4383-b5be-4cbb0b3150c7" path="/var/lib/kubelet/pods/71936f57-90b8-4383-b5be-4cbb0b3150c7/volumes"
Jul 21 07:00:57.714338 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:57.714266    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8555e38d-4da1-4d21-b938-c23fd0445501" path="/var/lib/kubelet/pods/8555e38d-4da1-4d21-b938-c23fd0445501/volumes"
Jul 21 07:00:59.849500 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:00:59.849451    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8" podUID="7054face-6b3c-419a-a2d8-2bfef79eb7cd" containerName="main" containerID="cri-o://4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026" gracePeriod=45
Jul 21 07:01:00.105334 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.105281    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 07:01:00.182938 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.182908    2577 generic.go:356] "Generic (PLEG): container finished" podID="7054face-6b3c-419a-a2d8-2bfef79eb7cd" containerID="4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026" exitCode=0
Jul 21 07:01:00.183113 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.182952    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"
Jul 21 07:01:00.183113 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.182962    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8" event={"ID":"7054face-6b3c-419a-a2d8-2bfef79eb7cd","Type":"ContainerDied","Data":"4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026"}
Jul 21 07:01:00.183113 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.182993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8" event={"ID":"7054face-6b3c-419a-a2d8-2bfef79eb7cd","Type":"ContainerDied","Data":"5ec500bdfa6c2e469c2be913b41568ef577c4d249b48ce3e0ca7b811dc923bd2"}
Jul 21 07:01:00.183113 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.183010    2577 scope.go:117] "RemoveContainer" containerID="4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026"
Jul 21 07:01:00.191786 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.191760    2577 scope.go:117] "RemoveContainer" containerID="4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026"
Jul 21 07:01:00.192002 ip-10-0-128-56 kubenswrapper[2577]: E0721 07:01:00.191984    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026\": container with ID starting with 4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026 not found: ID does not exist" containerID="4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026"
Jul 21 07:01:00.192047 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.192010    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026"} err="failed to get container status \"4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026\": rpc error: code = NotFound desc = could not find container \"4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026\": container with ID starting with 4d018bbf59590cdf8c06d1648db40418a8d53db0973e94c0021f84ac93c96026 not found: ID does not exist"
Jul 21 07:01:00.223791 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.223765    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tls-certs\") pod \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") "
Jul 21 07:01:00.223894 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.223801    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tmp-dir\") pod \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") "
Jul 21 07:01:00.223894 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.223824    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-dshm\") pod \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") "
Jul 21 07:01:00.223894 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.223868    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-home\") pod \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") "
Jul 21 07:01:00.224011 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.223953    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdttw\" (UniqueName: \"kubernetes.io/projected/7054face-6b3c-419a-a2d8-2bfef79eb7cd-kube-api-access-kdttw\") pod \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") "
Jul 21 07:01:00.224011 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.223999    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-model-cache\") pod \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\" (UID: \"7054face-6b3c-419a-a2d8-2bfef79eb7cd\") "
Jul 21 07:01:00.224120 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.224054    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7054face-6b3c-419a-a2d8-2bfef79eb7cd" (UID: "7054face-6b3c-419a-a2d8-2bfef79eb7cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 07:01:00.224216 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.224190    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-home" (OuterVolumeSpecName: "home") pod "7054face-6b3c-419a-a2d8-2bfef79eb7cd" (UID: "7054face-6b3c-419a-a2d8-2bfef79eb7cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 07:01:00.224297 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.224272    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-model-cache" (OuterVolumeSpecName: "model-cache") pod "7054face-6b3c-419a-a2d8-2bfef79eb7cd" (UID: "7054face-6b3c-419a-a2d8-2bfef79eb7cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 07:01:00.224360 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.224317    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tmp-dir\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:00.224360 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.224334    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-home\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:00.226194 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.226174    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-dshm" (OuterVolumeSpecName: "dshm") pod "7054face-6b3c-419a-a2d8-2bfef79eb7cd" (UID: "7054face-6b3c-419a-a2d8-2bfef79eb7cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 07:01:00.226304 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.226233    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7054face-6b3c-419a-a2d8-2bfef79eb7cd" (UID: "7054face-6b3c-419a-a2d8-2bfef79eb7cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 07:01:00.226304 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.226262    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7054face-6b3c-419a-a2d8-2bfef79eb7cd-kube-api-access-kdttw" (OuterVolumeSpecName: "kube-api-access-kdttw") pod "7054face-6b3c-419a-a2d8-2bfef79eb7cd" (UID: "7054face-6b3c-419a-a2d8-2bfef79eb7cd"). InnerVolumeSpecName "kube-api-access-kdttw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 07:01:00.324878 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.324845    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdttw\" (UniqueName: \"kubernetes.io/projected/7054face-6b3c-419a-a2d8-2bfef79eb7cd-kube-api-access-kdttw\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:00.324878 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.324875    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-model-cache\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:00.324878 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.324887    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7054face-6b3c-419a-a2d8-2bfef79eb7cd-tls-certs\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:00.325089 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.324895    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7054face-6b3c-419a-a2d8-2bfef79eb7cd-dshm\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:00.505015 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.504985    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"]
Jul 21 07:01:00.509127 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:00.509098    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-08eb3e/sub-test-model-08eb3e-kserve-5546db8dd9-drtr8"]
Jul 21 07:01:01.026985 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:01.026942    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"]
Jul 21 07:01:01.029454 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:01.029428    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-08eb3e-js7hb"]
Jul 21 07:01:01.714198 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:01.714152    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7054face-6b3c-419a-a2d8-2bfef79eb7cd" path="/var/lib/kubelet/pods/7054face-6b3c-419a-a2d8-2bfef79eb7cd/volumes"
Jul 21 07:01:01.714506 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:01.714493    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d95e47ed-43ef-42d1-87c2-6d01112a84c0" path="/var/lib/kubelet/pods/d95e47ed-43ef-42d1-87c2-6d01112a84c0/volumes"
Jul 21 07:01:08.057914 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.057875    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"]
Jul 21 07:01:08.058311 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058297    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d95e47ed-43ef-42d1-87c2-6d01112a84c0" containerName="revoke-keys"
Jul 21 07:01:08.058359 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058314    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d95e47ed-43ef-42d1-87c2-6d01112a84c0" containerName="revoke-keys"
Jul 21 07:01:08.058359 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058330    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7054face-6b3c-419a-a2d8-2bfef79eb7cd" containerName="main"
Jul 21 07:01:08.058359 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058336    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7054face-6b3c-419a-a2d8-2bfef79eb7cd" containerName="main"
Jul 21 07:01:08.058359 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058351    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8555e38d-4da1-4d21-b938-c23fd0445501" containerName="maas-api"
Jul 21 07:01:08.058479 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058361    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8555e38d-4da1-4d21-b938-c23fd0445501" containerName="maas-api"
Jul 21 07:01:08.058479 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058424    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d95e47ed-43ef-42d1-87c2-6d01112a84c0" containerName="revoke-keys"
Jul 21 07:01:08.058479 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058439    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7054face-6b3c-419a-a2d8-2bfef79eb7cd" containerName="main"
Jul 21 07:01:08.058479 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.058448    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8555e38d-4da1-4d21-b938-c23fd0445501" containerName="maas-api"
Jul 21 07:01:08.062904 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.062887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"
Jul 21 07:01:08.065481 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.065460    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jvhnq\""
Jul 21 07:01:08.068844 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.068819    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"]
Jul 21 07:01:08.095347 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.095319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fe0aed-7529-4b03-8ccb-d1dd9a579b94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg\" (UID: \"63fe0aed-7529-4b03-8ccb-d1dd9a579b94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"
Jul 21 07:01:08.195965 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.195937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fe0aed-7529-4b03-8ccb-d1dd9a579b94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg\" (UID: \"63fe0aed-7529-4b03-8ccb-d1dd9a579b94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"
Jul 21 07:01:08.196572 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.196522    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fe0aed-7529-4b03-8ccb-d1dd9a579b94-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg\" (UID: \"63fe0aed-7529-4b03-8ccb-d1dd9a579b94\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"
Jul 21 07:01:08.375732 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.375637    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"
Jul 21 07:01:08.512459 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:08.512435    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"]
Jul 21 07:01:08.514749 ip-10-0-128-56 kubenswrapper[2577]: W0721 07:01:08.514716    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fe0aed_7529_4b03_8ccb_d1dd9a579b94.slice/crio-796ff5e0e02f2762113b113b9dd1a46c4ff03cc984f9be564f8e72d657a83c83 WatchSource:0}: Error finding container 796ff5e0e02f2762113b113b9dd1a46c4ff03cc984f9be564f8e72d657a83c83: Status 404 returned error can't find the container with id 796ff5e0e02f2762113b113b9dd1a46c4ff03cc984f9be564f8e72d657a83c83
Jul 21 07:01:09.238117 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:09.238082    2577 generic.go:356] "Generic (PLEG): container finished" podID="63fe0aed-7529-4b03-8ccb-d1dd9a579b94" containerID="90e47039811ecb850e2b5ea658699229002a42fef434908b45c70b361102f224" exitCode=0
Jul 21 07:01:09.238466 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:09.238120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg" event={"ID":"63fe0aed-7529-4b03-8ccb-d1dd9a579b94","Type":"ContainerDied","Data":"90e47039811ecb850e2b5ea658699229002a42fef434908b45c70b361102f224"}
Jul 21 07:01:09.238466 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:09.238196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg" event={"ID":"63fe0aed-7529-4b03-8ccb-d1dd9a579b94","Type":"ContainerStarted","Data":"796ff5e0e02f2762113b113b9dd1a46c4ff03cc984f9be564f8e72d657a83c83"}
Jul 21 07:01:10.377917 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:10.377895    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"
Jul 21 07:01:10.418322 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:10.418284    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fe0aed-7529-4b03-8ccb-d1dd9a579b94-maas-api-service-ca\") pod \"63fe0aed-7529-4b03-8ccb-d1dd9a579b94\" (UID: \"63fe0aed-7529-4b03-8ccb-d1dd9a579b94\") "
Jul 21 07:01:10.418804 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:10.418768    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63fe0aed-7529-4b03-8ccb-d1dd9a579b94-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63fe0aed-7529-4b03-8ccb-d1dd9a579b94" (UID: "63fe0aed-7529-4b03-8ccb-d1dd9a579b94"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 07:01:10.519775 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:10.519750    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63fe0aed-7529-4b03-8ccb-d1dd9a579b94-maas-api-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:11.249968 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:11.249920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg" event={"ID":"63fe0aed-7529-4b03-8ccb-d1dd9a579b94","Type":"ContainerDied","Data":"796ff5e0e02f2762113b113b9dd1a46c4ff03cc984f9be564f8e72d657a83c83"}
Jul 21 07:01:11.250118 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:11.249984    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="796ff5e0e02f2762113b113b9dd1a46c4ff03cc984f9be564f8e72d657a83c83"
Jul 21 07:01:11.250118 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:11.249938    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"
Jul 21 07:01:18.556270 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.556237    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"]
Jul 21 07:01:18.556917 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.556458    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s" podUID="ae4fdcff-9324-44b5-84dd-991c28905625" containerName="maas-api" containerID="cri-o://e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734" gracePeriod=30
Jul 21 07:01:18.583763 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.583728    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"]
Jul 21 07:01:18.586960 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.586932    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-bddf64-29743620-tcwmb"]
Jul 21 07:01:18.808908 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.808847    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 07:01:18.906175 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.906142    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4fdcff-9324-44b5-84dd-991c28905625-maas-api-tls\") pod \"ae4fdcff-9324-44b5-84dd-991c28905625\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") "
Jul 21 07:01:18.906359 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.906221    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqw26\" (UniqueName: \"kubernetes.io/projected/ae4fdcff-9324-44b5-84dd-991c28905625-kube-api-access-fqw26\") pod \"ae4fdcff-9324-44b5-84dd-991c28905625\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") "
Jul 21 07:01:18.906359 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.906323    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4fdcff-9324-44b5-84dd-991c28905625-openshift-service-ca\") pod \"ae4fdcff-9324-44b5-84dd-991c28905625\" (UID: \"ae4fdcff-9324-44b5-84dd-991c28905625\") "
Jul 21 07:01:18.906727 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.906701    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4fdcff-9324-44b5-84dd-991c28905625-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae4fdcff-9324-44b5-84dd-991c28905625" (UID: "ae4fdcff-9324-44b5-84dd-991c28905625"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 07:01:18.908595 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.908569    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4fdcff-9324-44b5-84dd-991c28905625-kube-api-access-fqw26" (OuterVolumeSpecName: "kube-api-access-fqw26") pod "ae4fdcff-9324-44b5-84dd-991c28905625" (UID: "ae4fdcff-9324-44b5-84dd-991c28905625"). InnerVolumeSpecName "kube-api-access-fqw26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 07:01:18.908714 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:18.908679    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4fdcff-9324-44b5-84dd-991c28905625-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae4fdcff-9324-44b5-84dd-991c28905625" (UID: "ae4fdcff-9324-44b5-84dd-991c28905625"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 07:01:19.007480 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.007447    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4fdcff-9324-44b5-84dd-991c28905625-maas-api-tls\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:19.007480 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.007476    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqw26\" (UniqueName: \"kubernetes.io/projected/ae4fdcff-9324-44b5-84dd-991c28905625-kube-api-access-fqw26\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:19.007480 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.007486    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4fdcff-9324-44b5-84dd-991c28905625-openshift-service-ca\") on node \"ip-10-0-128-56.ec2.internal\" DevicePath \"\""
Jul 21 07:01:19.293381 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.293348    2577 generic.go:356] "Generic (PLEG): container finished" podID="ae4fdcff-9324-44b5-84dd-991c28905625" containerID="e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734" exitCode=0
Jul 21 07:01:19.293586 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.293399    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"
Jul 21 07:01:19.293586 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.293432    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s" event={"ID":"ae4fdcff-9324-44b5-84dd-991c28905625","Type":"ContainerDied","Data":"e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734"}
Jul 21 07:01:19.293586 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.293490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s" event={"ID":"ae4fdcff-9324-44b5-84dd-991c28905625","Type":"ContainerDied","Data":"7a77b1f47af80295b43eb12284793dc93221c3dee27976a1524024601a06ba0c"}
Jul 21 07:01:19.293586 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.293512    2577 scope.go:117] "RemoveContainer" containerID="e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734"
Jul 21 07:01:19.303336 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.303320    2577 scope.go:117] "RemoveContainer" containerID="e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734"
Jul 21 07:01:19.303573 ip-10-0-128-56 kubenswrapper[2577]: E0721 07:01:19.303527    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734\": container with ID starting with e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734 not found: ID does not exist" containerID="e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734"
Jul 21 07:01:19.303689 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.303582    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734"} err="failed to get container status \"e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734\": rpc error: code = NotFound desc = could not find container \"e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734\": container with ID starting with e7295dc12aa44b9e4fbfb88e5e7c6212f1b40c6e7e3e8c2b3dffccd765122734 not found: ID does not exist"
Jul 21 07:01:19.315100 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.315080    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"]
Jul 21 07:01:19.318917 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.318897    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bddf64-5cb78c9d49-4598s"]
Jul 21 07:01:19.714232 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.714140    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4fdcff-9324-44b5-84dd-991c28905625" path="/var/lib/kubelet/pods/ae4fdcff-9324-44b5-84dd-991c28905625/volumes"
Jul 21 07:01:19.714601 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:19.714413    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a70485-7fe7-470f-824f-391780a16012" path="/var/lib/kubelet/pods/f7a70485-7fe7-470f-824f-391780a16012/volumes"
Jul 21 07:01:23.136718 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:23.136604    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"]
Jul 21 07:01:23.138964 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:23.138940    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bddf64-7k9vg"]
Jul 21 07:01:23.713327 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:23.713295    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63fe0aed-7529-4b03-8ccb-d1dd9a579b94" path="/var/lib/kubelet/pods/63fe0aed-7529-4b03-8ccb-d1dd9a579b94/volumes"
Jul 21 07:01:36.028502 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:36.028466    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6ff745f6b9-n22qc_eef4e245-b3cc-46af-bf3d-27296f94bad9/manager/0.log"
Jul 21 07:01:36.145643 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:36.145609    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jbj6f_7bd765f3-66f8-426c-8da9-2ef07cdc74c1/server/0.log"
Jul 21 07:01:36.499112 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:36.499030    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c844c949-g6x2t_1136e1ef-12c2-4add-8244-5fc8f33b9ba2/copy-manifests/0.log"
Jul 21 07:01:36.517345 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:36.517317    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c844c949-g6x2t_1136e1ef-12c2-4add-8244-5fc8f33b9ba2/manager/0.log"
Jul 21 07:01:36.981287 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:36.981252    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-86f46b5fc6-dv2jd_f559a042-73ca-4e7a-a9d5-0e8664667042/maas-api/0.log"
Jul 21 07:01:37.214091 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:37.214059    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743605-lqb6p_d69ad42d-1001-48c0-8cff-29babad7e79e/cleanup/0.log"
Jul 21 07:01:37.328925 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:37.328887    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743620-66q98_4a1acf1a-56ab-4875-b6e0-db7161b1f7f5/cleanup/0.log"
Jul 21 07:01:37.437725 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:37.437699    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-znwrt_73e45c23-5f96-44df-9a3e-1c782ab44d37/postgres/0.log"
Jul 21 07:01:38.838953 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:38.838919    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2r56g_2f9ead72-6268-4518-88df-2b3abdb98eff/manager/0.log"
Jul 21 07:01:38.948857 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:38.948826    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9zxc6_9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada/manager/0.log"
Jul 21 07:01:39.061699 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:39.061673    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2kzb4_dc6a04a4-80c5-4c25-a459-36b2a33cc57b/kuadrant-console-plugin/0.log"
Jul 21 07:01:39.188442 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:39.188355    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jw2bc_ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc/registry-server/0.log"
Jul 21 07:01:39.561085 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:39.561056    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bdm6b_843f88db-efc6-4ccf-b509-e7bbbc8f64ef/manager/0.log"
Jul 21 07:01:40.635185 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:40.635154    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2js5p_e86931e7-b7f5-4905-9b64-28b6fa7ee6f1/payload-processing/0.log"
Jul 21 07:01:40.754568 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:40.754522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6948bd64-7zfnp_34287f05-4dc0-49e8-bd95-719ca9e8f580/router/0.log"
Jul 21 07:01:41.112233 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:41.112205    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-98bz8_8ad42808-989c-4bb8-bfd0-4186b4177ce6/main/0.log"
Jul 21 07:01:41.440153 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:41.440071    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5bqzx_dda3c5ee-fa14-4dfe-954d-852ba14b6266/main/0.log"
Jul 21 07:01:44.026920 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:44.026887    2577 scope.go:117] "RemoveContainer" containerID="2aeb75d827961cce53e0f4ddb20a603d11562a860460a638fccb6b3d9ad64fbc"
Jul 21 07:01:44.035351 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:44.035326    2577 scope.go:117] "RemoveContainer" containerID="18f54fd052dbe1dbb8acd3d9a9099ea5bd2db10ad590dd921a3dfa2479b7f314"
Jul 21 07:01:49.914897 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:49.914862    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-thwmp_54c7c5e3-26b3-44b0-9f4f-0b5353e28cb7/global-pull-secret-syncer/0.log"
Jul 21 07:01:50.045021 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:50.044991    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lhqgl_367e2d80-bfb6-4260-93d4-700c17a7796d/konnectivity-agent/0.log"
Jul 21 07:01:50.099048 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:50.099019    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-56.ec2.internal_42bd7eb63df01dcfbe6e3f5754bb93f6/haproxy/0.log"
Jul 21 07:01:55.524082 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:55.524046    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2r56g_2f9ead72-6268-4518-88df-2b3abdb98eff/manager/0.log"
Jul 21 07:01:55.547281 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:55.547257    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9zxc6_9279a2dc-ca6f-4f3b-b54d-3e008ebc1ada/manager/0.log"
Jul 21 07:01:55.576434 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:55.576406    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2kzb4_dc6a04a4-80c5-4c25-a459-36b2a33cc57b/kuadrant-console-plugin/0.log"
Jul 21 07:01:55.628497 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:55.628468    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-jw2bc_ba5b5dea-3ac9-49f9-bc61-3035b5b39fdc/registry-server/0.log"
Jul 21 07:01:55.891034 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:55.890999    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bdm6b_843f88db-efc6-4ccf-b509-e7bbbc8f64ef/manager/0.log"
Jul 21 07:01:57.940648 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:57.940557    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8cf9cc889-jn4tt_4badf439-acfd-4c04-864e-581587ebb5b0/metrics-server/0.log"
Jul 21 07:01:57.972165 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:57.972131    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-pq2tt_502f1f59-7056-4915-8ed3-cdfeba2a880e/monitoring-plugin/0.log"
Jul 21 07:01:58.114056 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.114028    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrlrc_05f3879b-2385-4061-8c97-ee6848828496/node-exporter/0.log"
Jul 21 07:01:58.140689 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.140663    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrlrc_05f3879b-2385-4061-8c97-ee6848828496/kube-rbac-proxy/0.log"
Jul 21 07:01:58.167865 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.167844    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rrlrc_05f3879b-2385-4061-8c97-ee6848828496/init-textfile/0.log"
Jul 21 07:01:58.375225 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.375198    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64839c1d-b21a-47eb-9fbe-58b9ea24346a/prometheus/0.log"
Jul 21 07:01:58.401302 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.401271    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64839c1d-b21a-47eb-9fbe-58b9ea24346a/config-reloader/0.log"
Jul 21 07:01:58.424254 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.424227    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64839c1d-b21a-47eb-9fbe-58b9ea24346a/thanos-sidecar/0.log"
Jul 21 07:01:58.453995 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.453962    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64839c1d-b21a-47eb-9fbe-58b9ea24346a/kube-rbac-proxy-web/0.log"
Jul 21 07:01:58.477768 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.477742    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64839c1d-b21a-47eb-9fbe-58b9ea24346a/kube-rbac-proxy/0.log"
Jul 21 07:01:58.497878 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.497846    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64839c1d-b21a-47eb-9fbe-58b9ea24346a/kube-rbac-proxy-thanos/0.log"
Jul 21 07:01:58.518757 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.518691    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_64839c1d-b21a-47eb-9fbe-58b9ea24346a/init-config-reloader/0.log"
Jul 21 07:01:58.545603 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.545583    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-b9mgc_dae1a2c1-85bd-4423-ba07-20905ac689b0/prometheus-operator/0.log"
Jul 21 07:01:58.564689 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.564671    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-b9mgc_dae1a2c1-85bd-4423-ba07-20905ac689b0/kube-rbac-proxy/0.log"
Jul 21 07:01:58.629440 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.629366    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bdb9d59d7-rrwlz_52b05a59-dba0-40f7-9e72-373dafc4bce6/telemeter-client/0.log"
Jul 21 07:01:58.649936 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.649906    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bdb9d59d7-rrwlz_52b05a59-dba0-40f7-9e72-373dafc4bce6/reload/0.log"
Jul 21 07:01:58.671713 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:01:58.671661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bdb9d59d7-rrwlz_52b05a59-dba0-40f7-9e72-373dafc4bce6/kube-rbac-proxy/0.log"
Jul 21 07:02:00.427856 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.427824    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"]
Jul 21 07:02:00.428313 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.428239    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63fe0aed-7529-4b03-8ccb-d1dd9a579b94" containerName="revoke-keys"
Jul 21 07:02:00.428313 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.428255    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="63fe0aed-7529-4b03-8ccb-d1dd9a579b94" containerName="revoke-keys"
Jul 21 07:02:00.428313 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.428293    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4fdcff-9324-44b5-84dd-991c28905625" containerName="maas-api"
Jul 21 07:02:00.428313 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.428303    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4fdcff-9324-44b5-84dd-991c28905625" containerName="maas-api"
Jul 21 07:02:00.428512 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.428393    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4fdcff-9324-44b5-84dd-991c28905625" containerName="maas-api"
Jul 21 07:02:00.428512 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.428404    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="63fe0aed-7529-4b03-8ccb-d1dd9a579b94" containerName="revoke-keys"
Jul 21 07:02:00.431610 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.431590    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.434182 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.434161    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mtl9f\"/\"default-dockercfg-qq7rw\""
Jul 21 07:02:00.434312 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.434191    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mtl9f\"/\"openshift-service-ca.crt\""
Jul 21 07:02:00.435196 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.435182    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mtl9f\"/\"kube-root-ca.crt\""
Jul 21 07:02:00.443634 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.443610    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"]
Jul 21 07:02:00.482752 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.482719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-proc\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.482905 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.482765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-lib-modules\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.482905 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.482795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-sys\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.482905 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.482815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvh2n\" (UniqueName: \"kubernetes.io/projected/efe3410f-ab2c-4a8f-9962-3577318dda2e-kube-api-access-pvh2n\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.483016 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.482911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-podres\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.583927 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.583895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-podres\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.584126 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.583946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-proc\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.584126 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.583989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-lib-modules\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.584126 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.584029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-sys\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.584126 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.584054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvh2n\" (UniqueName: \"kubernetes.io/projected/efe3410f-ab2c-4a8f-9962-3577318dda2e-kube-api-access-pvh2n\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.584126 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.584061    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-podres\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.584126 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.584076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-proc\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.584126 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.584097    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-sys\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.584384 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.584128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/efe3410f-ab2c-4a8f-9962-3577318dda2e-lib-modules\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.592147 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.592117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvh2n\" (UniqueName: \"kubernetes.io/projected/efe3410f-ab2c-4a8f-9962-3577318dda2e-kube-api-access-pvh2n\") pod \"perf-node-gather-daemonset-28v9d\" (UID: \"efe3410f-ab2c-4a8f-9962-3577318dda2e\") " pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.743768 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.743679    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:00.877997 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:00.877974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"]
Jul 21 07:02:00.879986 ip-10-0-128-56 kubenswrapper[2577]: W0721 07:02:00.879957    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podefe3410f_ab2c_4a8f_9962_3577318dda2e.slice/crio-8b58b9a91e37db8ca2babe3a3d39a0b27c1c8e4637f3ed27031a92cc34d9b5aa WatchSource:0}: Error finding container 8b58b9a91e37db8ca2babe3a3d39a0b27c1c8e4637f3ed27031a92cc34d9b5aa: Status 404 returned error can't find the container with id 8b58b9a91e37db8ca2babe3a3d39a0b27c1c8e4637f3ed27031a92cc34d9b5aa
Jul 21 07:02:01.161862 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:01.161826    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-57977fbb9b-rz4m7_ec71de9e-ac04-47cf-9878-50e5cf451a20/console/0.log"
Jul 21 07:02:01.202337 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:01.202307    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-fzwlk_b7654c73-3579-4c49-b969-7945805d2a5a/download-server/0.log"
Jul 21 07:02:01.517270 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:01.517235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d" event={"ID":"efe3410f-ab2c-4a8f-9962-3577318dda2e","Type":"ContainerStarted","Data":"1a2a65ac098a65bcbc7f3c3900b989bb142705bb5c1f5087ba2c8210c39437e2"}
Jul 21 07:02:01.517777 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:01.517292    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d" event={"ID":"efe3410f-ab2c-4a8f-9962-3577318dda2e","Type":"ContainerStarted","Data":"8b58b9a91e37db8ca2babe3a3d39a0b27c1c8e4637f3ed27031a92cc34d9b5aa"}
Jul 21 07:02:01.517777 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:01.517340    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:01.536707 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:01.536661    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d" podStartSLOduration=1.5366473470000002 podStartE2EDuration="1.536647347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 07:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 07:02:01.535176296 +0000 UTC m=+2658.347919965" watchObservedRunningTime="2026-07-21 07:02:01.536647347 +0000 UTC m=+2658.349391030"
Jul 21 07:02:02.897035 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:02.897004    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s8z97_330c0482-8a09-475a-990e-01b83091f19b/dns/0.log"
Jul 21 07:02:02.916694 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:02.916665    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s8z97_330c0482-8a09-475a-990e-01b83091f19b/kube-rbac-proxy/0.log"
Jul 21 07:02:02.938922 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:02.938898    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9nl56_ea99fd85-6838-44e4-b591-a8f1f6489598/dns-node-resolver/0.log"
Jul 21 07:02:03.556690 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:03.556657    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9wv82_2872afe6-bbd2-4ff1-849b-11ca538c3a14/node-ca/0.log"
Jul 21 07:02:04.782600 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:04.782567    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2js5p_e86931e7-b7f5-4905-9b64-28b6fa7ee6f1/payload-processing/0.log"
Jul 21 07:02:04.803587 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:04.803557    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6948bd64-7zfnp_34287f05-4dc0-49e8-bd95-719ca9e8f580/router/0.log"
Jul 21 07:02:05.505246 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:05.505217    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6lq5t_30b29ba6-dcbc-4db4-9109-baaafe62e0ab/serve-healthcheck-canary/0.log"
Jul 21 07:02:06.051198 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:06.051161    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk2hx_bd28b7ed-2e4c-426d-ba6f-cc5a89975621/kube-rbac-proxy/0.log"
Jul 21 07:02:06.069751 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:06.069724    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk2hx_bd28b7ed-2e4c-426d-ba6f-cc5a89975621/exporter/0.log"
Jul 21 07:02:06.088760 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:06.088733    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qk2hx_bd28b7ed-2e4c-426d-ba6f-cc5a89975621/extractor/0.log"
Jul 21 07:02:07.532595 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:07.532570    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mtl9f/perf-node-gather-daemonset-28v9d"
Jul 21 07:02:08.771769 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:08.771738    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6ff745f6b9-n22qc_eef4e245-b3cc-46af-bf3d-27296f94bad9/manager/0.log"
Jul 21 07:02:08.790913 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:08.790882    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jbj6f_7bd765f3-66f8-426c-8da9-2ef07cdc74c1/server/0.log"
Jul 21 07:02:09.025350 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:09.025268    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c844c949-g6x2t_1136e1ef-12c2-4add-8244-5fc8f33b9ba2/manager/0.log"
Jul 21 07:02:09.041800 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:09.041776    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78c844c949-g6x2t_1136e1ef-12c2-4add-8244-5fc8f33b9ba2/copy-manifests/0.log"
Jul 21 07:02:10.452929 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:10.452903    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-964495ff5-q9x6f_0da85fb2-b1de-43d0-8566-aa35eed5d07e/manager/0.log"
Jul 21 07:02:10.503639 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:10.503600    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-pwd27_449f7269-f910-4431-ac36-140b819b7b35/openshift-lws-operator/0.log"
Jul 21 07:02:11.181207 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:11.181173    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2js5p_e86931e7-b7f5-4905-9b64-28b6fa7ee6f1/payload-processing/0.log"
Jul 21 07:02:11.194394 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:11.194369    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6948bd64-7zfnp_34287f05-4dc0-49e8-bd95-719ca9e8f580/router/0.log"
Jul 21 07:02:12.668691 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:12.668661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2js5p_e86931e7-b7f5-4905-9b64-28b6fa7ee6f1/payload-processing/0.log"
Jul 21 07:02:12.685734 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:12.685705    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b6948bd64-7zfnp_34287f05-4dc0-49e8-bd95-719ca9e8f580/router/0.log"
Jul 21 07:02:17.080455 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.080425    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvbl7_3864ad44-6ed0-49fc-9844-64c3db7cc458/kube-multus-additional-cni-plugins/0.log"
Jul 21 07:02:17.106119 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.106087    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvbl7_3864ad44-6ed0-49fc-9844-64c3db7cc458/egress-router-binary-copy/0.log"
Jul 21 07:02:17.132398 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.132370    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvbl7_3864ad44-6ed0-49fc-9844-64c3db7cc458/cni-plugins/0.log"
Jul 21 07:02:17.158780 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.158760    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvbl7_3864ad44-6ed0-49fc-9844-64c3db7cc458/bond-cni-plugin/0.log"
Jul 21 07:02:17.181692 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.181671    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvbl7_3864ad44-6ed0-49fc-9844-64c3db7cc458/routeoverride-cni/0.log"
Jul 21 07:02:17.204060 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.204030    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvbl7_3864ad44-6ed0-49fc-9844-64c3db7cc458/whereabouts-cni-bincopy/0.log"
Jul 21 07:02:17.226968 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.226944    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kvbl7_3864ad44-6ed0-49fc-9844-64c3db7cc458/whereabouts-cni/0.log"
Jul 21 07:02:17.459127 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.459050    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jjzcf_99395a70-f20e-4a73-b161-66c015c14b90/kube-multus/0.log"
Jul 21 07:02:17.583060 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.583026    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zgblg_1dc25648-0845-4e8f-8eec-9a370cb306cb/network-metrics-daemon/0.log"
Jul 21 07:02:17.598699 ip-10-0-128-56 kubenswrapper[2577]: I0721 07:02:17.598675    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zgblg_1dc25648-0845-4e8f-8eec-9a370cb306cb/kube-rbac-proxy/0.log"