Jul 07 15:41:58.813833 ip-10-0-128-7 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.198200    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205064    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205075    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205080    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205083    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205087    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205095    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205098    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:41:59.211782 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205101    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205103    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205106    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205109    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205111    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205114    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205117    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205120    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205122    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205125    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205127    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205130    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205132    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205136    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205138    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205141    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205143    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205146    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205149    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205151    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:41:59.214412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205155    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205161    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205164    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205166    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205169    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205171    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205174    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205176    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205179    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205182    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205184    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205187    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205190    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205193    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205196    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205199    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205202    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205205    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205209    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:41:59.216190 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205212    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205215    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205218    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205220    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205223    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205225    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205228    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205230    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205233    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205236    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205238    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205241    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205243    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205246    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205250    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205253    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205258    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205261    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205264    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205267    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:41:59.218406 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205270    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205272    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205275    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205277    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205280    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205283    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205286    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205288    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205291    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205293    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205296    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205299    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205301    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205304    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205306    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205309    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205311    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205314    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205316    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205319    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:41:59.220174 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205322    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205325    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205327    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205330    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205332    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205335    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205337    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205340    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205343    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205346    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205348    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205351    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.205353    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.207975    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.207984    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.207988    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.207991    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.207995    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208001    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208004    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:41:59.222501 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208007    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208010    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208012    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208015    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208018    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208021    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208023    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208026    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208029    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208031    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208036    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208040    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208043    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208049    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208052    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208054    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208058    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208061    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208064    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208067    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:41:59.224220 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208070    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208073    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208075    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208078    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208081    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208083    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208086    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208088    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208091    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208094    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208096    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208100    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208102    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208105    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208108    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208110    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208113    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208116    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208118    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208121    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:41:59.226369 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208123    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208126    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208129    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208131    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208134    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208138    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208141    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208143    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208146    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208148    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208151    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208154    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208156    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208159    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208162    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208164    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208167    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208169    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208172    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:41:59.228240 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208176    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208178    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208181    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208184    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208187    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208189    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208193    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208197    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208199    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208202    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208204    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208206    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208209    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208211    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208214    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208217    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208219    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208222    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208225    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:41:59.230890 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208228    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208232    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208235    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208238    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208240    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208243    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208245    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208248    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208251    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208253    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208255    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208258    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208261    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208263    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208697    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208703    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208707    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208710    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208713    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208716    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:41:59.261524 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208719    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208722    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208725    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208728    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208731    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208734    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208736    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208739    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208742    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208746    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208750    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208755    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208758    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208762    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208764    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208767    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208769    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208772    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208774    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208776    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:41:59.281211 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208779    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208781    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208784    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208786    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208789    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208791    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208794    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208798    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208809    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208812    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208815    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208818    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208820    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208823    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208825    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208828    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208830    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208833    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208835    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:41:59.512587 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208838    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:41:59.283168 ip-10-0-128-7 systemd[1]: Started Kubernetes Kubelet.
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208840    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208843    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208846    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208849    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208852    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208856    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208858    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208861    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208864    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208867    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208869    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208872    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208875    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208877    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208880    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208882    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208885    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208887    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208894    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:41:59.531284 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208896    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208899    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208901    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208904    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208906    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208912    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208914    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208917    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208919    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208922    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208924    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208926    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208929    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208931    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208934    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208938    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208943    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208945    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208949    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:41:59.532104 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208952    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208954    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208957    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208959    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208962    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208964    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208967    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208969    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208972    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208974    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208977    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208979    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208982    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208984    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.208987    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209046    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209052    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209058    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209065    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209075    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209078    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 15:41:59.532835 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209083    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209086    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209090    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209092    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209096    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209099    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209102    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209105    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209109    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209112    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209116    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209119    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209122    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209125    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209128    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209131    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209134    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209138    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209141    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209144    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209147    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209150    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209153    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209156    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 15:41:59.533608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209159    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209162    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209166    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209169    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209172    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209174    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209177    2581 flags.go:64] FLAG: --enable-server="true"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209181    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209185    2581 flags.go:64] FLAG: --event-burst="100"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209188    2581 flags.go:64] FLAG: --event-qps="50"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209191    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209194    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209197    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209201    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209203    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209206    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209210    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209213    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209218    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209220    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209223    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209226    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209229    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209232    2581 flags.go:64] FLAG: --feature-gates=""
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209236    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 15:41:59.534718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209238    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209241    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209244    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209248    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209251    2581 flags.go:64] FLAG: --help="false"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209254    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209257    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209260    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209263    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209266    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209269    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209272    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209274    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209277    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209280    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209290    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209294    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209297    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209300    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209302    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209305    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209308    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209311    2581 flags.go:64] FLAG: --lock-file=""
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209315    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 15:41:59.537043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209318    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209322    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209332    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209335    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209338    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209341    2581 flags.go:64] FLAG: --logging-format="text"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209344    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209347    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209350    2581 flags.go:64] FLAG: --manifest-url=""
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209353    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209357    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209360    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209364    2581 flags.go:64] FLAG: --max-pods="110"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209367    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209370    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209373    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209376    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209379    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209381    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209384    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209392    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209395    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209398    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 15:41:59.538660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209401    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209404    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209409    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209412    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209415    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209417    2581 flags.go:64] FLAG: --port="10250"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209420    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209423    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0773976ac6d3a925b"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209427    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209430    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209433    2581 flags.go:64] FLAG: --register-node="true"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209438    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209442    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209444    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209447    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209450    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209453    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209456    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209459    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209462    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209465    2581 flags.go:64] FLAG: --runonce="false"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209468    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209471    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209473    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209476    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 15:41:59.541318 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209479    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209482    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209484    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209488    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209490    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209493    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209496    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209499    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209502    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.209541    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210638    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210686    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210692    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210696    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210703    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210706    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210710    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210713    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210717    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210720    2581 flags.go:64] FLAG: --v="2"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210734    2581 flags.go:64] FLAG: --version="false"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210738    2581 flags.go:64] FLAG: --vmodule=""
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210743    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.210747    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 15:41:59.544003 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.210972    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.210977    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.210980    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.210983    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.210986    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.210989    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.210994    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211001    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211012    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211018    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211021    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211025    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211027    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211030    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211033    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211037    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211040    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211042    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211045    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:59.545983 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211049    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211055    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211058    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211061    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211064    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211067    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211069    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211072    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211075    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211077    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211080    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211083    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211085    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211088    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211093    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211096    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211098    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211101    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211104    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:41:59.547196 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211106    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211109    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211112    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211117    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211121    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211123    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211126    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211131    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211134    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211136    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211139    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211141    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211144    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211147    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211150    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211153    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211155    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211159    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211163    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211167    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:41:59.548806 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211182    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211185    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211188    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211191    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211193    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211196    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211199    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211202    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211204    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211207    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211210    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211213    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211219    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211223    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211226    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211230    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211236    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211239    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211242    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211244    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:41:59.550456 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211247    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211250    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211252    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211255    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211260    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211263    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211265    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211268    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211271    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211274    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211276    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211279    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211282    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211285    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211287    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211290    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211293    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211298    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211301    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211303    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:41:59.551589 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.211306    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.212172    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.219828    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.219843    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.219862    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.219868    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219923    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219928    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219931    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219935    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219938    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219941    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219944    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219946    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:41:59.552519 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219949    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219952    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219954    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219958    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219964    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219967    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219970    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219973    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219976    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219979    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219981    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219984    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219986    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219989    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219991    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219994    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219997    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.219999    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220002    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:41:59.552947 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220004    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220008    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220010    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220013    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220015    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220018    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220021    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220025    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220029    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220032    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220035    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220038    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220041    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220043    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220046    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220049    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220052    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220056    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220059    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220062    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:41:59.553591 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220065    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220069    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220073    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220076    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220078    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220081    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220084    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220088    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220091    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220094    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220096    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220099    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220102    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220105    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220107    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220109    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220112    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220114    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220117    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220120    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:59.554191 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220122    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220125    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220127    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220129    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220132    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220135    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220137    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220140    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220142    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220146    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220149    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220151    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220154    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220157    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220160    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220162    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220165    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220167    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220170    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220173    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:41:59.554803 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220176    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220179    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220183    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220186    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220188    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220191    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220194    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220196    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220199    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220202    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220204    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220206    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.220212    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220325    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220329    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:41:59.557697 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220332    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220335    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220338    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220340    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220343    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220346    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220348    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220353    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220356    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220358    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220361    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220364    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220366    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220369    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220371    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220374    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220376    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220378    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220381    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220383    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:41:59.558147 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220386    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220389    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220393    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220397    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220400    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220402    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220405    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220408    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220411    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220413    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220416    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220418    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220421    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220424    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220426    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220429    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220431    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220434    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220438    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:41:59.672394 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220442    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220445    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220448    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220451    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220453    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220456    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220459    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220461    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220464    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220466    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220469    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220472    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220474    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220477    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220480    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220483    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220486    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220488    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220490    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220493    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:41:59.673046 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220496    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220499    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220501    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220504    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220506    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220508    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220511    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220513    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220516    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220518    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220520    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220523    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220527    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220529    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220531    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220534    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220536    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220539    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220541    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220544    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:41:59.673910 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220547    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220551    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220553    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220571    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220575    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220578    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220581    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220584    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220587    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220590    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220593    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220595    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220598    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220600    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220603    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220607    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220609    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:41:59.674542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:41:59.220612    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.220617    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.220746    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.223289    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.224932    2581 server.go:1019] "Starting client certificate rotation"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.226437    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.226487    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.227788    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.228922    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.240515    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.243675    2581 log.go:25] "Validated CRI v1 image API"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.245356    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 15:41:59.675155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.251063    2581 fs.go:135] Filesystem UUIDs: map[5d3226b6-d448-4184-897c-e47cd010aa9e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ce9b2586-ff8e-41da-9c98-f5d19f2fe09a:/dev/nvme0n1p4]
Jul 07 15:41:59.675577 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.251077    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 15:41:59.675769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.257816    2581 manager.go:216] Machine: {Timestamp:2026-07-07 15:41:59.25640275 +0000 UTC m=+0.327700902 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100769 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2946c098dce6e8202d6cc22ef11076 SystemUUID:ec2946c0-98dc-e6e8-202d-6cc22ef11076 BootID:e1a3fe32-99f8-4ad5-9aa7-98aacbe41581 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:14:9a:ee:ca:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:14:9a:ee:ca:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:2f:1b:bb:1a:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 15:41:59.675769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.257907    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 15:41:59.675769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.257983    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 15:41:59.675769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.261725    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 15:41:59.675769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.261750    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-7.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 15:41:59.675769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.262582    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 15:41:59.675769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.262591    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 15:41:59.675769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.262599    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.263393    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.265089    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.268386    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269425    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269543    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269585    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269597    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269620    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269630    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269639    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269952    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.269967    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.273791    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.276609    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.276645    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278083    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278099    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278108    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278115    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278128    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278136    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278148    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278156    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278165    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278174    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278192    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.278201    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.279111    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.279120    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.282518    2581 server.go:1268] "Started kubelet"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.282643    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.282652    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.282708    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.284877    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.285292    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.287823    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.287880    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.287990    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-7.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 15:41:59.676179 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.291526    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.287764    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-7.ec2.internal.18c00c3f7e707e7c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-7.ec2.internal,UID:ip-10-0-128-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-7.ec2.internal,},FirstTimestamp:2026-07-07 15:41:59.282491004 +0000 UTC m=+0.353789156,LastTimestamp:2026-07-07 15:41:59.282491004 +0000 UTC m=+0.353789156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-7.ec2.internal,}"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.294488    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.294498    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.294572    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295206    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295204    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295218    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295296    2581 factory.go:55] Registering systemd factory
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295303    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295311    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295313    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295461    2581 factory.go:153] Registering CRI-O factory
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295472    2581 factory.go:223] Registration of the crio container factory successfully
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295511    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295530    2581 factory.go:103] Registering Raw factory
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295544    2581 manager.go:1196] Started watching for new ooms in manager
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.295843    2581 manager.go:349] Starting recovery of all containers
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.304020    2581 manager.go:354] Recovery completed
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.304977    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.305142    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-7.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.309494    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.311102    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.311130    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.311157    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.311647    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.311657    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.311669    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.311673    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.312253    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.312271    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.312280    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.313830    2581 policy_none.go:49] "None policy: Start"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.313842    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 15:41:59.677428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.313859    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 15:41:59.678339 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.315787    2581 policy_none.go:47] "Start"
Jul 07 15:41:59.678339 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.319159    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-7.ec2.internal.18c00c3f80254724  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-7.ec2.internal,UID:ip-10-0-128-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-7.ec2.internal,},FirstTimestamp:2026-07-07 15:41:59.311116068 +0000 UTC m=+0.382414223,LastTimestamp:2026-07-07 15:41:59.311116068 +0000 UTC m=+0.382414223,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-7.ec2.internal,}"
Jul 07 15:41:59.678339 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.322417    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-7.ec2.internal.18c00c3f80258e4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-7.ec2.internal,UID:ip-10-0-128-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-7.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-7.ec2.internal,},FirstTimestamp:2026-07-07 15:41:59.311134284 +0000 UTC m=+0.382432436,LastTimestamp:2026-07-07 15:41:59.311134284 +0000 UTC m=+0.382432436,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-7.ec2.internal,}"
Jul 07 15:41:59.678339 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.330501    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-7.ec2.internal.18c00c3f8025f78a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-7.ec2.internal,UID:ip-10-0-128-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-7.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-7.ec2.internal,},FirstTimestamp:2026-07-07 15:41:59.311161226 +0000 UTC m=+0.382459378,LastTimestamp:2026-07-07 15:41:59.311161226 +0000 UTC m=+0.382459378,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-7.ec2.internal,}"
Jul 07 15:41:59.678339 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.337885    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-7.ec2.internal.18c00c3f80254724\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-7.ec2.internal.18c00c3f80254724  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-7.ec2.internal,UID:ip-10-0-128-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-7.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-7.ec2.internal,},FirstTimestamp:2026-07-07 15:41:59.311116068 +0000 UTC m=+0.382414223,LastTimestamp:2026-07-07 15:41:59.312262691 +0000 UTC m=+0.383560843,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-7.ec2.internal,}"
Jul 07 15:41:59.678339 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.346115    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ld5vh"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.355111    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-7.ec2.internal.18c00c3f80258e4c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-7.ec2.internal.18c00c3f80258e4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-7.ec2.internal,UID:ip-10-0-128-7.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-7.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-7.ec2.internal,},FirstTimestamp:2026-07-07 15:41:59.311134284 +0000 UTC m=+0.382432436,LastTimestamp:2026-07-07 15:41:59.312275092 +0000 UTC m=+0.383573247,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-7.ec2.internal,}"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.356767    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ld5vh"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.377111    2581 manager.go:337] "Starting Device Plugin manager"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.377137    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.377146    2581 server.go:87] "Starting device plugin registration server"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.377365    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.377376    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.377463    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.377545    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.377553    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.378191    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.378232    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.420479    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.421629    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.421659    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.421677    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.421708    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.424316    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.477623    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.478527    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.478555    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.478577    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.478602    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.492216    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.492233    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-7.ec2.internal\": node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.514405    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.522740    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal"]
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.522791    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.523529    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.523555    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:59.678573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.523584    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.526643    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.526744    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.526768    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.527334    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.527353    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.527376    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.527387    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.527354    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.527482    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.529353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.529376    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.530034    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.530067    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.530082    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.580986    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-7.ec2.internal\" not found" node="ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.585462    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-7.ec2.internal\" not found" node="ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.596632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e86357c524e2021f712cdefdd86b20f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal\" (UID: \"e86357c524e2021f712cdefdd86b20f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.596654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e86357c524e2021f712cdefdd86b20f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal\" (UID: \"e86357c524e2021f712cdefdd86b20f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.596670    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6743fb53a9cf62de7101c6de8e19bb65-config\") pod \"kube-apiserver-proxy-ip-10-0-128-7.ec2.internal\" (UID: \"6743fb53a9cf62de7101c6de8e19bb65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.679397 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.614513    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:41:59.834738 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.697199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e86357c524e2021f712cdefdd86b20f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal\" (UID: \"e86357c524e2021f712cdefdd86b20f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.834738 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.697221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6743fb53a9cf62de7101c6de8e19bb65-config\") pod \"kube-apiserver-proxy-ip-10-0-128-7.ec2.internal\" (UID: \"6743fb53a9cf62de7101c6de8e19bb65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.834738 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.697237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e86357c524e2021f712cdefdd86b20f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal\" (UID: \"e86357c524e2021f712cdefdd86b20f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.834738 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.697269    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e86357c524e2021f712cdefdd86b20f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal\" (UID: \"e86357c524e2021f712cdefdd86b20f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.834738 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.697291    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e86357c524e2021f712cdefdd86b20f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal\" (UID: \"e86357c524e2021f712cdefdd86b20f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.834738 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.697310    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6743fb53a9cf62de7101c6de8e19bb65-config\") pod \"kube-apiserver-proxy-ip-10-0-128-7.ec2.internal\" (UID: \"6743fb53a9cf62de7101c6de8e19bb65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.834738 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.715308    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:41:59.834738 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.815385    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:41:59.980386 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.884542    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.980386 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:41:59.888692    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal"
Jul 07 15:41:59.980386 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:41:59.916438    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:42:00.166103 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:00.016895    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:42:00.166103 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:00.117423    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:42:00.360540 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:00.217885    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:42:00.360540 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.220275    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:42:00.360540 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.224462    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 15:42:00.360540 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.224549    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:42:00.360540 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.224609    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:42:00.360540 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:00.318182    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:42:00.360540 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.360324    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 15:37:00 +0000 UTC" deadline="2028-03-29 17:39:41.63562292 +0000 UTC"
Jul 07 15:42:00.360540 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.360351    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15145h57m41.275275444s"
Jul 07 15:42:01.722568 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.393597    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:42:01.722568 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.394449    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:42:01.722568 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.394476    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:42:01.722568 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.394489    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:42:01.722568 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:00.418672    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:42:01.722568 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:00.431030    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:42:01.813901 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:01.734868    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:01.835320    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-7.ec2.internal\" not found"
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:01.849126    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode86357c524e2021f712cdefdd86b20f5.slice/crio-f62f8f297bedf7cbed6c8ce61ff529b6a9d66ae97b3b3bc2ac55ef566f63dd35 WatchSource:0}: Error finding container f62f8f297bedf7cbed6c8ce61ff529b6a9d66ae97b3b3bc2ac55ef566f63dd35: Status 404 returned error can't find the container with id f62f8f297bedf7cbed6c8ce61ff529b6a9d66ae97b3b3bc2ac55ef566f63dd35
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:01.849391    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6743fb53a9cf62de7101c6de8e19bb65.slice/crio-953b2043d5693f5b05b529b6a1c3c4fa11f67890dd5cd5cdcc4ba4e5535110f2 WatchSource:0}: Error finding container 953b2043d5693f5b05b529b6a1c3c4fa11f67890dd5cd5cdcc4ba4e5535110f2: Status 404 returned error can't find the container with id 953b2043d5693f5b05b529b6a1c3c4fa11f67890dd5cd5cdcc4ba4e5535110f2
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:01.853820    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:01.875789    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:01.911370    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal"
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:01.925261    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:01.926110    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal"
Jul 07 15:42:01.958068 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:01.934486    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:42:02.487358 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.487334    2581 apiserver.go:52] "Watching apiserver"
Jul 07 15:42:02.496344 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.495986    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 15:42:02.497899 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.497859    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-xgh8d","openshift-multus/multus-9hjxh","openshift-multus/multus-additional-cni-plugins-ff98w","openshift-multus/network-metrics-daemon-rxh56","kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal","openshift-image-registry/node-ca-2zjct","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal","openshift-network-diagnostics/network-check-target-5lxpc","openshift-network-operator/iptables-alerter-z7fnw","openshift-ovn-kubernetes/ovnkube-node-sj475","kube-system/global-pull-secret-syncer-cwbvk","kube-system/konnectivity-agent-t7frb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm","openshift-cluster-node-tuning-operator/tuned-fwhxl"]
Jul 07 15:42:02.501673 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.501080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.503240 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.503022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.503240 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.503100    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:02.504082 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.504063    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 15:42:02.504166 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.504117    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 15:42:02.504455 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.504248    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hjx4w\""
Jul 07 15:42:02.504455 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.504325    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 15:42:02.504455 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.504337    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 15:42:02.504455 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.504397    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 15:42:02.504707 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.504564    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 15:42:02.505892 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.505551    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.507116 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.507098    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 15:42:02.507635 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.507618    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 15:42:02.507781 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.507649    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 15:42:02.507855 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.507789    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:02.507914 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.507856    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:02.507914 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.507691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xt7wk\""
Jul 07 15:42:02.508461 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.508215    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 15:42:02.508461 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.508222    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 15:42:02.510194 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.510175    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.511208 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.511188    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 15:42:02.512075 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.511911    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:42:02.512075 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.511994    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 15:42:02.512327 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.512307    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.512431 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.512393    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mcb7s\""
Jul 07 15:42:02.514120 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.514101    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 15:42:02.514222 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.514177    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 15:42:02.514802 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.514777    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 15:42:02.514891 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.514858    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rmt8t\""
Jul 07 15:42:02.515192 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.515176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.517856 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.517428    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 15:42:02.517856 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.517507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 15:42:02.517856 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.517634    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d74zx\""
Jul 07 15:42:02.517856 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.517729    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:42:02.518083 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.517864    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.519988 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.519715    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.519988 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.519740    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2n5p4\""
Jul 07 15:42:02.520125 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.520103    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 15:42:02.520340 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.520324    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 15:42:02.520503 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.520364    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 15:42:02.521195 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.521195 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.521398 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521206    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcffp\" (UniqueName: \"kubernetes.io/projected/e462eb51-3312-4c10-b4ed-95708d85ec81-kube-api-access-dcffp\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:02.521398 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysctl-d\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.521398 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysctl-conf\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.521398 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35931c90-c0aa-468c-ac1a-e223d27e720d-tmp\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.521398 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-var-lib-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.521398 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-cni-bin\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-env-overrides\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrsdt\" (UniqueName: \"kubernetes.io/projected/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-kube-api-access-lrsdt\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-sys\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-lib-modules\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521543    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c00bacd2-0897-4e32-9e42-b58deaf50d60-serviceca\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521567    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-os-release\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-var-lib-kubelet\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521662    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58khw\" (UniqueName: \"kubernetes.io/projected/35931c90-c0aa-468c-ac1a-e223d27e720d-kube-api-access-58khw\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b65ae597-c59e-4f76-9812-ae2dc272c84d-dbus\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.521724 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521735    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2p89f\""
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521754    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-slash\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-ovn\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-node-log\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-cni-netd\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovnkube-config\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovnkube-script-lib\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovn-node-metrics-cert\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521926    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-system-cni-dir\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b65ae597-c59e-4f76-9812-ae2dc272c84d-kubelet-config\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.521969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.522297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-kubernetes\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-systemd\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-run\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522124    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-run-netns\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522197    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-run-ovn-kubernetes\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-host\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shj8d\" (UniqueName: \"kubernetes.io/projected/c00bacd2-0897-4e32-9e42-b58deaf50d60-kube-api-access-shj8d\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-systemd-units\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-systemd\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-etc-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-log-socket\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.522998 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckww\" (UniqueName: \"kubernetes.io/projected/7112e2c9-338d-46a7-903a-bf7e9fb60598-kube-api-access-9ckww\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.523805 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-modprobe-d\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.523805 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysconfig\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.523805 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cnibin\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.523805 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-kubelet\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.523805 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-tuned\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.523805 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.522646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c00bacd2-0897-4e32-9e42-b58deaf50d60-host\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.524110 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.523971    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pmqks\""
Jul 07 15:42:02.524161 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.524143    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 15:42:02.524263 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.524244    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 15:42:02.524583 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.524565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:02.524658 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.524625    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:02.526905 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.526887    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:02.528730 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.528710    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 15:42:02.528945 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.528921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xs6gk\""
Jul 07 15:42:02.529036 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.528959    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 15:42:02.551888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.551869    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fszxz"
Jul 07 15:42:02.562566 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.562336    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fszxz"
Jul 07 15:42:02.612931 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.612879    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 15:42:02.623292 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b65ae597-c59e-4f76-9812-ae2dc272c84d-kubelet-config\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.623389 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.623389 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-ovn\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.623389 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623354    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b65ae597-c59e-4f76-9812-ae2dc272c84d-kubelet-config\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.623389 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovnkube-script-lib\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.623572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97263585-1530-4ff1-92ff-e6206533f14b-konnectivity-ca\") pod \"konnectivity-agent-t7frb\" (UID: \"97263585-1530-4ff1-92ff-e6206533f14b\") " pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:02.623572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623423    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-ovn\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.623572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623428    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-device-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.623572 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.623458    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:02.623572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:02.623572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.623572 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.623531    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret podName:b65ae597-c59e-4f76-9812-ae2dc272c84d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:03.123496939 +0000 UTC m=+2.979073816 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret") pod "global-pull-secret-syncer-cwbvk" (UID: "b65ae597-c59e-4f76-9812-ae2dc272c84d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:02.623572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78212b9f-464a-4eac-85c7-6e4598d49713-multus-daemon-config\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbcv\" (UniqueName: \"kubernetes.io/projected/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-kube-api-access-kjbcv\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-host\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-cni-multus\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623642    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623676    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-etc-kubernetes\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623703    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-host\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623745    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-systemd-units\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623778    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-systemd-units\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-etc-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckww\" (UniqueName: \"kubernetes.io/projected/7112e2c9-338d-46a7-903a-bf7e9fb60598-kube-api-access-9ckww\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623820    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-etc-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-modprobe-d\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-tuned\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.623946 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49rlh\" (UniqueName: \"kubernetes.io/projected/78212b9f-464a-4eac-85c7-6e4598d49713-kube-api-access-49rlh\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-kubelet\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-conf-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.623975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-iptables-alerter-script\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-sys-fs\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624001    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-modprobe-d\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624010    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovnkube-script-lib\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624076    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-kubelet\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcffp\" (UniqueName: \"kubernetes.io/projected/e462eb51-3312-4c10-b4ed-95708d85ec81-kube-api-access-dcffp\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysctl-d\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624127    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624152    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysctl-conf\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-cni-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.624604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97263585-1530-4ff1-92ff-e6206533f14b-agent-certs\") pod \"konnectivity-agent-t7frb\" (UID: \"97263585-1530-4ff1-92ff-e6206533f14b\") " pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624199    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624226    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysctl-d\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-registration-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrsdt\" (UniqueName: \"kubernetes.io/projected/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-kube-api-access-lrsdt\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-netns\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624329    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysctl-conf\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-cni-bin\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624380    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf4tr\" (UniqueName: \"kubernetes.io/projected/6d232f46-468a-41e6-8a5f-37c8f6913409-kube-api-access-pf4tr\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsq4s\" (UniqueName: \"kubernetes.io/projected/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-kube-api-access-bsq4s\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-os-release\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-multus-certs\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624506    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-socket-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.625119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624609    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-os-release\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-systemd\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-sys\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624672    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-lib-modules\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b65ae597-c59e-4f76-9812-ae2dc272c84d-dbus\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-slash\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-node-log\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624790    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-lib-modules\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624813    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-slash\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624834    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-sys\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-cni-netd\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovn-node-metrics-cert\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624870    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-node-log\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-system-cni-dir\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-kubernetes\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.625713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.624962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-run\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovnkube-config\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78212b9f-464a-4eac-85c7-6e4598d49713-cni-binary-copy\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-k8s-cni-cncf-io\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625081    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d232f46-468a-41e6-8a5f-37c8f6913409-hosts-file\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-run-netns\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625114    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-run-ovn-kubernetes\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625184    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-kubernetes\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625194    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-run-netns\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625212    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-system-cni-dir\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625234    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-run\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shj8d\" (UniqueName: \"kubernetes.io/projected/c00bacd2-0897-4e32-9e42-b58deaf50d60-kube-api-access-shj8d\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.626427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625326    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b65ae597-c59e-4f76-9812-ae2dc272c84d-dbus\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-systemd\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625369    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-cni-netd\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-log-socket\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysconfig\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c00bacd2-0897-4e32-9e42-b58deaf50d60-host\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-system-cni-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-kubelet\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625634    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cnibin\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-hostroot\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625664    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovnkube-config\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625683    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-host-slash\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.627059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625714    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625715    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625751    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35931c90-c0aa-468c-ac1a-e223d27e720d-tmp\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-cnibin\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d232f46-468a-41e6-8a5f-37c8f6913409-tmp-dir\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-var-lib-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-cni-bin\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-env-overrides\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.625979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c00bacd2-0897-4e32-9e42-b58deaf50d60-serviceca\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-os-release\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626086    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-var-lib-kubelet\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58khw\" (UniqueName: \"kubernetes.io/projected/35931c90-c0aa-468c-ac1a-e223d27e720d-kube-api-access-58khw\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.627656 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626138    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626149    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-socket-dir-parent\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626188    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-log-socket\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-sysconfig\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626299    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cnibin\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626314    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-run-systemd\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-cni-bin\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.626417    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.626463    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs podName:e462eb51-3312-4c10-b4ed-95708d85ec81 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:03.126447443 +0000 UTC m=+2.982024315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs") pod "network-metrics-daemon-rxh56" (UID: "e462eb51-3312-4c10-b4ed-95708d85ec81") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626528    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-systemd\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626552    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7112e2c9-338d-46a7-903a-bf7e9fb60598-env-overrides\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626571    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-host-run-ovn-kubernetes\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626603    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c00bacd2-0897-4e32-9e42-b58deaf50d60-host\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626827    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7112e2c9-338d-46a7-903a-bf7e9fb60598-var-lib-openvswitch\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.628363 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626835    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c00bacd2-0897-4e32-9e42-b58deaf50d60-serviceca\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.629084 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.626913    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/35931c90-c0aa-468c-ac1a-e223d27e720d-var-lib-kubelet\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.629084 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.627012    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.629084 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.628640    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7112e2c9-338d-46a7-903a-bf7e9fb60598-ovn-node-metrics-cert\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.629389 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.629356    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/35931c90-c0aa-468c-ac1a-e223d27e720d-tmp\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.629665 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.629642    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/35931c90-c0aa-468c-ac1a-e223d27e720d-etc-tuned\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.637394 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.637345    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrsdt\" (UniqueName: \"kubernetes.io/projected/1c21f7cb-a91f-4e4c-a78a-213e0d8149ec-kube-api-access-lrsdt\") pod \"multus-additional-cni-plugins-ff98w\" (UID: \"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec\") " pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.637394 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.637368    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckww\" (UniqueName: \"kubernetes.io/projected/7112e2c9-338d-46a7-903a-bf7e9fb60598-kube-api-access-9ckww\") pod \"ovnkube-node-sj475\" (UID: \"7112e2c9-338d-46a7-903a-bf7e9fb60598\") " pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.638185 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.638164    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58khw\" (UniqueName: \"kubernetes.io/projected/35931c90-c0aa-468c-ac1a-e223d27e720d-kube-api-access-58khw\") pod \"tuned-fwhxl\" (UID: \"35931c90-c0aa-468c-ac1a-e223d27e720d\") " pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.639970 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.639945    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shj8d\" (UniqueName: \"kubernetes.io/projected/c00bacd2-0897-4e32-9e42-b58deaf50d60-kube-api-access-shj8d\") pod \"node-ca-2zjct\" (UID: \"c00bacd2-0897-4e32-9e42-b58deaf50d60\") " pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.640435 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.640413    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcffp\" (UniqueName: \"kubernetes.io/projected/e462eb51-3312-4c10-b4ed-95708d85ec81-kube-api-access-dcffp\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:02.642596 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.642553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal" event={"ID":"e86357c524e2021f712cdefdd86b20f5","Type":"ContainerStarted","Data":"f62f8f297bedf7cbed6c8ce61ff529b6a9d66ae97b3b3bc2ac55ef566f63dd35"}
Jul 07 15:42:02.643718 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.643664    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal" event={"ID":"6743fb53a9cf62de7101c6de8e19bb65","Type":"ContainerStarted","Data":"953b2043d5693f5b05b529b6a1c3c4fa11f67890dd5cd5cdcc4ba4e5535110f2"}
Jul 07 15:42:02.727201 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97263585-1530-4ff1-92ff-e6206533f14b-konnectivity-ca\") pod \"konnectivity-agent-t7frb\" (UID: \"97263585-1530-4ff1-92ff-e6206533f14b\") " pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:02.727332 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-device-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.727332 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:02.727332 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78212b9f-464a-4eac-85c7-6e4598d49713-multus-daemon-config\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727332 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbcv\" (UniqueName: \"kubernetes.io/projected/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-kube-api-access-kjbcv\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.727500 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-cni-multus\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727500 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-etc-kubernetes\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727500 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49rlh\" (UniqueName: \"kubernetes.io/projected/78212b9f-464a-4eac-85c7-6e4598d49713-kube-api-access-49rlh\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727500 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-conf-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727500 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-iptables-alerter-script\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.727500 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-sys-fs\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.727500 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727489    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-cni-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97263585-1530-4ff1-92ff-e6206533f14b-agent-certs\") pod \"konnectivity-agent-t7frb\" (UID: \"97263585-1530-4ff1-92ff-e6206533f14b\") " pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-registration-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-netns\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-cni-bin\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf4tr\" (UniqueName: \"kubernetes.io/projected/6d232f46-468a-41e6-8a5f-37c8f6913409-kube-api-access-pf4tr\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsq4s\" (UniqueName: \"kubernetes.io/projected/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-kube-api-access-bsq4s\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-multus-certs\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-socket-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.727814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78212b9f-464a-4eac-85c7-6e4598d49713-cni-binary-copy\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728131 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727811    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-sys-fs\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.728131 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727817    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-conf-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728131 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727890    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-registration-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.728131 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.727946    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-cni-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728333 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728162    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-cni-bin\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728333 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728228    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-multus-certs\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728333 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728269    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-netns\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728333 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-k8s-cni-cncf-io\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d232f46-468a-41e6-8a5f-37c8f6913409-hosts-file\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.728529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728348    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/78212b9f-464a-4eac-85c7-6e4598d49713-multus-daemon-config\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728331    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/78212b9f-464a-4eac-85c7-6e4598d49713-cni-binary-copy\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-device-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.728529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728387    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-cni-multus\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728391    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-run-k8s-cni-cncf-io\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728458    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/97263585-1530-4ff1-92ff-e6206533f14b-konnectivity-ca\") pod \"konnectivity-agent-t7frb\" (UID: \"97263585-1530-4ff1-92ff-e6206533f14b\") " pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:02.728529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728475    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-etc-kubernetes\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-system-cni-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728596    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-system-cni-dir\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-kubelet\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728700    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-host-var-lib-kubelet\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728661    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d232f46-468a-41e6-8a5f-37c8f6913409-hosts-file\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-hostroot\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-host-slash\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728727    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-socket-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728775    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-host-slash\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728763    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-hostroot\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-cnibin\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d232f46-468a-41e6-8a5f-37c8f6913409-tmp-dir\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.728888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.728853    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-cnibin\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.729822 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.729801    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-iptables-alerter-script\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.730177 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.730000    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-os-release\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.730177 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.730135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-os-release\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.730325 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.730177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.730325 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.730136    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d232f46-468a-41e6-8a5f-37c8f6913409-tmp-dir\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.730325 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.730231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-socket-dir-parent\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.730325 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.730304    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/78212b9f-464a-4eac-85c7-6e4598d49713-multus-socket-dir-parent\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.730515 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.730396    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-etc-selinux\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.732684 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.731319    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/97263585-1530-4ff1-92ff-e6206533f14b-agent-certs\") pod \"konnectivity-agent-t7frb\" (UID: \"97263585-1530-4ff1-92ff-e6206533f14b\") " pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:02.735720 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.735700    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:42:02.735720 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.735724    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:42:02.735720 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.735735    2581 projected.go:196] Error preparing data for projected volume kube-api-access-npjts for pod openshift-network-diagnostics/network-check-target-5lxpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:02.735958 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:02.735794    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts podName:f8c379f0-b25d-4fbe-b912-0288f27a2d6c nodeName:}" failed. No retries permitted until 2026-07-07 15:42:03.235777078 +0000 UTC m=+3.091353936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-npjts" (UniqueName: "kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts") pod "network-check-target-5lxpc" (UID: "f8c379f0-b25d-4fbe-b912-0288f27a2d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:02.738108 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.738080    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf4tr\" (UniqueName: \"kubernetes.io/projected/6d232f46-468a-41e6-8a5f-37c8f6913409-kube-api-access-pf4tr\") pod \"node-resolver-xgh8d\" (UID: \"6d232f46-468a-41e6-8a5f-37c8f6913409\") " pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.738197 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.738095    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49rlh\" (UniqueName: \"kubernetes.io/projected/78212b9f-464a-4eac-85c7-6e4598d49713-kube-api-access-49rlh\") pod \"multus-9hjxh\" (UID: \"78212b9f-464a-4eac-85c7-6e4598d49713\") " pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.740038 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.740020    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbcv\" (UniqueName: \"kubernetes.io/projected/4c3b05e3-ace5-45cf-85e4-5b92e5509c96-kube-api-access-kjbcv\") pod \"iptables-alerter-z7fnw\" (UID: \"4c3b05e3-ace5-45cf-85e4-5b92e5509c96\") " pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.740247 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.740229    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsq4s\" (UniqueName: \"kubernetes.io/projected/ad978853-1ea2-4ffc-9bd7-fd58de4e28d0-kube-api-access-bsq4s\") pod \"aws-ebs-csi-driver-node-622mm\" (UID: \"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.814702 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.814673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:02.823755 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.823735    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ff98w"
Jul 07 15:42:02.832641 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.832614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fwhxl"
Jul 07 15:42:02.839417 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.839332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2zjct"
Jul 07 15:42:02.847769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.847713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z7fnw"
Jul 07 15:42:02.855673 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.855653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm"
Jul 07 15:42:02.864491 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.864443    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hjxh"
Jul 07 15:42:02.872047 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.872017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xgh8d"
Jul 07 15:42:02.879672 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.879655    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:02.968042 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:02.968016    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:42:03.133649 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:03.133582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:03.133649 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:03.133631    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:03.133825 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.133722    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:03.133825 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.133754    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:03.133825 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.133785    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs podName:e462eb51-3312-4c10-b4ed-95708d85ec81 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:04.133769681 +0000 UTC m=+3.989346538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs") pod "network-metrics-daemon-rxh56" (UID: "e462eb51-3312-4c10-b4ed-95708d85ec81") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:03.133825 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.133799    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret podName:b65ae597-c59e-4f76-9812-ae2dc272c84d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:04.133792941 +0000 UTC m=+3.989369798 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret") pod "global-pull-secret-syncer-cwbvk" (UID: "b65ae597-c59e-4f76-9812-ae2dc272c84d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:03.336200 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:03.336166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:03.336394 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.336338    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:42:03.336394 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.336357    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:42:03.336394 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.336367    2581 projected.go:196] Error preparing data for projected volume kube-api-access-npjts for pod openshift-network-diagnostics/network-check-target-5lxpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:03.336559 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.336427    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts podName:f8c379f0-b25d-4fbe-b912-0288f27a2d6c nodeName:}" failed. No retries permitted until 2026-07-07 15:42:04.336410036 +0000 UTC m=+4.191986912 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-npjts" (UniqueName: "kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts") pod "network-check-target-5lxpc" (UID: "f8c379f0-b25d-4fbe-b912-0288f27a2d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:03.566090 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:03.566008    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:37:02 +0000 UTC" deadline="2028-03-12 04:37:57.166347291 +0000 UTC"
Jul 07 15:42:03.566090 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:03.566045    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14724h55m53.600307803s"
Jul 07 15:42:03.637604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:03.637575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:03.638122 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:03.637698    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:03.799783 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:03.799754    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3b05e3_ace5_45cf_85e4_5b92e5509c96.slice/crio-15460fb6e8832ca0f823f1410b8cbe40f9f52f4934ecb704c4d9660d83bf0fc8 WatchSource:0}: Error finding container 15460fb6e8832ca0f823f1410b8cbe40f9f52f4934ecb704c4d9660d83bf0fc8: Status 404 returned error can't find the container with id 15460fb6e8832ca0f823f1410b8cbe40f9f52f4934ecb704c4d9660d83bf0fc8
Jul 07 15:42:03.802555 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:03.802529    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad978853_1ea2_4ffc_9bd7_fd58de4e28d0.slice/crio-f8a5e635a1f518c525a00c7f17986cb3ee469956977cd5cbde278af43fa8a397 WatchSource:0}: Error finding container f8a5e635a1f518c525a00c7f17986cb3ee469956977cd5cbde278af43fa8a397: Status 404 returned error can't find the container with id f8a5e635a1f518c525a00c7f17986cb3ee469956977cd5cbde278af43fa8a397
Jul 07 15:42:03.805835 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:03.805683    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d232f46_468a_41e6_8a5f_37c8f6913409.slice/crio-dd1ee4bdd776bd7fa5dad9364324c2f5b316861afb449946ed9f60b1277d4ed7 WatchSource:0}: Error finding container dd1ee4bdd776bd7fa5dad9364324c2f5b316861afb449946ed9f60b1277d4ed7: Status 404 returned error can't find the container with id dd1ee4bdd776bd7fa5dad9364324c2f5b316861afb449946ed9f60b1277d4ed7
Jul 07 15:42:03.806338 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:03.806269    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35931c90_c0aa_468c_ac1a_e223d27e720d.slice/crio-fbd9955bce1abe0129c5b9f345ffb18500321758199e53ffc7731e5c4248dac6 WatchSource:0}: Error finding container fbd9955bce1abe0129c5b9f345ffb18500321758199e53ffc7731e5c4248dac6: Status 404 returned error can't find the container with id fbd9955bce1abe0129c5b9f345ffb18500321758199e53ffc7731e5c4248dac6
Jul 07 15:42:03.827093 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:03.827069    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00bacd2_0897_4e32_9e42_b58deaf50d60.slice/crio-1a97a6f40feb4bf681d85f16b97840d482f2fa9f48678bc6de067a83f494472d WatchSource:0}: Error finding container 1a97a6f40feb4bf681d85f16b97840d482f2fa9f48678bc6de067a83f494472d: Status 404 returned error can't find the container with id 1a97a6f40feb4bf681d85f16b97840d482f2fa9f48678bc6de067a83f494472d
Jul 07 15:42:03.828263 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:03.828233    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c21f7cb_a91f_4e4c_a78a_213e0d8149ec.slice/crio-5e5421d98602f8e95d38edd2cab7cfb08f406cc0a08337cbbe6c219a228502a0 WatchSource:0}: Error finding container 5e5421d98602f8e95d38edd2cab7cfb08f406cc0a08337cbbe6c219a228502a0: Status 404 returned error can't find the container with id 5e5421d98602f8e95d38edd2cab7cfb08f406cc0a08337cbbe6c219a228502a0
Jul 07 15:42:03.828859 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:03.828834    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7112e2c9_338d_46a7_903a_bf7e9fb60598.slice/crio-793b941787187f80672002d0214644b2f21b8007b70429a2075d20e0eae11898 WatchSource:0}: Error finding container 793b941787187f80672002d0214644b2f21b8007b70429a2075d20e0eae11898: Status 404 returned error can't find the container with id 793b941787187f80672002d0214644b2f21b8007b70429a2075d20e0eae11898
Jul 07 15:42:03.830246 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:03.830231    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78212b9f_464a_4eac_85c7_6e4598d49713.slice/crio-40e5c93716773851c2f56e0e7177ff462ebf20a41ee57380bb0d01b1d71796e3 WatchSource:0}: Error finding container 40e5c93716773851c2f56e0e7177ff462ebf20a41ee57380bb0d01b1d71796e3: Status 404 returned error can't find the container with id 40e5c93716773851c2f56e0e7177ff462ebf20a41ee57380bb0d01b1d71796e3
Jul 07 15:42:03.831445 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:03.831416    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:42:04.141476 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.141319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:04.141561 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.141501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:04.141561 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.141453    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:04.141624 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.141588    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs podName:e462eb51-3312-4c10-b4ed-95708d85ec81 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:06.141573389 +0000 UTC m=+5.997150246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs") pod "network-metrics-daemon-rxh56" (UID: "e462eb51-3312-4c10-b4ed-95708d85ec81") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:04.141624 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.141592    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:04.141687 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.141629    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret podName:b65ae597-c59e-4f76-9812-ae2dc272c84d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:06.141615911 +0000 UTC m=+5.997192768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret") pod "global-pull-secret-syncer-cwbvk" (UID: "b65ae597-c59e-4f76-9812-ae2dc272c84d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:04.343369 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.343182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:04.343515 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.343366    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:42:04.343515 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.343387    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:42:04.343515 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.343400    2581 projected.go:196] Error preparing data for projected volume kube-api-access-npjts for pod openshift-network-diagnostics/network-check-target-5lxpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:04.343515 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.343463    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts podName:f8c379f0-b25d-4fbe-b912-0288f27a2d6c nodeName:}" failed. No retries permitted until 2026-07-07 15:42:06.343444545 +0000 UTC m=+6.199021404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-npjts" (UniqueName: "kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts") pod "network-check-target-5lxpc" (UID: "f8c379f0-b25d-4fbe-b912-0288f27a2d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:04.567231 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.567189    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:37:02 +0000 UTC" deadline="2028-02-29 02:39:40.986280815 +0000 UTC"
Jul 07 15:42:04.567231 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.567231    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14434h57m36.419055188s"
Jul 07 15:42:04.640074 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.639514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:04.640074 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.639649    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:04.642324 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.642066    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:04.642324 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:04.642231    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:04.665948 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.665920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t7frb" event={"ID":"97263585-1530-4ff1-92ff-e6206533f14b","Type":"ContainerStarted","Data":"f45919adb94a755d8a84ef305817c53c6d4b7f5ab8820a927a745dbd5fd35aec"}
Jul 07 15:42:04.675847 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.675817    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hjxh" event={"ID":"78212b9f-464a-4eac-85c7-6e4598d49713","Type":"ContainerStarted","Data":"40e5c93716773851c2f56e0e7177ff462ebf20a41ee57380bb0d01b1d71796e3"}
Jul 07 15:42:04.690837 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.690804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff98w" event={"ID":"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec","Type":"ContainerStarted","Data":"5e5421d98602f8e95d38edd2cab7cfb08f406cc0a08337cbbe6c219a228502a0"}
Jul 07 15:42:04.709453 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.709126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2zjct" event={"ID":"c00bacd2-0897-4e32-9e42-b58deaf50d60","Type":"ContainerStarted","Data":"1a97a6f40feb4bf681d85f16b97840d482f2fa9f48678bc6de067a83f494472d"}
Jul 07 15:42:04.728008 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.727923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fwhxl" event={"ID":"35931c90-c0aa-468c-ac1a-e223d27e720d","Type":"ContainerStarted","Data":"fbd9955bce1abe0129c5b9f345ffb18500321758199e53ffc7731e5c4248dac6"}
Jul 07 15:42:04.748741 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.748503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm" event={"ID":"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0","Type":"ContainerStarted","Data":"f8a5e635a1f518c525a00c7f17986cb3ee469956977cd5cbde278af43fa8a397"}
Jul 07 15:42:04.761328 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.761299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal" event={"ID":"6743fb53a9cf62de7101c6de8e19bb65","Type":"ContainerStarted","Data":"297146b9647b69eb5795c5cdf5836e7cf0300629a76d761abe5f66d68fd9f84a"}
Jul 07 15:42:04.766846 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.766820    2581 generic.go:356] "Generic (PLEG): container finished" podID="e86357c524e2021f712cdefdd86b20f5" containerID="df1e82e1a5de9200a0b7a012ac2cfcd3b3dfc54448125fb3f411e9f588118007" exitCode=0
Jul 07 15:42:04.766930 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.766905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal" event={"ID":"e86357c524e2021f712cdefdd86b20f5","Type":"ContainerDied","Data":"df1e82e1a5de9200a0b7a012ac2cfcd3b3dfc54448125fb3f411e9f588118007"}
Jul 07 15:42:04.770519 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.770432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"793b941787187f80672002d0214644b2f21b8007b70429a2075d20e0eae11898"}
Jul 07 15:42:04.787059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.786996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xgh8d" event={"ID":"6d232f46-468a-41e6-8a5f-37c8f6913409","Type":"ContainerStarted","Data":"dd1ee4bdd776bd7fa5dad9364324c2f5b316861afb449946ed9f60b1277d4ed7"}
Jul 07 15:42:04.792566 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.792541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z7fnw" event={"ID":"4c3b05e3-ace5-45cf-85e4-5b92e5509c96","Type":"ContainerStarted","Data":"15460fb6e8832ca0f823f1410b8cbe40f9f52f4934ecb704c4d9660d83bf0fc8"}
Jul 07 15:42:04.812292 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:04.812237    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-7.ec2.internal" podStartSLOduration=3.812224812 podStartE2EDuration="3.812224812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:04.787359742 +0000 UTC m=+4.642936619" watchObservedRunningTime="2026-07-07 15:42:04.812224812 +0000 UTC m=+4.667801691"
Jul 07 15:42:05.638215 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:05.638185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:05.638397 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:05.638328    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:05.815226 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:05.815196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal" event={"ID":"e86357c524e2021f712cdefdd86b20f5","Type":"ContainerStarted","Data":"25b82300943d65a1200c365deb0e0a11a4a99fb1221e3dc6a77981610d0d8b53"}
Jul 07 15:42:06.156593 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:06.156556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:06.156761 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:06.156615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:06.156761 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.156725    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:06.156761 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.156726    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:06.156938 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.156790    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret podName:b65ae597-c59e-4f76-9812-ae2dc272c84d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:10.156772657 +0000 UTC m=+10.012349517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret") pod "global-pull-secret-syncer-cwbvk" (UID: "b65ae597-c59e-4f76-9812-ae2dc272c84d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:06.156938 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.156810    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs podName:e462eb51-3312-4c10-b4ed-95708d85ec81 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:10.15679989 +0000 UTC m=+10.012376752 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs") pod "network-metrics-daemon-rxh56" (UID: "e462eb51-3312-4c10-b4ed-95708d85ec81") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:06.359127 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:06.359079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:06.359404 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.359262    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:42:06.359404 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.359300    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:42:06.359404 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.359315    2581 projected.go:196] Error preparing data for projected volume kube-api-access-npjts for pod openshift-network-diagnostics/network-check-target-5lxpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:06.359404 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.359372    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts podName:f8c379f0-b25d-4fbe-b912-0288f27a2d6c nodeName:}" failed. No retries permitted until 2026-07-07 15:42:10.359353734 +0000 UTC m=+10.214930594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-npjts" (UniqueName: "kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts") pod "network-check-target-5lxpc" (UID: "f8c379f0-b25d-4fbe-b912-0288f27a2d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:06.639144 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:06.638679    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:06.639144 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:06.638687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:06.639144 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.638799    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:06.639144 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:06.638904    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:07.637595 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:07.637563    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:07.638067 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:07.637692    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:08.638025 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:08.637904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:08.638025 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:08.637929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:08.638619 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:08.638085    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:08.638619 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:08.638552    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:09.638070 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:09.638013    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:09.638533 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:09.638131    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:10.197496 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:10.197244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:10.197496 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:10.197325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:10.197496 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.197372    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:10.197496 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.197436    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs podName:e462eb51-3312-4c10-b4ed-95708d85ec81 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:18.197417779 +0000 UTC m=+18.052994663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs") pod "network-metrics-daemon-rxh56" (UID: "e462eb51-3312-4c10-b4ed-95708d85ec81") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:10.197496 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.197439    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:10.197496 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.197472    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret podName:b65ae597-c59e-4f76-9812-ae2dc272c84d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:18.197462348 +0000 UTC m=+18.053039204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret") pod "global-pull-secret-syncer-cwbvk" (UID: "b65ae597-c59e-4f76-9812-ae2dc272c84d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:10.399663 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:10.399584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:10.399832 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.399748    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:42:10.399832 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.399771    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:42:10.399832 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.399784    2581 projected.go:196] Error preparing data for projected volume kube-api-access-npjts for pod openshift-network-diagnostics/network-check-target-5lxpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:10.400001 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.399846    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts podName:f8c379f0-b25d-4fbe-b912-0288f27a2d6c nodeName:}" failed. No retries permitted until 2026-07-07 15:42:18.39982867 +0000 UTC m=+18.255405543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-npjts" (UniqueName: "kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts") pod "network-check-target-5lxpc" (UID: "f8c379f0-b25d-4fbe-b912-0288f27a2d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:10.639846 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:10.639391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:10.639846 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.639506    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:10.639846 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:10.639737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:10.639846 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:10.639844    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:11.638585 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:11.638559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:11.638744 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:11.638665    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:12.638345 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:12.638033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:12.638345 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:12.638177    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:12.639915 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:12.638411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:12.639915 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:12.638525    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:13.637643 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:13.637591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:13.637805 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:13.637717    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:14.638598 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:14.638567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:14.639056 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:14.638714    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:14.639056 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:14.638768    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:14.639056 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:14.638896    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:15.637921 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:15.637887    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:15.638126 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:15.638012    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:16.638146 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:16.638111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:16.638593 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:16.638151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:16.638593 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:16.638236    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:16.638593 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:16.638381    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:17.637606 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:17.637567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:17.637814 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:17.637670    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:18.258059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:18.257987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:18.258059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:18.258051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:18.258491 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.258108    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:18.258491 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.258148    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:18.258491 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.258181    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs podName:e462eb51-3312-4c10-b4ed-95708d85ec81 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:34.258165072 +0000 UTC m=+34.113741932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs") pod "network-metrics-daemon-rxh56" (UID: "e462eb51-3312-4c10-b4ed-95708d85ec81") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:18.258491 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.258197    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret podName:b65ae597-c59e-4f76-9812-ae2dc272c84d nodeName:}" failed. No retries permitted until 2026-07-07 15:42:34.258190299 +0000 UTC m=+34.113767156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret") pod "global-pull-secret-syncer-cwbvk" (UID: "b65ae597-c59e-4f76-9812-ae2dc272c84d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:18.459903 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:18.459872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:18.460091 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.460071    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:42:18.460147 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.460096    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:42:18.460147 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.460107    2581 projected.go:196] Error preparing data for projected volume kube-api-access-npjts for pod openshift-network-diagnostics/network-check-target-5lxpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:18.460223 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.460183    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts podName:f8c379f0-b25d-4fbe-b912-0288f27a2d6c nodeName:}" failed. No retries permitted until 2026-07-07 15:42:34.460153209 +0000 UTC m=+34.315730090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-npjts" (UniqueName: "kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts") pod "network-check-target-5lxpc" (UID: "f8c379f0-b25d-4fbe-b912-0288f27a2d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:18.637922 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:18.637893    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:18.638114 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:18.637929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:18.638114 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.638028    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:18.638295 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:18.638254    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:19.638141 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:19.638106    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:19.638569 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:19.638244    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:20.639754 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:20.639711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:20.640198 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:20.639885    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:20.640371 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:20.640353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:20.640500 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:20.640480    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:21.638170 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:21.638138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:21.638369 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:21.638255    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:22.637630 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.637606    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:22.638123 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:22.637727    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:22.638123 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.637812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:22.638123 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:22.637899    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:22.848713 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.848542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t7frb" event={"ID":"97263585-1530-4ff1-92ff-e6206533f14b","Type":"ContainerStarted","Data":"f1225936674d4afa1300bec2f7cdf8668019f91f64501e94054c109cbce63269"}
Jul 07 15:42:22.849863 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.849832    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hjxh" event={"ID":"78212b9f-464a-4eac-85c7-6e4598d49713","Type":"ContainerStarted","Data":"7b7a65eea7a326e2c874bef378309129fe0ba8d94cd5edfc61ac4adce13f2a73"}
Jul 07 15:42:22.851193 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.851171    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c21f7cb-a91f-4e4c-a78a-213e0d8149ec" containerID="4ef256f0bcf4e4f6af07c1f9dc2b0d589f0e0e0043279ecdddfee767657df010" exitCode=0
Jul 07 15:42:22.851297 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.851236    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff98w" event={"ID":"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec","Type":"ContainerDied","Data":"4ef256f0bcf4e4f6af07c1f9dc2b0d589f0e0e0043279ecdddfee767657df010"}
Jul 07 15:42:22.852668 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.852646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2zjct" event={"ID":"c00bacd2-0897-4e32-9e42-b58deaf50d60","Type":"ContainerStarted","Data":"929918c96a6d8dc47ae791b196bc3f807570c0e41a04b1f33f8b5e79d876ef9d"}
Jul 07 15:42:22.854041 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.854014    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fwhxl" event={"ID":"35931c90-c0aa-468c-ac1a-e223d27e720d","Type":"ContainerStarted","Data":"b5ce13986e61a945798f91aca8f9901c3329bcfdc565d9e6f4db3fe64b058c70"}
Jul 07 15:42:22.855384 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.855359    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm" event={"ID":"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0","Type":"ContainerStarted","Data":"e77805c29fdfdd9f89ee922e06d301cb2c95b2e8b7113add952f9c311b9a392f"}
Jul 07 15:42:22.857612 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.857592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"74a1f5e0591ff9377dc9f9a7ef509d615642c669fd400956a4e68a1c0f8d4576"}
Jul 07 15:42:22.857690 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.857662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"660eb12720288f32170c6d5980e9ab5bcbb6375820fff2d6b4d71cb051bfd894"}
Jul 07 15:42:22.857748 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.857714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"98dab7285a9ebc3a3ed84fc72510ea92593103b429ec95ac978d829bedca32c0"}
Jul 07 15:42:22.859030 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.859012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xgh8d" event={"ID":"6d232f46-468a-41e6-8a5f-37c8f6913409","Type":"ContainerStarted","Data":"199aca5f118dd93243fb70939c585ff65c7d3ebafab31c06fa271293357470eb"}
Jul 07 15:42:22.881251 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.881213    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-7.ec2.internal" podStartSLOduration=21.881202118 podStartE2EDuration="21.881202118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:05.842053618 +0000 UTC m=+5.697630499" watchObservedRunningTime="2026-07-07 15:42:22.881202118 +0000 UTC m=+22.736778996"
Jul 07 15:42:22.905597 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.905561    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9hjxh" podStartSLOduration=4.228743983 podStartE2EDuration="22.90554846s" totalImagesPullingTime="18.676804477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:22.90500366 +0000 UTC m=+22.760580538" watchObservedRunningTime="2026-07-07 15:42:22.90554846 +0000 UTC m=+22.761125317"
Jul 07 15:42:22.924531 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.924491    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xgh8d" podStartSLOduration=4.306864511 podStartE2EDuration="22.924481286s" totalImagesPullingTime="18.617616775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:22.924421352 +0000 UTC m=+22.779998231" watchObservedRunningTime="2026-07-07 15:42:22.924481286 +0000 UTC m=+22.780058165"
Jul 07 15:42:22.948616 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.948585    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fwhxl" podStartSLOduration=4.329390591 podStartE2EDuration="22.948574547s" totalImagesPullingTime="18.619183956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:22.948177061 +0000 UTC m=+22.803753940" watchObservedRunningTime="2026-07-07 15:42:22.948574547 +0000 UTC m=+22.804151426"
Jul 07 15:42:22.965925 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.965870    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t7frb" podStartSLOduration=8.823430665 podStartE2EDuration="22.965860154s" totalImagesPullingTime="14.142429489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:22.965667393 +0000 UTC m=+22.821244273" watchObservedRunningTime="2026-07-07 15:42:22.965860154 +0000 UTC m=+22.821437033"
Jul 07 15:42:22.989531 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:22.989502    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2zjct" podStartSLOduration=12.520788063 podStartE2EDuration="22.989491954s" totalImagesPullingTime="10.468703891s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:22.989463883 +0000 UTC m=+22.845040762" watchObservedRunningTime="2026-07-07 15:42:22.989491954 +0000 UTC m=+22.845068833"
Jul 07 15:42:23.638565 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:23.638534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:23.639372 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:23.638654    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:23.862214 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:23.862176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z7fnw" event={"ID":"4c3b05e3-ace5-45cf-85e4-5b92e5509c96","Type":"ContainerStarted","Data":"e955f68122c59a1949571b2c166cbf11a2f358af831242ddb20a3b29bfc6b08b"}
Jul 07 15:42:23.865405 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:23.865374    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"e1b33936bfbce3dbf514b527fe387beaaa6e265f0ce129023d120170c110d594"}
Jul 07 15:42:23.865538 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:23.865459    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"a1a300efa4b1ca5fb7d07cbb86de80c91bc64042b981831588deff35122b725b"}
Jul 07 15:42:23.865538 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:23.865510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"3d75052aab0e210981d6dacc3281ca605f8d0b5fbce09b1734d6076eb672475b"}
Jul 07 15:42:23.884244 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:23.884189    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z7fnw" podStartSLOduration=5.243501319 podStartE2EDuration="23.884170554s" totalImagesPullingTime="18.640669235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:23.884015429 +0000 UTC m=+23.739592308" watchObservedRunningTime="2026-07-07 15:42:23.884170554 +0000 UTC m=+23.739747434"
Jul 07 15:42:24.028882 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.028856    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 15:42:24.607093 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.606992    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:42:24.028879389Z","UUID":"7cd666e3-2deb-4695-8711-e07b46ad6047","Handler":null,"Name":"","Endpoint":""}
Jul 07 15:42:24.608801 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.608773    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 15:42:24.608924 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.608819    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 15:42:24.638169 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.638145    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:24.638317 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.638150    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:24.638317 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:24.638264    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:24.638436 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:24.638402    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:24.850025 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.849995    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:24.850499 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.850483    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:24.870146 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.870070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm" event={"ID":"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0","Type":"ContainerStarted","Data":"dc31be785073dd92d2fa322cd4d13e13b52bf10d49364e6498660136b8bb1225"}
Jul 07 15:42:24.870408 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.870358    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:24.870818 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:24.870803    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t7frb"
Jul 07 15:42:25.637619 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:25.637589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:25.637738 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:25.637714    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:25.874387 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:25.874350    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm" event={"ID":"ad978853-1ea2-4ffc-9bd7-fd58de4e28d0","Type":"ContainerStarted","Data":"23082dc5e640a46214404029595ff7f4964f00b62b7f26d6811d30afdbb741ca"}
Jul 07 15:42:25.877938 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:25.877910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"4645bfa89eb033f5aaba4cd4a42859d297ec7d397dac6ba66bce83a7a9c999cb"}
Jul 07 15:42:25.897366 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:25.897317    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-622mm" podStartSLOduration=4.633379919 podStartE2EDuration="25.897300046s" totalImagesPullingTime="21.263920127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:25.896845033 +0000 UTC m=+25.752421926" watchObservedRunningTime="2026-07-07 15:42:25.897300046 +0000 UTC m=+25.752876920"
Jul 07 15:42:26.637949 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:26.637919    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:26.637949 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:26.637947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:26.638200 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:26.638039    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:26.638200 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:26.638184    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:27.637609 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.637585    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:27.638120 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:27.637708    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:27.883454 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.883295    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c21f7cb-a91f-4e4c-a78a-213e0d8149ec" containerID="7ace9198df645e47d4c4e92891da0b2673b2f11fda6948eb7103d03e4e40519a" exitCode=0
Jul 07 15:42:27.883592 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.883347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff98w" event={"ID":"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec","Type":"ContainerDied","Data":"7ace9198df645e47d4c4e92891da0b2673b2f11fda6948eb7103d03e4e40519a"}
Jul 07 15:42:27.887063 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.887045    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" event={"ID":"7112e2c9-338d-46a7-903a-bf7e9fb60598","Type":"ContainerStarted","Data":"3560c63cdea08b7eadedd1da9e3c1b9373abd8854cc193260aea379882c698c7"}
Jul 07 15:42:27.887419 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.887399    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:27.887505 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.887461    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:27.887505 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.887490    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:27.903793 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.903772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:27.903926 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.903893    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:27.942193 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:27.942155    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-sj475" podStartSLOduration=9.267761839 podStartE2EDuration="27.942143723s" totalImagesPullingTime="18.674381884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:27.941251627 +0000 UTC m=+27.796828530" watchObservedRunningTime="2026-07-07 15:42:27.942143723 +0000 UTC m=+27.797720601"
Jul 07 15:42:28.395125 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:28.395092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t7frb_97263585-1530-4ff1-92ff-e6206533f14b/konnectivity-agent/0.log" limit=1024
Jul 07 15:42:28.502072 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:28.502032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-t7frb_97263585-1530-4ff1-92ff-e6206533f14b/konnectivity-agent/0.log" limit=1024
Jul 07 15:42:28.637793 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:28.637764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:28.638396 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:28.637872    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:28.638396 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:28.637927    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:28.638396 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:28.638021    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:29.637674 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.637652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:29.637785 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:29.637743    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:29.693511 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.693483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cwbvk"]
Jul 07 15:42:29.693826 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.693586    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:29.693826 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:29.693666    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:29.696346 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.696314    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5lxpc"]
Jul 07 15:42:29.700869 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.700847    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxh56"]
Jul 07 15:42:29.700957 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.700929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:29.701046 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:29.701024    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:29.893181 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.893157    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c21f7cb-a91f-4e4c-a78a-213e0d8149ec" containerID="1744faf0dd6640b1b975849bdc7bbd30afc40e5ecef2c7038663fa183cd28a6f" exitCode=0
Jul 07 15:42:29.893376 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.893230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff98w" event={"ID":"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec","Type":"ContainerDied","Data":"1744faf0dd6640b1b975849bdc7bbd30afc40e5ecef2c7038663fa183cd28a6f"}
Jul 07 15:42:29.893457 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:29.893380    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:29.896420 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:29.895689    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:31.638554 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:31.638350    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:31.638906 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:31.638356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:31.638906 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:31.638356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:31.638906 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:31.638599    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:31.638906 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:31.638728    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:31.638906 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:31.638772    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:31.899603 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:31.899524    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c21f7cb-a91f-4e4c-a78a-213e0d8149ec" containerID="0b0cadbb4efc1198bb2bb30fb72117d67cc82817061f8b20cc800c708560b1a1" exitCode=0
Jul 07 15:42:31.899603 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:31.899582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff98w" event={"ID":"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec","Type":"ContainerDied","Data":"0b0cadbb4efc1198bb2bb30fb72117d67cc82817061f8b20cc800c708560b1a1"}
Jul 07 15:42:33.638448 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:33.638418    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:33.639179 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:33.638520    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:33.639179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:33.638419    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:33.639179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:33.638558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:33.639179 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:33.638658    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:33.639179 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:33.638730    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:34.283034 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:34.283004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:34.283194 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:34.283047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:34.283194 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:34.283163    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:34.283194 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:34.283165    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:34.283317 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:34.283237    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret podName:b65ae597-c59e-4f76-9812-ae2dc272c84d nodeName:}" failed. No retries permitted until 2026-07-07 15:43:06.28320736 +0000 UTC m=+66.138784225 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret") pod "global-pull-secret-syncer-cwbvk" (UID: "b65ae597-c59e-4f76-9812-ae2dc272c84d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:42:34.283317 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:34.283269    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs podName:e462eb51-3312-4c10-b4ed-95708d85ec81 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:06.283247627 +0000 UTC m=+66.138824491 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs") pod "network-metrics-daemon-rxh56" (UID: "e462eb51-3312-4c10-b4ed-95708d85ec81") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:42:34.485445 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:34.485370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:34.485583 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:34.485512    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:42:34.485583 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:34.485529    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:42:34.485583 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:34.485542    2581 projected.go:196] Error preparing data for projected volume kube-api-access-npjts for pod openshift-network-diagnostics/network-check-target-5lxpc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:34.485713 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:34.485603    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts podName:f8c379f0-b25d-4fbe-b912-0288f27a2d6c nodeName:}" failed. No retries permitted until 2026-07-07 15:43:06.485584829 +0000 UTC m=+66.341161689 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-npjts" (UniqueName: "kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts") pod "network-check-target-5lxpc" (UID: "f8c379f0-b25d-4fbe-b912-0288f27a2d6c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:42:35.638341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:35.638310    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:35.638798 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:35.638356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:35.638798 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:35.638426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:35.638798 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:35.638439    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rxh56" podUID="e462eb51-3312-4c10-b4ed-95708d85ec81"
Jul 07 15:42:35.638798 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:35.638525    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5lxpc" podUID="f8c379f0-b25d-4fbe-b912-0288f27a2d6c"
Jul 07 15:42:35.638798 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:35.638616    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cwbvk" podUID="b65ae597-c59e-4f76-9812-ae2dc272c84d"
Jul 07 15:42:36.484860 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.484830    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-7.ec2.internal" event="NodeReady"
Jul 07 15:42:36.485008 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.484949    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 15:42:36.540515 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.540466    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-frpn4"]
Jul 07 15:42:36.543084 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.543063    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8wdjh"]
Jul 07 15:42:36.543216 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.543196    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.544942 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.544921    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8wdjh"
Jul 07 15:42:36.545608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.545589    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 15:42:36.546221 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.546204    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 15:42:36.546684 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.546667    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kr7tb\""
Jul 07 15:42:36.547263 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.547247    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 15:42:36.547761 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.547743    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pplwf\""
Jul 07 15:42:36.548025 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.548009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 15:42:36.548107 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.548010    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 15:42:36.554743 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.554692    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8wdjh"]
Jul 07 15:42:36.555464 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.555416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frpn4"]
Jul 07 15:42:36.703424 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.703393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bbbc\" (UniqueName: \"kubernetes.io/projected/d1360da7-5e9b-4c69-8086-bd51152a3eee-kube-api-access-9bbbc\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.703864 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.703479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/086f4c58-f6a1-4bca-9144-2f4cc9d3b465-cert\") pod \"ingress-canary-8wdjh\" (UID: \"086f4c58-f6a1-4bca-9144-2f4cc9d3b465\") " pod="openshift-ingress-canary/ingress-canary-8wdjh"
Jul 07 15:42:36.703864 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.703526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1360da7-5e9b-4c69-8086-bd51152a3eee-config-volume\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.703864 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.703580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1360da7-5e9b-4c69-8086-bd51152a3eee-tmp-dir\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.703864 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.703622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks4kr\" (UniqueName: \"kubernetes.io/projected/086f4c58-f6a1-4bca-9144-2f4cc9d3b465-kube-api-access-ks4kr\") pod \"ingress-canary-8wdjh\" (UID: \"086f4c58-f6a1-4bca-9144-2f4cc9d3b465\") " pod="openshift-ingress-canary/ingress-canary-8wdjh"
Jul 07 15:42:36.703864 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.703661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.804351 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.804311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbbc\" (UniqueName: \"kubernetes.io/projected/d1360da7-5e9b-4c69-8086-bd51152a3eee-kube-api-access-9bbbc\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.804479 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.804392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/086f4c58-f6a1-4bca-9144-2f4cc9d3b465-cert\") pod \"ingress-canary-8wdjh\" (UID: \"086f4c58-f6a1-4bca-9144-2f4cc9d3b465\") " pod="openshift-ingress-canary/ingress-canary-8wdjh"
Jul 07 15:42:36.804479 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.804417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1360da7-5e9b-4c69-8086-bd51152a3eee-config-volume\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.804479 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.804437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1360da7-5e9b-4c69-8086-bd51152a3eee-tmp-dir\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.804479 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.804473    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ks4kr\" (UniqueName: \"kubernetes.io/projected/086f4c58-f6a1-4bca-9144-2f4cc9d3b465-kube-api-access-ks4kr\") pod \"ingress-canary-8wdjh\" (UID: \"086f4c58-f6a1-4bca-9144-2f4cc9d3b465\") " pod="openshift-ingress-canary/ingress-canary-8wdjh"
Jul 07 15:42:36.804719 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.804499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.804719 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:36.804664    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:42:36.804818 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:36.804731    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls podName:d1360da7-5e9b-4c69-8086-bd51152a3eee nodeName:}" failed. No retries permitted until 2026-07-07 15:42:37.304708419 +0000 UTC m=+37.160285292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls") pod "dns-default-frpn4" (UID: "d1360da7-5e9b-4c69-8086-bd51152a3eee") : secret "dns-default-metrics-tls" not found
Jul 07 15:42:36.804913 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.804888    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1360da7-5e9b-4c69-8086-bd51152a3eee-tmp-dir\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.805162 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.805144    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1360da7-5e9b-4c69-8086-bd51152a3eee-config-volume\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.808668 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.808647    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/086f4c58-f6a1-4bca-9144-2f4cc9d3b465-cert\") pod \"ingress-canary-8wdjh\" (UID: \"086f4c58-f6a1-4bca-9144-2f4cc9d3b465\") " pod="openshift-ingress-canary/ingress-canary-8wdjh"
Jul 07 15:42:36.822461 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.822323    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bbbc\" (UniqueName: \"kubernetes.io/projected/d1360da7-5e9b-4c69-8086-bd51152a3eee-kube-api-access-9bbbc\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:36.822729 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.822707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks4kr\" (UniqueName: \"kubernetes.io/projected/086f4c58-f6a1-4bca-9144-2f4cc9d3b465-kube-api-access-ks4kr\") pod \"ingress-canary-8wdjh\" (UID: \"086f4c58-f6a1-4bca-9144-2f4cc9d3b465\") " pod="openshift-ingress-canary/ingress-canary-8wdjh"
Jul 07 15:42:36.862451 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.862431    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8wdjh"
Jul 07 15:42:36.917249 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.917126    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c21f7cb-a91f-4e4c-a78a-213e0d8149ec" containerID="e7b4cfa7a12e55d6aa69e2d54324b08a43845a550ff941ff36fae62a0417852d" exitCode=0
Jul 07 15:42:36.917514 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:36.917330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff98w" event={"ID":"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec","Type":"ContainerDied","Data":"e7b4cfa7a12e55d6aa69e2d54324b08a43845a550ff941ff36fae62a0417852d"}
Jul 07 15:42:37.034347 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.034324    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8wdjh"]
Jul 07 15:42:37.064008 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:37.063979    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086f4c58_f6a1_4bca_9144_2f4cc9d3b465.slice/crio-4ce89168ed85f4b6fa3a8653f61003442da6b8ca558d59407630ea2cb5f99fd8 WatchSource:0}: Error finding container 4ce89168ed85f4b6fa3a8653f61003442da6b8ca558d59407630ea2cb5f99fd8: Status 404 returned error can't find the container with id 4ce89168ed85f4b6fa3a8653f61003442da6b8ca558d59407630ea2cb5f99fd8
Jul 07 15:42:37.308753 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.308693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:37.308878 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:37.308859    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:42:37.308945 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:37.308936    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls podName:d1360da7-5e9b-4c69-8086-bd51152a3eee nodeName:}" failed. No retries permitted until 2026-07-07 15:42:38.308913459 +0000 UTC m=+38.164490319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls") pod "dns-default-frpn4" (UID: "d1360da7-5e9b-4c69-8086-bd51152a3eee") : secret "dns-default-metrics-tls" not found
Jul 07 15:42:37.638238 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.638205    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:42:37.638433 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.638205    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:42:37.638433 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.638205    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:42:37.640830 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.640804    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:42:37.640830 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.640823    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54b57\""
Jul 07 15:42:37.641821 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.641798    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:42:37.641821 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.641814    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:42:37.641968 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.641824    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:42:37.641968 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.641824    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-88kw6\""
Jul 07 15:42:37.920660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.920577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8wdjh" event={"ID":"086f4c58-f6a1-4bca-9144-2f4cc9d3b465","Type":"ContainerStarted","Data":"4ce89168ed85f4b6fa3a8653f61003442da6b8ca558d59407630ea2cb5f99fd8"}
Jul 07 15:42:37.924009 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.923981    2581 generic.go:356] "Generic (PLEG): container finished" podID="1c21f7cb-a91f-4e4c-a78a-213e0d8149ec" containerID="999459426d7cec77380c478f5f5bba29ac5260510b9f3d016c48aeb0981474ca" exitCode=0
Jul 07 15:42:37.924133 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:37.924022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff98w" event={"ID":"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec","Type":"ContainerDied","Data":"999459426d7cec77380c478f5f5bba29ac5260510b9f3d016c48aeb0981474ca"}
Jul 07 15:42:38.315601 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:38.315238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:38.315601 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:38.315551    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:42:38.315804 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:38.315646    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls podName:d1360da7-5e9b-4c69-8086-bd51152a3eee nodeName:}" failed. No retries permitted until 2026-07-07 15:42:40.31562532 +0000 UTC m=+40.171202196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls") pod "dns-default-frpn4" (UID: "d1360da7-5e9b-4c69-8086-bd51152a3eee") : secret "dns-default-metrics-tls" not found
Jul 07 15:42:38.930943 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:38.930914    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ff98w" event={"ID":"1c21f7cb-a91f-4e4c-a78a-213e0d8149ec","Type":"ContainerStarted","Data":"46a78c3f5fd8ab9e51fd88b74102a5967decef1684ab7b63f5117e3fba4c97d7"}
Jul 07 15:42:38.962740 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:38.962675    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ff98w" podStartSLOduration=7.843441516 podStartE2EDuration="38.962654595s" totalImagesPullingTime="31.119213079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:38.961628287 +0000 UTC m=+38.817205167" watchObservedRunningTime="2026-07-07 15:42:38.962654595 +0000 UTC m=+38.818231475"
Jul 07 15:42:39.934342 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:39.934304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8wdjh" event={"ID":"086f4c58-f6a1-4bca-9144-2f4cc9d3b465","Type":"ContainerStarted","Data":"6ff2c1caa55dd0a83459bf8181594e8edc4a62e2212005e506e93a13676435c0"}
Jul 07 15:42:39.957785 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:39.957740    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8wdjh" podStartSLOduration=1.447206461 podStartE2EDuration="3.957726419s" totalImagesPullingTime="2.510519958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:39.957188868 +0000 UTC m=+39.812765748" watchObservedRunningTime="2026-07-07 15:42:39.957726419 +0000 UTC m=+39.813303297"
Jul 07 15:42:40.330845 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:40.330806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:40.331004 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:40.330942    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:42:40.331066 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:40.331005    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls podName:d1360da7-5e9b-4c69-8086-bd51152a3eee nodeName:}" failed. No retries permitted until 2026-07-07 15:42:44.330987106 +0000 UTC m=+44.186563965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls") pod "dns-default-frpn4" (UID: "d1360da7-5e9b-4c69-8086-bd51152a3eee") : secret "dns-default-metrics-tls" not found
Jul 07 15:42:44.356672 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:44.356636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:44.357005 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:44.356775    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:42:44.357005 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:44.356836    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls podName:d1360da7-5e9b-4c69-8086-bd51152a3eee nodeName:}" failed. No retries permitted until 2026-07-07 15:42:52.356818905 +0000 UTC m=+52.212395776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls") pod "dns-default-frpn4" (UID: "d1360da7-5e9b-4c69-8086-bd51152a3eee") : secret "dns-default-metrics-tls" not found
Jul 07 15:42:52.408879 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:52.408841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:42:52.409327 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:52.408987    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:42:52.409327 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:52.409059    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls podName:d1360da7-5e9b-4c69-8086-bd51152a3eee nodeName:}" failed. No retries permitted until 2026-07-07 15:43:08.40904378 +0000 UTC m=+68.264620640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls") pod "dns-default-frpn4" (UID: "d1360da7-5e9b-4c69-8086-bd51152a3eee") : secret "dns-default-metrics-tls" not found
Jul 07 15:42:56.816107 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.816071    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q"]
Jul 07 15:42:56.818145 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.818128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q"
Jul 07 15:42:56.821005 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.820980    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:42:56.821122 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.821015    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 15:42:56.821171 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.821143    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dzjr4\""
Jul 07 15:42:56.828769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.828750    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q"]
Jul 07 15:42:56.831580 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.831562    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-768bb75c95-46rlq"]
Jul 07 15:42:56.833145 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.833128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.836891 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.836876    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 15:42:56.837484 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.837466    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 15:42:56.837568 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.837486    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d8w2m\""
Jul 07 15:42:56.837762 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.837745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmbm2\" (UniqueName: \"kubernetes.io/projected/4cfbc970-2a8e-4bc9-add2-f94b82865457-kube-api-access-qmbm2\") pod \"volume-data-source-validator-5d456fdbcd-xgs4q\" (UID: \"4cfbc970-2a8e-4bc9-add2-f94b82865457\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q"
Jul 07 15:42:56.839121 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.839093    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 15:42:56.844745 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.844729    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 15:42:56.853315 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.853295    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768bb75c95-46rlq"]
Jul 07 15:42:56.929881 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.929859    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"]
Jul 07 15:42:56.931851 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.931835    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:56.934589 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.934572    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 15:42:56.936098 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.936071    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 15:42:56.936210 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.936097    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 15:42:56.936210 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.936122    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 15:42:56.936210 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.936140    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xrnwz\""
Jul 07 15:42:56.938992 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.938974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.939064 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.939000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-installation-pull-secrets\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.939064 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.939051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65429566-aedd-44af-859a-499e3185aefe-ca-trust-extracted\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.939129 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.939077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmbm2\" (UniqueName: \"kubernetes.io/projected/4cfbc970-2a8e-4bc9-add2-f94b82865457-kube-api-access-qmbm2\") pod \"volume-data-source-validator-5d456fdbcd-xgs4q\" (UID: \"4cfbc970-2a8e-4bc9-add2-f94b82865457\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q"
Jul 07 15:42:56.939129 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.939093    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-bound-sa-token\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.939129 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.939108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-image-registry-private-configuration\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.939218 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.939129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-trusted-ca\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.939218 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.939173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-registry-certificates\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.939218 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.939212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26n7\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-kube-api-access-x26n7\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:56.953130 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.953111    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"]
Jul 07 15:42:56.958145 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:56.958119    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmbm2\" (UniqueName: \"kubernetes.io/projected/4cfbc970-2a8e-4bc9-add2-f94b82865457-kube-api-access-qmbm2\") pod \"volume-data-source-validator-5d456fdbcd-xgs4q\" (UID: \"4cfbc970-2a8e-4bc9-add2-f94b82865457\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q"
Jul 07 15:42:57.014756 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.014729    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"]
Jul 07 15:42:57.016406 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.016393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.018654 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.018636    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:42:57.018737 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.018673    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 15:42:57.018789 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.018675    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 15:42:57.018789 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.018689    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-l6ml2\""
Jul 07 15:42:57.018901 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.018885    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 15:42:57.036512 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.036474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"]
Jul 07 15:42:57.039869 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.039849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65429566-aedd-44af-859a-499e3185aefe-ca-trust-extracted\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.039942 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.039878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-bound-sa-token\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.039942 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.039897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4w5\" (UniqueName: \"kubernetes.io/projected/fa9393d3-c78a-4192-9ea7-d32bee6bc414-kube-api-access-tx4w5\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.039942 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.039913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.039942 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.039934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-image-registry-private-configuration\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.040152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.039955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-trusted-ca\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.040152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.039984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkkgp\" (UniqueName: \"kubernetes.io/projected/ad512174-e3ad-44f7-a058-05848b16d427-kube-api-access-nkkgp\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.040152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-registry-certificates\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.040152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad512174-e3ad-44f7-a058-05848b16d427-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.040152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26n7\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-kube-api-access-x26n7\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.040411 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa9393d3-c78a-4192-9ea7-d32bee6bc414-config\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.040411 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.040411 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040263    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65429566-aedd-44af-859a-499e3185aefe-ca-trust-extracted\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.040411 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-installation-pull-secrets\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.040411 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa9393d3-c78a-4192-9ea7-d32bee6bc414-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.040411 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.040373    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:42:57.040411 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.040388    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bb75c95-46rlq: secret "image-registry-tls" not found
Jul 07 15:42:57.040647 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.040450    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls podName:65429566-aedd-44af-859a-499e3185aefe nodeName:}" failed. No retries permitted until 2026-07-07 15:42:57.54043272 +0000 UTC m=+57.396009584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls") pod "image-registry-768bb75c95-46rlq" (UID: "65429566-aedd-44af-859a-499e3185aefe") : secret "image-registry-tls" not found
Jul 07 15:42:57.040647 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040565    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-registry-certificates\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.040914 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.040891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-trusted-ca\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.042412 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.042397    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-image-registry-private-configuration\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.042534 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.042516    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-installation-pull-secrets\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.057432 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.057411    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-bound-sa-token\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.058245 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.058228    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26n7\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-kube-api-access-x26n7\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.126634 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.126601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q"
Jul 07 15:42:57.141243 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.141221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkkgp\" (UniqueName: \"kubernetes.io/projected/ad512174-e3ad-44f7-a058-05848b16d427-kube-api-access-nkkgp\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.141343 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.141255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad512174-e3ad-44f7-a058-05848b16d427-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.141467 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.141445    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa9393d3-c78a-4192-9ea7-d32bee6bc414-config\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.141533 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.141517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa9393d3-c78a-4192-9ea7-d32bee6bc414-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.141618 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.141601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4w5\" (UniqueName: \"kubernetes.io/projected/fa9393d3-c78a-4192-9ea7-d32bee6bc414-kube-api-access-tx4w5\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.141673 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.141633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.141754 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.141739    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:42:57.141822 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.141809    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls podName:ad512174-e3ad-44f7-a058-05848b16d427 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:57.641791822 +0000 UTC m=+57.497368694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2hdwx" (UID: "ad512174-e3ad-44f7-a058-05848b16d427") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:42:57.142054 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.142034    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fa9393d3-c78a-4192-9ea7-d32bee6bc414-config\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.142054 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.142047    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ad512174-e3ad-44f7-a058-05848b16d427-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.143506 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.143486    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fa9393d3-c78a-4192-9ea7-d32bee6bc414-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.153775 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.153752    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkkgp\" (UniqueName: \"kubernetes.io/projected/ad512174-e3ad-44f7-a058-05848b16d427-kube-api-access-nkkgp\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.154179 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.154163    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4w5\" (UniqueName: \"kubernetes.io/projected/fa9393d3-c78a-4192-9ea7-d32bee6bc414-kube-api-access-tx4w5\") pod \"service-ca-operator-5d46d9ffd4-bwrxn\" (UID: \"fa9393d3-c78a-4192-9ea7-d32bee6bc414\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.246542 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.246518    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q"]
Jul 07 15:42:57.249639 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:57.249619    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfbc970_2a8e_4bc9_add2_f94b82865457.slice/crio-f729f3f03891e6f9434908e7f729dec27a0876dac635875655d8d110baaccb0e WatchSource:0}: Error finding container f729f3f03891e6f9434908e7f729dec27a0876dac635875655d8d110baaccb0e: Status 404 returned error can't find the container with id f729f3f03891e6f9434908e7f729dec27a0876dac635875655d8d110baaccb0e
Jul 07 15:42:57.324919 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.324897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"
Jul 07 15:42:57.459750 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.459723    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn"]
Jul 07 15:42:57.462708 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:42:57.462687    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9393d3_c78a_4192_9ea7_d32bee6bc414.slice/crio-d7f5cfa87d28a356c4fbb5f69798eeca54c1fb8617a91f66ab833b46b57621f8 WatchSource:0}: Error finding container d7f5cfa87d28a356c4fbb5f69798eeca54c1fb8617a91f66ab833b46b57621f8: Status 404 returned error can't find the container with id d7f5cfa87d28a356c4fbb5f69798eeca54c1fb8617a91f66ab833b46b57621f8
Jul 07 15:42:57.545461 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.545433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:57.545592 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.545578    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:42:57.545638 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.545594    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bb75c95-46rlq: secret "image-registry-tls" not found
Jul 07 15:42:57.545673 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.545644    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls podName:65429566-aedd-44af-859a-499e3185aefe nodeName:}" failed. No retries permitted until 2026-07-07 15:42:58.545625731 +0000 UTC m=+58.401202596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls") pod "image-registry-768bb75c95-46rlq" (UID: "65429566-aedd-44af-859a-499e3185aefe") : secret "image-registry-tls" not found
Jul 07 15:42:57.645947 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.645912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:57.646054 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.646019    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:42:57.646099 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:57.646067    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls podName:ad512174-e3ad-44f7-a058-05848b16d427 nodeName:}" failed. No retries permitted until 2026-07-07 15:42:58.64605369 +0000 UTC m=+58.501630548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2hdwx" (UID: "ad512174-e3ad-44f7-a058-05848b16d427") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:42:57.976202 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.976169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q" event={"ID":"4cfbc970-2a8e-4bc9-add2-f94b82865457","Type":"ContainerStarted","Data":"f729f3f03891e6f9434908e7f729dec27a0876dac635875655d8d110baaccb0e"}
Jul 07 15:42:57.977563 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:57.977537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn" event={"ID":"fa9393d3-c78a-4192-9ea7-d32bee6bc414","Type":"ContainerStarted","Data":"d7f5cfa87d28a356c4fbb5f69798eeca54c1fb8617a91f66ab833b46b57621f8"}
Jul 07 15:42:58.553377 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:58.553346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:42:58.553535 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:58.553493    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:42:58.553535 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:58.553515    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bb75c95-46rlq: secret "image-registry-tls" not found
Jul 07 15:42:58.553677 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:58.553571    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls podName:65429566-aedd-44af-859a-499e3185aefe nodeName:}" failed. No retries permitted until 2026-07-07 15:43:00.553550475 +0000 UTC m=+60.409127337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls") pod "image-registry-768bb75c95-46rlq" (UID: "65429566-aedd-44af-859a-499e3185aefe") : secret "image-registry-tls" not found
Jul 07 15:42:58.654613 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:58.654589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:42:58.654724 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:58.654698    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:42:58.654780 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:42:58.654744    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls podName:ad512174-e3ad-44f7-a058-05848b16d427 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:00.654731948 +0000 UTC m=+60.510308805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2hdwx" (UID: "ad512174-e3ad-44f7-a058-05848b16d427") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:42:58.981652 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:58.981614    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q" event={"ID":"4cfbc970-2a8e-4bc9-add2-f94b82865457","Type":"ContainerStarted","Data":"4c0c0803cee536bf4e6090cefef02f272816614f1b54c09f67a42abbbe426037"}
Jul 07 15:42:59.015263 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:59.015211    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xgs4q" podStartSLOduration=1.808386215 podStartE2EDuration="3.015194939s" totalImagesPullingTime="1.206808724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:59.014942225 +0000 UTC m=+58.870519107" watchObservedRunningTime="2026-07-07 15:42:59.015194939 +0000 UTC m=+58.870771818"
Jul 07 15:42:59.903693 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:59.903669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-sj475"
Jul 07 15:42:59.985115 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:42:59.985087    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn" event={"ID":"fa9393d3-c78a-4192-9ea7-d32bee6bc414","Type":"ContainerStarted","Data":"6a81ebbb2f4b44bd3d4e9b73092aa68229997bc83b27aca3662ea568b62dbab6"}
Jul 07 15:43:00.008643 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:00.008599    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn" podStartSLOduration=1.6676442649999998 podStartE2EDuration="4.008585363s" totalImagesPullingTime="2.340941098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:00.00752858 +0000 UTC m=+59.863105460" watchObservedRunningTime="2026-07-07 15:43:00.008585363 +0000 UTC m=+59.864162241"
Jul 07 15:43:00.571080 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:00.571051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:00.571315 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:00.571194    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:43:00.571315 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:00.571210    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bb75c95-46rlq: secret "image-registry-tls" not found
Jul 07 15:43:00.571315 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:00.571258    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls podName:65429566-aedd-44af-859a-499e3185aefe nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.571242447 +0000 UTC m=+64.426819309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls") pod "image-registry-768bb75c95-46rlq" (UID: "65429566-aedd-44af-859a-499e3185aefe") : secret "image-registry-tls" not found
Jul 07 15:43:00.672154 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:00.672124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:43:00.672295 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:00.672218    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:43:00.672295 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:00.672263    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls podName:ad512174-e3ad-44f7-a058-05848b16d427 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.672251533 +0000 UTC m=+64.527828389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2hdwx" (UID: "ad512174-e3ad-44f7-a058-05848b16d427") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:43:03.283926 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.283894    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-szzvm"]
Jul 07 15:43:03.288130 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.288110    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.292806 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.292779    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 15:43:03.292916 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.292779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 15:43:03.293038 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.293002    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-68vpx\""
Jul 07 15:43:03.293133 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.293122    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 15:43:03.293188 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.293175    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 15:43:03.303061 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.303042    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szzvm"]
Jul 07 15:43:03.390833 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.390813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.390934 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.390839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mmxs\" (UniqueName: \"kubernetes.io/projected/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-api-access-5mmxs\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.390934 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.390861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb90d776-91b9-4c65-b4e3-820227ca9f1b-data-volume\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.390934 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.390879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.391059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.391041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb90d776-91b9-4c65-b4e3-820227ca9f1b-crio-socket\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.491600 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.491574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb90d776-91b9-4c65-b4e3-820227ca9f1b-crio-socket\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.491716 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.491603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.491716 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.491621    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mmxs\" (UniqueName: \"kubernetes.io/projected/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-api-access-5mmxs\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.491716 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.491640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb90d776-91b9-4c65-b4e3-820227ca9f1b-data-volume\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.491716 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.491655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.491716 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.491699    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/eb90d776-91b9-4c65-b4e3-820227ca9f1b-crio-socket\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.491878 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:03.491707    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:43:03.491878 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:03.491790    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:03.991770601 +0000 UTC m=+63.847347458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : configmap "kube-rbac-proxy" not found
Jul 07 15:43:03.491878 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:03.491821    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:03.491878 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:03.491876    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:03.991859345 +0000 UTC m=+63.847436227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:03.492016 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.491944    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb90d776-91b9-4c65-b4e3-820227ca9f1b-data-volume\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.508706 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.508686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mmxs\" (UniqueName: \"kubernetes.io/projected/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-api-access-5mmxs\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.609394 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.609368    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-lkk5z"]
Jul 07 15:43:03.612338 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.612325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.619554 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.619538    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 15:43:03.620102 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.620084    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 15:43:03.620227 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.620118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 15:43:03.620383 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.620371    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-46n46\""
Jul 07 15:43:03.621011 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.620996    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 15:43:03.629379 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.629358    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-lkk5z"]
Jul 07 15:43:03.693309 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.693270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/856f7c66-6d70-49cf-bf63-effc94d9cd85-signing-key\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.693404 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.693384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/856f7c66-6d70-49cf-bf63-effc94d9cd85-signing-cabundle\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.693449 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.693441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znd6h\" (UniqueName: \"kubernetes.io/projected/856f7c66-6d70-49cf-bf63-effc94d9cd85-kube-api-access-znd6h\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.794683 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.794649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/856f7c66-6d70-49cf-bf63-effc94d9cd85-signing-key\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.794849 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.794727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/856f7c66-6d70-49cf-bf63-effc94d9cd85-signing-cabundle\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.794849 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.794788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znd6h\" (UniqueName: \"kubernetes.io/projected/856f7c66-6d70-49cf-bf63-effc94d9cd85-kube-api-access-znd6h\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.795444 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.795420    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/856f7c66-6d70-49cf-bf63-effc94d9cd85-signing-cabundle\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.797081 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.797060    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/856f7c66-6d70-49cf-bf63-effc94d9cd85-signing-key\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.806734 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.806704    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znd6h\" (UniqueName: \"kubernetes.io/projected/856f7c66-6d70-49cf-bf63-effc94d9cd85-kube-api-access-znd6h\") pod \"service-ca-758f599c5-lkk5z\" (UID: \"856f7c66-6d70-49cf-bf63-effc94d9cd85\") " pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.920402 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.920353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-lkk5z"
Jul 07 15:43:03.995889 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.995862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.996052 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:03.996031    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:03.996117 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:03.996098    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:43:03.996176 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:03.996036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:03.996176 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:03.996102    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.996082488 +0000 UTC m=+64.851659359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:03.996176 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:03.996162    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:04.996145987 +0000 UTC m=+64.851722844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : configmap "kube-rbac-proxy" not found
Jul 07 15:43:04.041377 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:04.041353    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-lkk5z"]
Jul 07 15:43:04.044268 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:04.044246    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856f7c66_6d70_49cf_bf63_effc94d9cd85.slice/crio-ee69c36ae9da7a6d845d8b694a1bcb4d291533bcaec03e59ea8db0871be25821 WatchSource:0}: Error finding container ee69c36ae9da7a6d845d8b694a1bcb4d291533bcaec03e59ea8db0871be25821: Status 404 returned error can't find the container with id ee69c36ae9da7a6d845d8b694a1bcb4d291533bcaec03e59ea8db0871be25821
Jul 07 15:43:04.600895 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:04.600835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:04.601364 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:04.600998    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:43:04.601364 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:04.601021    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-768bb75c95-46rlq: secret "image-registry-tls" not found
Jul 07 15:43:04.601364 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:04.601092    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls podName:65429566-aedd-44af-859a-499e3185aefe nodeName:}" failed. No retries permitted until 2026-07-07 15:43:12.601072131 +0000 UTC m=+72.456649033 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls") pod "image-registry-768bb75c95-46rlq" (UID: "65429566-aedd-44af-859a-499e3185aefe") : secret "image-registry-tls" not found
Jul 07 15:43:04.701689 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:04.701660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:43:04.701829 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:04.701800    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 15:43:04.701877 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:04.701853    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls podName:ad512174-e3ad-44f7-a058-05848b16d427 nodeName:}" failed. No retries permitted until 2026-07-07 15:43:12.70184009 +0000 UTC m=+72.557416951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-2hdwx" (UID: "ad512174-e3ad-44f7-a058-05848b16d427") : secret "cluster-monitoring-operator-tls" not found
Jul 07 15:43:04.999758 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:04.999681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-lkk5z" event={"ID":"856f7c66-6d70-49cf-bf63-effc94d9cd85","Type":"ContainerStarted","Data":"1abdb9d10ccfe109ca1e2267cc2997522dacd3fd19351f16a61bedd313392769"}
Jul 07 15:43:04.999758 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:04.999736    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-lkk5z" event={"ID":"856f7c66-6d70-49cf-bf63-effc94d9cd85","Type":"ContainerStarted","Data":"ee69c36ae9da7a6d845d8b694a1bcb4d291533bcaec03e59ea8db0871be25821"}
Jul 07 15:43:05.004172 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:05.004153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:05.004234 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:05.004182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:05.004316 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:05.004297    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:43:05.004363 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:05.004314    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:05.004363 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:05.004358    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:07.004346408 +0000 UTC m=+66.859923265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:05.004466 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:05.004371    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:07.004365184 +0000 UTC m=+66.859942041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : configmap "kube-rbac-proxy" not found
Jul 07 15:43:05.022118 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:05.022069    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-lkk5z" podStartSLOduration=2.022047744 podStartE2EDuration="2.022047744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:05.020028041 +0000 UTC m=+64.875604919" watchObservedRunningTime="2026-07-07 15:43:05.022047744 +0000 UTC m=+64.877624628"
Jul 07 15:43:05.465976 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:05.465943    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xgh8d_6d232f46-468a-41e6-8a5f-37c8f6913409/dns-node-resolver/0.log"
Jul 07 15:43:06.067349 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.067321    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2zjct_c00bacd2-0897-4e32-9e42-b58deaf50d60/node-ca/0.log"
Jul 07 15:43:06.315916 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.315881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:43:06.316158 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.315947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:43:06.318545 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.318499    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:43:06.318545 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.318513    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:43:06.326370 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:06.326352    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:43:06.326450 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:06.326416    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs podName:e462eb51-3312-4c10-b4ed-95708d85ec81 nodeName:}" failed. No retries permitted until 2026-07-07 15:44:10.326396556 +0000 UTC m=+130.181973433 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs") pod "network-metrics-daemon-rxh56" (UID: "e462eb51-3312-4c10-b4ed-95708d85ec81") : secret "metrics-daemon-secret" not found
Jul 07 15:43:06.328509 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.328480    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b65ae597-c59e-4f76-9812-ae2dc272c84d-original-pull-secret\") pod \"global-pull-secret-syncer-cwbvk\" (UID: \"b65ae597-c59e-4f76-9812-ae2dc272c84d\") " pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:43:06.457821 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.457795    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cwbvk"
Jul 07 15:43:06.517647 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.517616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:43:06.520484 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.520460    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:43:06.530267 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.530248    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:43:06.541116 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.541086    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npjts\" (UniqueName: \"kubernetes.io/projected/f8c379f0-b25d-4fbe-b912-0288f27a2d6c-kube-api-access-npjts\") pod \"network-check-target-5lxpc\" (UID: \"f8c379f0-b25d-4fbe-b912-0288f27a2d6c\") " pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:43:06.586551 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.586524    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cwbvk"]
Jul 07 15:43:06.590267 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:06.590243    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65ae597_c59e_4f76_9812_ae2dc272c84d.slice/crio-bcc1971a16dc33d591f1ccaf51e14cc50cde3614f514dec5f6ff5fd37d48a89b WatchSource:0}: Error finding container bcc1971a16dc33d591f1ccaf51e14cc50cde3614f514dec5f6ff5fd37d48a89b: Status 404 returned error can't find the container with id bcc1971a16dc33d591f1ccaf51e14cc50cde3614f514dec5f6ff5fd37d48a89b
Jul 07 15:43:06.765741 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.765711    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54b57\""
Jul 07 15:43:06.773546 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.773525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:43:06.902316 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:06.902272    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5lxpc"]
Jul 07 15:43:06.905404 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:06.905383    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c379f0_b25d_4fbe_b912_0288f27a2d6c.slice/crio-db8aff23a8d0a40cba86e3267519d78c2975b7730b53df179939e8556b0215bf WatchSource:0}: Error finding container db8aff23a8d0a40cba86e3267519d78c2975b7730b53df179939e8556b0215bf: Status 404 returned error can't find the container with id db8aff23a8d0a40cba86e3267519d78c2975b7730b53df179939e8556b0215bf
Jul 07 15:43:07.007118 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:07.007084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5lxpc" event={"ID":"f8c379f0-b25d-4fbe-b912-0288f27a2d6c","Type":"ContainerStarted","Data":"db8aff23a8d0a40cba86e3267519d78c2975b7730b53df179939e8556b0215bf"}
Jul 07 15:43:07.008420 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:07.008398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cwbvk" event={"ID":"b65ae597-c59e-4f76-9812-ae2dc272c84d","Type":"ContainerStarted","Data":"bcc1971a16dc33d591f1ccaf51e14cc50cde3614f514dec5f6ff5fd37d48a89b"}
Jul 07 15:43:07.021954 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:07.021928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:07.022060 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:07.021973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:07.022060 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:07.022050    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:43:07.022180 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:07.022121    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:11.022101124 +0000 UTC m=+70.877677987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : configmap "kube-rbac-proxy" not found
Jul 07 15:43:07.022180 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:07.022138    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:07.022180 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:07.022175    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:11.022164046 +0000 UTC m=+70.877740903 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:07.069314 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:07.069268    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8wdjh_086f4c58-f6a1-4bca-9144-2f4cc9d3b465/serve-healthcheck-canary/0.log"
Jul 07 15:43:08.434722 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:08.434677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:43:08.435176 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:08.434895    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:43:08.435176 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:08.434959    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls podName:d1360da7-5e9b-4c69-8086-bd51152a3eee nodeName:}" failed. No retries permitted until 2026-07-07 15:43:40.43493871 +0000 UTC m=+100.290515570 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls") pod "dns-default-frpn4" (UID: "d1360da7-5e9b-4c69-8086-bd51152a3eee") : secret "dns-default-metrics-tls" not found
Jul 07 15:43:11.057397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:11.057354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:11.057837 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:11.057406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:11.057837 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:11.057467    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:43:11.057837 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:11.057523    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:11.057837 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:11.057545    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:19.057525531 +0000 UTC m=+78.913102411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : configmap "kube-rbac-proxy" not found
Jul 07 15:43:11.057837 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:11.057570    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls podName:eb90d776-91b9-4c65-b4e3-820227ca9f1b nodeName:}" failed. No retries permitted until 2026-07-07 15:43:19.057555128 +0000 UTC m=+78.913132000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szzvm" (UID: "eb90d776-91b9-4c65-b4e3-820227ca9f1b") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:43:12.022909 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.022827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5lxpc" event={"ID":"f8c379f0-b25d-4fbe-b912-0288f27a2d6c","Type":"ContainerStarted","Data":"e4608d82c6f44d093948ee0e99a72996fa9e38d4320a98bee15f2220d16bb277"}
Jul 07 15:43:12.023059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.022942    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:43:12.024338 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.024315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cwbvk" event={"ID":"b65ae597-c59e-4f76-9812-ae2dc272c84d","Type":"ContainerStarted","Data":"133b583fdd404fe82244540b18adc97a077385e20b382fa0fcea5b6f9cc030ab"}
Jul 07 15:43:12.042237 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.042197    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5lxpc" podStartSLOduration=67.335575959 podStartE2EDuration="1m12.042184736s" totalImagesPullingTime="4.706608777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:12.041669651 +0000 UTC m=+71.897246531" watchObservedRunningTime="2026-07-07 15:43:12.042184736 +0000 UTC m=+71.897761614"
Jul 07 15:43:12.063916 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.063878    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cwbvk" podStartSLOduration=67.041966567 podStartE2EDuration="1m12.06386812s" totalImagesPullingTime="5.021901553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:12.063391094 +0000 UTC m=+71.918967985" watchObservedRunningTime="2026-07-07 15:43:12.06386812 +0000 UTC m=+71.919445002"
Jul 07 15:43:12.670061 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.670028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:12.672538 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.672506    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"image-registry-768bb75c95-46rlq\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") " pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:12.743322 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.743273    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d8w2m\""
Jul 07 15:43:12.752047 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.752027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:12.771264 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.771233    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:43:12.773526 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.773491    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ad512174-e3ad-44f7-a058-05848b16d427-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-2hdwx\" (UID: \"ad512174-e3ad-44f7-a058-05848b16d427\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:43:12.842106 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.842075    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xrnwz\""
Jul 07 15:43:12.850057 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.850036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"
Jul 07 15:43:12.879370 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.879344    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-768bb75c95-46rlq"]
Jul 07 15:43:12.882567 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:12.882536    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65429566_aedd_44af_859a_499e3185aefe.slice/crio-dbf9d37af7093287a5451e6ffeb49f8cc83ab11a3ae7e7eba847441493981f85 WatchSource:0}: Error finding container dbf9d37af7093287a5451e6ffeb49f8cc83ab11a3ae7e7eba847441493981f85: Status 404 returned error can't find the container with id dbf9d37af7093287a5451e6ffeb49f8cc83ab11a3ae7e7eba847441493981f85
Jul 07 15:43:12.989950 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:12.989925    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx"]
Jul 07 15:43:12.992974 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:12.992941    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad512174_e3ad_44f7_a058_05848b16d427.slice/crio-1f7c2a1501a03d885ef20fb980d7ca512774a9d91326fdd80a99458b7b23bd48 WatchSource:0}: Error finding container 1f7c2a1501a03d885ef20fb980d7ca512774a9d91326fdd80a99458b7b23bd48: Status 404 returned error can't find the container with id 1f7c2a1501a03d885ef20fb980d7ca512774a9d91326fdd80a99458b7b23bd48
Jul 07 15:43:13.029123 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:13.029096    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bb75c95-46rlq" event={"ID":"65429566-aedd-44af-859a-499e3185aefe","Type":"ContainerStarted","Data":"597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c"}
Jul 07 15:43:13.029238 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:13.029143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bb75c95-46rlq" event={"ID":"65429566-aedd-44af-859a-499e3185aefe","Type":"ContainerStarted","Data":"dbf9d37af7093287a5451e6ffeb49f8cc83ab11a3ae7e7eba847441493981f85"}
Jul 07 15:43:13.029238 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:13.029201    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:13.030390 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:13.030361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx" event={"ID":"ad512174-e3ad-44f7-a058-05848b16d427","Type":"ContainerStarted","Data":"1f7c2a1501a03d885ef20fb980d7ca512774a9d91326fdd80a99458b7b23bd48"}
Jul 07 15:43:13.054199 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:13.054160    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-768bb75c95-46rlq" podStartSLOduration=17.054146429 podStartE2EDuration="17.054146429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:13.053294117 +0000 UTC m=+72.908870990" watchObservedRunningTime="2026-07-07 15:43:13.054146429 +0000 UTC m=+72.909723341"
Jul 07 15:43:16.042266 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:16.042230    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx" event={"ID":"ad512174-e3ad-44f7-a058-05848b16d427","Type":"ContainerStarted","Data":"36b7e04310b72f5c90a840421bcd7f5e9dae10c0523d908f3adca8d8b4ab610f"}
Jul 07 15:43:16.068464 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:16.068417    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-2hdwx" podStartSLOduration=18.079493875 podStartE2EDuration="20.068402584s" totalImagesPullingTime="1.988908709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:16.068353171 +0000 UTC m=+75.923930050" watchObservedRunningTime="2026-07-07 15:43:16.068402584 +0000 UTC m=+75.923979462"
Jul 07 15:43:19.120089 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:19.120056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:19.120462 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:19.120094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:19.120608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:19.120580    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/eb90d776-91b9-4c65-b4e3-820227ca9f1b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:19.122373 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:19.122343    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/eb90d776-91b9-4c65-b4e3-820227ca9f1b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szzvm\" (UID: \"eb90d776-91b9-4c65-b4e3-820227ca9f1b\") " pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:19.196669 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:19.196643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szzvm"
Jul 07 15:43:19.321141 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:19.321114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szzvm"]
Jul 07 15:43:19.324144 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:19.324104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb90d776_91b9_4c65_b4e3_820227ca9f1b.slice/crio-6c8370528de2e9d9bb3401d8414605411dc0b6b9b00c0a7887552fc44518dbf9 WatchSource:0}: Error finding container 6c8370528de2e9d9bb3401d8414605411dc0b6b9b00c0a7887552fc44518dbf9: Status 404 returned error can't find the container with id 6c8370528de2e9d9bb3401d8414605411dc0b6b9b00c0a7887552fc44518dbf9
Jul 07 15:43:20.058343 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:20.058305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szzvm" event={"ID":"eb90d776-91b9-4c65-b4e3-820227ca9f1b","Type":"ContainerStarted","Data":"6c8370528de2e9d9bb3401d8414605411dc0b6b9b00c0a7887552fc44518dbf9"}
Jul 07 15:43:23.068191 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:23.068157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szzvm" event={"ID":"eb90d776-91b9-4c65-b4e3-820227ca9f1b","Type":"ContainerStarted","Data":"3d19f7e1607cc9ae5b100e0e5a287786e7d86184eb1f2b9bb0826129fdc37c91"}
Jul 07 15:43:24.072855 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.072824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szzvm" event={"ID":"eb90d776-91b9-4c65-b4e3-820227ca9f1b","Type":"ContainerStarted","Data":"6f7e198784995c3099e21766c750e3e1f0dcdb9d9150dd41405c8734f5c9321d"}
Jul 07 15:43:24.831214 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.831176    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"]
Jul 07 15:43:24.834327 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.834306    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:24.836828 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.836805    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 15:43:24.837672 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.837651    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 15:43:24.837768 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.837689    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 15:43:24.837843 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.837818    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 15:43:24.848907 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.848879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"]
Jul 07 15:43:24.886270 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.886170    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768bb75c95-46rlq"]
Jul 07 15:43:24.887082 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.887053    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"]
Jul 07 15:43:24.890190 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.890173    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"
Jul 07 15:43:24.901858 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.901837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 15:43:24.904567 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.904537    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"]
Jul 07 15:43:24.909231 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.909210    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cpl7p\""
Jul 07 15:43:24.943951 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.943892    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-sm7rm"]
Jul 07 15:43:24.947556 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.947532    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-sm7rm"
Jul 07 15:43:24.950010 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.949986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-dt2rz\""
Jul 07 15:43:24.950119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.950038    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 15:43:24.950119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.950058    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 15:43:24.962688 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.962663    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fec4f431-6e05-4dec-abb8-4e6f30729135-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7rstm\" (UID: \"fec4f431-6e05-4dec-abb8-4e6f30729135\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"
Jul 07 15:43:24.962776 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.962708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q794d\" (UniqueName: \"kubernetes.io/projected/bb6cc144-855b-445d-bbf3-73367364072b-kube-api-access-q794d\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:24.962838 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.962769    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6cc144-855b-445d-bbf3-73367364072b-tmp\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:24.962915 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.962855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb6cc144-855b-445d-bbf3-73367364072b-klusterlet-config\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:24.964620 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:24.964597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-sm7rm"]
Jul 07 15:43:25.063662 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.063632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6cc144-855b-445d-bbf3-73367364072b-tmp\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:25.063865 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.063690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjwb7\" (UniqueName: \"kubernetes.io/projected/4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9-kube-api-access-rjwb7\") pod \"downloads-685bfb5f64-sm7rm\" (UID: \"4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9\") " pod="openshift-console/downloads-685bfb5f64-sm7rm"
Jul 07 15:43:25.063865 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.063737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb6cc144-855b-445d-bbf3-73367364072b-klusterlet-config\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:25.063865 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.063774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fec4f431-6e05-4dec-abb8-4e6f30729135-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7rstm\" (UID: \"fec4f431-6e05-4dec-abb8-4e6f30729135\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"
Jul 07 15:43:25.063865 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.063797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q794d\" (UniqueName: \"kubernetes.io/projected/bb6cc144-855b-445d-bbf3-73367364072b-kube-api-access-q794d\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:25.064148 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.064122    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb6cc144-855b-445d-bbf3-73367364072b-tmp\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:25.066484 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.066459    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fec4f431-6e05-4dec-abb8-4e6f30729135-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-7rstm\" (UID: \"fec4f431-6e05-4dec-abb8-4e6f30729135\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"
Jul 07 15:43:25.066810 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.066790    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bb6cc144-855b-445d-bbf3-73367364072b-klusterlet-config\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:25.075576 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.075550    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q794d\" (UniqueName: \"kubernetes.io/projected/bb6cc144-855b-445d-bbf3-73367364072b-kube-api-access-q794d\") pod \"klusterlet-addon-workmgr-cc8774d68-wxvzn\" (UID: \"bb6cc144-855b-445d-bbf3-73367364072b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:25.145943 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.145874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:25.164394 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.164357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjwb7\" (UniqueName: \"kubernetes.io/projected/4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9-kube-api-access-rjwb7\") pod \"downloads-685bfb5f64-sm7rm\" (UID: \"4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9\") " pod="openshift-console/downloads-685bfb5f64-sm7rm"
Jul 07 15:43:25.176321 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.176275    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjwb7\" (UniqueName: \"kubernetes.io/projected/4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9-kube-api-access-rjwb7\") pod \"downloads-685bfb5f64-sm7rm\" (UID: \"4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9\") " pod="openshift-console/downloads-685bfb5f64-sm7rm"
Jul 07 15:43:25.202364 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.202085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"
Jul 07 15:43:25.258888 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.258430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-sm7rm"
Jul 07 15:43:25.301135 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.301042    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"]
Jul 07 15:43:25.366382 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.366356    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"]
Jul 07 15:43:25.370339 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:25.370301    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec4f431_6e05_4dec_abb8_4e6f30729135.slice/crio-33fcd274a5df59b0652f88ce5dd17ffdb10246d5dee3c68060ef38950e9b20f9 WatchSource:0}: Error finding container 33fcd274a5df59b0652f88ce5dd17ffdb10246d5dee3c68060ef38950e9b20f9: Status 404 returned error can't find the container with id 33fcd274a5df59b0652f88ce5dd17ffdb10246d5dee3c68060ef38950e9b20f9
Jul 07 15:43:25.420508 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:25.420449    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-sm7rm"]
Jul 07 15:43:26.082185 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:26.082151    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm" event={"ID":"fec4f431-6e05-4dec-abb8-4e6f30729135","Type":"ContainerStarted","Data":"33fcd274a5df59b0652f88ce5dd17ffdb10246d5dee3c68060ef38950e9b20f9"}
Jul 07 15:43:26.083484 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:26.083456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn" event={"ID":"bb6cc144-855b-445d-bbf3-73367364072b","Type":"ContainerStarted","Data":"b6b337a26a6d060bb5019cef5b37986321bdc920c26b5b209d7d62cb12974182"}
Jul 07 15:43:26.453266 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:26.453200    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7edcb2_aab5_4b1e_9cdf_5c901dfdaea9.slice/crio-47ec16369f1856aedaf7f73e10ab819c7892d6c44dc4e3198287864adcbb673f WatchSource:0}: Error finding container 47ec16369f1856aedaf7f73e10ab819c7892d6c44dc4e3198287864adcbb673f: Status 404 returned error can't find the container with id 47ec16369f1856aedaf7f73e10ab819c7892d6c44dc4e3198287864adcbb673f
Jul 07 15:43:27.089018 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:27.088947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-sm7rm" event={"ID":"4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9","Type":"ContainerStarted","Data":"47ec16369f1856aedaf7f73e10ab819c7892d6c44dc4e3198287864adcbb673f"}
Jul 07 15:43:27.092821 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:27.091924    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szzvm" event={"ID":"eb90d776-91b9-4c65-b4e3-820227ca9f1b","Type":"ContainerStarted","Data":"17f91d6a8a78467c64fc6a9437dec26cce25d49fbf32dd5c7f3699a7c8739ffd"}
Jul 07 15:43:27.117684 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:27.117630    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-szzvm" podStartSLOduration=17.058875253 podStartE2EDuration="24.117611562s" totalImagesPullingTime="7.058736309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:43:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:27.116482973 +0000 UTC m=+86.972059853" watchObservedRunningTime="2026-07-07 15:43:27.117611562 +0000 UTC m=+86.973188455"
Jul 07 15:43:29.102241 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:29.102097    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm" event={"ID":"fec4f431-6e05-4dec-abb8-4e6f30729135","Type":"ContainerStarted","Data":"a7186db2ed55185480a9eb7cdf3a39b4d46b2a71dada675279fe19ebc007319d"}
Jul 07 15:43:29.102723 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:29.102320    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"
Jul 07 15:43:29.108141 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:29.108119    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm"
Jul 07 15:43:29.121960 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:29.121914    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-7rstm" podStartSLOduration=2.327676253 podStartE2EDuration="5.121896937s" totalImagesPullingTime="2.794220684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:29.121265169 +0000 UTC m=+88.976842049" watchObservedRunningTime="2026-07-07 15:43:29.121896937 +0000 UTC m=+88.977473818"
Jul 07 15:43:30.056296 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.056252    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74b9d76c96-6blt6"]
Jul 07 15:43:30.059589 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.059562    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.061919 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.061901    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 15:43:30.063059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.063011    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 15:43:30.063059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.063030    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 15:43:30.063059 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.063084    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 15:43:30.063347 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.063327    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9znj9\""
Jul 07 15:43:30.063908 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.063882    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 15:43:30.075883 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.075860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b9d76c96-6blt6"]
Jul 07 15:43:30.111407 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.111361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn" event={"ID":"bb6cc144-855b-445d-bbf3-73367364072b","Type":"ContainerStarted","Data":"b9bc66b95d8f4caf7e455971ee95ca475727ece180b553912a960692649c7523"}
Jul 07 15:43:30.111799 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.111453    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:30.113315 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.113275    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn"
Jul 07 15:43:30.138286 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.138248    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cc8774d68-wxvzn" podStartSLOduration=1.508637105 podStartE2EDuration="6.138233851s" totalImagesPullingTime="4.629596746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:30.137506856 +0000 UTC m=+89.993083735" watchObservedRunningTime="2026-07-07 15:43:30.138233851 +0000 UTC m=+89.993810730"
Jul 07 15:43:30.203903 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.203834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-oauth-serving-cert\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.203903 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.203872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-config\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.204067 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.203905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-service-ca\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.204067 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.204002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-serving-cert\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.204067 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.204047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhj9k\" (UniqueName: \"kubernetes.io/projected/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-kube-api-access-nhj9k\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.204218 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.204142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-oauth-config\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.305184 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.305153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-service-ca\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.305320 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.305195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-serving-cert\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.305320 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.305230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhj9k\" (UniqueName: \"kubernetes.io/projected/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-kube-api-access-nhj9k\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.305504 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.305469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-oauth-config\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.305607 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.305549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-oauth-serving-cert\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.305607 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.305589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-config\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.306319 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.306201    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-service-ca\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.306467 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.306320    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-oauth-serving-cert\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.306467 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.306424    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-config\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.308065 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.308044    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-serving-cert\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.308157 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.308108    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-oauth-config\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.328127 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.328105    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhj9k\" (UniqueName: \"kubernetes.io/projected/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-kube-api-access-nhj9k\") pod \"console-74b9d76c96-6blt6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") " pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.370966 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.370933    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:30.507298 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:30.507240    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74b9d76c96-6blt6"]
Jul 07 15:43:30.511653 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:30.511621    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea3b0d55_6a10_4b46_87f9_3390dbceb3d6.slice/crio-a79dfad9e64604e10d5483e5fa6a5a27555b2f93b2df07ff85138e41475506e0 WatchSource:0}: Error finding container a79dfad9e64604e10d5483e5fa6a5a27555b2f93b2df07ff85138e41475506e0: Status 404 returned error can't find the container with id a79dfad9e64604e10d5483e5fa6a5a27555b2f93b2df07ff85138e41475506e0
Jul 07 15:43:31.116083 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:31.116046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b9d76c96-6blt6" event={"ID":"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6","Type":"ContainerStarted","Data":"a79dfad9e64604e10d5483e5fa6a5a27555b2f93b2df07ff85138e41475506e0"}
Jul 07 15:43:34.129719 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:34.129680    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b9d76c96-6blt6" event={"ID":"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6","Type":"ContainerStarted","Data":"2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537"}
Jul 07 15:43:34.156780 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:34.156721    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74b9d76c96-6blt6" podStartSLOduration=0.74209595 podStartE2EDuration="4.156700979s" totalImagesPullingTime="3.414605029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:34.153992035 +0000 UTC m=+94.009568914" watchObservedRunningTime="2026-07-07 15:43:34.156700979 +0000 UTC m=+94.012277858"
Jul 07 15:43:34.891801 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:34.891775    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:35.125021 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.124986    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"]
Jul 07 15:43:35.128776 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.128758    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.132809 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.132782    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 15:43:35.133180 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.132903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 15:43:35.133529 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.133506    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fw5rb\""
Jul 07 15:43:35.133793 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.133775    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 15:43:35.144836 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.144381    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"]
Jul 07 15:43:35.148211 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.148175    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bxckb"]
Jul 07 15:43:35.151856 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.151806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.152397 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.152366    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"]
Jul 07 15:43:35.154638 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.154258    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 15:43:35.154638 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.154378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 15:43:35.154638 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.154488    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-56vcq\""
Jul 07 15:43:35.155842 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.155820    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.156064 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.155933    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 15:43:35.158346 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.158271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-n5brk\""
Jul 07 15:43:35.159212 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.158731    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 15:43:35.159212 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.159054    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 15:43:35.159212 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.159085    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 15:43:35.169395 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.169371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"]
Jul 07 15:43:35.245157 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/067047d9-6009-4a2c-80ad-1f3490f9eaa9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.245157 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245164    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.245392 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-wtmp\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.245392 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/067047d9-6009-4a2c-80ad-1f3490f9eaa9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.245392 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgszj\" (UniqueName: \"kubernetes.io/projected/067047d9-6009-4a2c-80ad-1f3490f9eaa9-kube-api-access-lgszj\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.245392 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-sys\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.245602 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc356441-15ea-4303-bfee-383038e24a70-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.245602 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.245602 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-root\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.245602 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245537    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx2xj\" (UniqueName: \"kubernetes.io/projected/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-kube-api-access-bx2xj\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.245602 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km9vz\" (UniqueName: \"kubernetes.io/projected/fc356441-15ea-4303-bfee-383038e24a70-kube-api-access-km9vz\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.245840 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-tls\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.245840 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.245840 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.245840 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.245840 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-textfile\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.245840 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-metrics-client-ca\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.246113 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/067047d9-6009-4a2c-80ad-1f3490f9eaa9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.246113 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.245936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc356441-15ea-4303-bfee-383038e24a70-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.346683 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/067047d9-6009-4a2c-80ad-1f3490f9eaa9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.346826 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc356441-15ea-4303-bfee-383038e24a70-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.346826 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346737    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/067047d9-6009-4a2c-80ad-1f3490f9eaa9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.346826 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.346826 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-wtmp\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347007 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/067047d9-6009-4a2c-80ad-1f3490f9eaa9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.347007 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgszj\" (UniqueName: \"kubernetes.io/projected/067047d9-6009-4a2c-80ad-1f3490f9eaa9-kube-api-access-lgszj\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.347007 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-sys\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347007 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc356441-15ea-4303-bfee-383038e24a70-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.347007 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.346953    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347007 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347001    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-root\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx2xj\" (UniqueName: \"kubernetes.io/projected/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-kube-api-access-bx2xj\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347055    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km9vz\" (UniqueName: \"kubernetes.io/projected/fc356441-15ea-4303-bfee-383038e24a70-kube-api-access-km9vz\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-tls\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347118    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-wtmp\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347190    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-root\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-textfile\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-metrics-client-ca\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347822 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347538    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-sys\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.347822 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347623    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fc356441-15ea-4303-bfee-383038e24a70-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.347822 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347730    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/067047d9-6009-4a2c-80ad-1f3490f9eaa9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.347972 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.347865    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-metrics-client-ca\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.348489 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.348131    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.348489 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.348381    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fc356441-15ea-4303-bfee-383038e24a70-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.348489 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.348402    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.348977 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.348912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-textfile\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.350068 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.350039    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/067047d9-6009-4a2c-80ad-1f3490f9eaa9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.350845 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.350818    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.351167 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.351138    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc356441-15ea-4303-bfee-383038e24a70-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.351256 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.351146    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-tls\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.351378 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.351355    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.351989 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.351969    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/067047d9-6009-4a2c-80ad-1f3490f9eaa9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.364112 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.364085    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx2xj\" (UniqueName: \"kubernetes.io/projected/a24d9075-cfef-47cb-b79b-2a525cbfb6ea-kube-api-access-bx2xj\") pod \"node-exporter-bxckb\" (UID: \"a24d9075-cfef-47cb-b79b-2a525cbfb6ea\") " pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.364386 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.364358    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgszj\" (UniqueName: \"kubernetes.io/projected/067047d9-6009-4a2c-80ad-1f3490f9eaa9-kube-api-access-lgszj\") pod \"openshift-state-metrics-54cf96dfcf-zbnt9\" (UID: \"067047d9-6009-4a2c-80ad-1f3490f9eaa9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.364883 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.364863    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-km9vz\" (UniqueName: \"kubernetes.io/projected/fc356441-15ea-4303-bfee-383038e24a70-kube-api-access-km9vz\") pod \"kube-state-metrics-7c9dbb8b7d-26q7c\" (UID: \"fc356441-15ea-4303-bfee-383038e24a70\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.446063 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.445997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"
Jul 07 15:43:35.468057 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.467865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxckb"
Jul 07 15:43:35.476382 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.476161    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"
Jul 07 15:43:35.615953 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.615861    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9"]
Jul 07 15:43:35.621542 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:35.621513    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067047d9_6009_4a2c_80ad_1f3490f9eaa9.slice/crio-5e28844bbe35d545a58b218b6f97e6ad9b154376bff753c4c74fbd03ebbc6fb4 WatchSource:0}: Error finding container 5e28844bbe35d545a58b218b6f97e6ad9b154376bff753c4c74fbd03ebbc6fb4: Status 404 returned error can't find the container with id 5e28844bbe35d545a58b218b6f97e6ad9b154376bff753c4c74fbd03ebbc6fb4
Jul 07 15:43:35.631722 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:35.631700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c"]
Jul 07 15:43:35.635894 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:35.635870    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc356441_15ea_4303_bfee_383038e24a70.slice/crio-99dd2a0d38721f61e197e78f82a48a2ea2b2d2699e4a61ce6390c474da5759b0 WatchSource:0}: Error finding container 99dd2a0d38721f61e197e78f82a48a2ea2b2d2699e4a61ce6390c474da5759b0: Status 404 returned error can't find the container with id 99dd2a0d38721f61e197e78f82a48a2ea2b2d2699e4a61ce6390c474da5759b0
Jul 07 15:43:36.143737 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:36.143700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c" event={"ID":"fc356441-15ea-4303-bfee-383038e24a70","Type":"ContainerStarted","Data":"99dd2a0d38721f61e197e78f82a48a2ea2b2d2699e4a61ce6390c474da5759b0"}
Jul 07 15:43:36.145936 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:36.145905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxckb" event={"ID":"a24d9075-cfef-47cb-b79b-2a525cbfb6ea","Type":"ContainerStarted","Data":"32348ad9a3b2131923a3a7f7551919c1679d38e81ae8d143239b07bbe7f4d202"}
Jul 07 15:43:36.148572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:36.148466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9" event={"ID":"067047d9-6009-4a2c-80ad-1f3490f9eaa9","Type":"ContainerStarted","Data":"15560b77fd8d488839da1afdcd524c49682e5197d1126bddbe1894fa63c15d27"}
Jul 07 15:43:36.148572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:36.148522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9" event={"ID":"067047d9-6009-4a2c-80ad-1f3490f9eaa9","Type":"ContainerStarted","Data":"4b27d0034a2b21c3bf7839b09db86dd0661e810758795f9d671115008ea3e30d"}
Jul 07 15:43:36.148572 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:36.148544    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9" event={"ID":"067047d9-6009-4a2c-80ad-1f3490f9eaa9","Type":"ContainerStarted","Data":"5e28844bbe35d545a58b218b6f97e6ad9b154376bff753c4c74fbd03ebbc6fb4"}
Jul 07 15:43:38.160230 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.160142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c" event={"ID":"fc356441-15ea-4303-bfee-383038e24a70","Type":"ContainerStarted","Data":"5f573079d6a9c1b34450d695d5b5f331e84d2e210da69f2a6dc57655f411f881"}
Jul 07 15:43:38.160230 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.160213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c" event={"ID":"fc356441-15ea-4303-bfee-383038e24a70","Type":"ContainerStarted","Data":"8664158c891408e98ab5e34401a81d571ba415941ca9b239658f5daf3940ee0b"}
Jul 07 15:43:38.160737 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.160242    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c" event={"ID":"fc356441-15ea-4303-bfee-383038e24a70","Type":"ContainerStarted","Data":"63dd2a97005042fc2ed3f5c25b60f6f18b46fcc19b33c09da7a0f36c1e5c2381"}
Jul 07 15:43:38.163702 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.163665    2581 generic.go:356] "Generic (PLEG): container finished" podID="a24d9075-cfef-47cb-b79b-2a525cbfb6ea" containerID="9d51a45b39e9dcf0b8f13d5ea1db7eacd466247cfa307f3da784b2c7470c4c85" exitCode=0
Jul 07 15:43:38.163823 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.163749    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxckb" event={"ID":"a24d9075-cfef-47cb-b79b-2a525cbfb6ea","Type":"ContainerDied","Data":"9d51a45b39e9dcf0b8f13d5ea1db7eacd466247cfa307f3da784b2c7470c4c85"}
Jul 07 15:43:38.167450 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.167377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9" event={"ID":"067047d9-6009-4a2c-80ad-1f3490f9eaa9","Type":"ContainerStarted","Data":"0345054a61a0e1dcacddbc5ccee13442cd3a3461d277ce3f637e42721b3ac026"}
Jul 07 15:43:38.193997 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.193945    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-26q7c" podStartSLOduration=1.238712584 podStartE2EDuration="3.193926334s" totalImagesPullingTime="1.95521375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:38.193459089 +0000 UTC m=+98.049035990" watchObservedRunningTime="2026-07-07 15:43:38.193926334 +0000 UTC m=+98.049503193"
Jul 07 15:43:38.219187 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.218021    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-zbnt9" podStartSLOduration=1.386378132 podStartE2EDuration="3.218002727s" totalImagesPullingTime="1.831624595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:38.217499556 +0000 UTC m=+98.073076474" watchObservedRunningTime="2026-07-07 15:43:38.218002727 +0000 UTC m=+98.073579614"
Jul 07 15:43:38.633202 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.633173    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55845694c5-bbwph"]
Jul 07 15:43:38.637886 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.637858    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.649884 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.649859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55845694c5-bbwph"]
Jul 07 15:43:38.650869 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.650847    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 15:43:38.788497 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.788460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srbgv\" (UniqueName: \"kubernetes.io/projected/bd71444a-3030-4e69-81a2-6a3aafd2bb89-kube-api-access-srbgv\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.788672 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.788511    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-oauth-config\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.788672 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.788564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-service-ca\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.788672 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.788633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-serving-cert\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.788672 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.788659    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-trusted-ca-bundle\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.788859 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.788706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-oauth-serving-cert\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.788859 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.788732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-config\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890032 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.889958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-service-ca\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890032 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-serving-cert\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890240 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-trusted-ca-bundle\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890240 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-oauth-serving-cert\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890367 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-config\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890367 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srbgv\" (UniqueName: \"kubernetes.io/projected/bd71444a-3030-4e69-81a2-6a3aafd2bb89-kube-api-access-srbgv\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890463 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-oauth-config\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890772 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890742    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-service-ca\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890951 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-oauth-serving-cert\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.890951 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.890948    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-trusted-ca-bundle\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.891109 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.891054    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-config\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.892884 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.892860    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-oauth-config\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.893108 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.893091    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-serving-cert\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.899950 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.899924    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srbgv\" (UniqueName: \"kubernetes.io/projected/bd71444a-3030-4e69-81a2-6a3aafd2bb89-kube-api-access-srbgv\") pod \"console-55845694c5-bbwph\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") " pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:38.951003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:38.950971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:40.371800 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:40.371762    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:40.372236 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:40.371826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:40.377652 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:40.377627    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:40.504922 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:40.504880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:43:40.507454 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:40.507423    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1360da7-5e9b-4c69-8086-bd51152a3eee-metrics-tls\") pod \"dns-default-frpn4\" (UID: \"d1360da7-5e9b-4c69-8086-bd51152a3eee\") " pod="openshift-dns/dns-default-frpn4"
Jul 07 15:43:40.758240 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:40.758171    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kr7tb\""
Jul 07 15:43:40.767091 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:40.766784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frpn4"
Jul 07 15:43:41.187087 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:41.187057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:43:43.033378 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:43.033342    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5lxpc"
Jul 07 15:43:45.319263 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.319230    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55845694c5-bbwph"]
Jul 07 15:43:45.380655 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.380624    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dc969467f-f25ln"]
Jul 07 15:43:45.397168 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.397143    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.406419 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.406399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc969467f-f25ln"]
Jul 07 15:43:45.445921 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.445891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-oauth-config\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.446022 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.445992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-oauth-serving-cert\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.446084 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.446062    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-service-ca\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.446154 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.446137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-trusted-ca-bundle\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.446202 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.446187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-serving-cert\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.446248 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.446215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-config\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.446248 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.446240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46ss6\" (UniqueName: \"kubernetes.io/projected/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-kube-api-access-46ss6\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.547204 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.547176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-oauth-serving-cert\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.547320 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.547234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-service-ca\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.547320 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.547311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-trusted-ca-bundle\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.547452 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.547344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-serving-cert\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.547452 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.547368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-config\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.547452 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.547393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ss6\" (UniqueName: \"kubernetes.io/projected/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-kube-api-access-46ss6\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.547604 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.547451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-oauth-config\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.548080 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.548030    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-oauth-serving-cert\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.548175 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.548090    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-service-ca\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.548746 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.548509    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-trusted-ca-bundle\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.548746 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.548693    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-config\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.550906 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.550550    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-serving-cert\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.551260 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.551212    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-oauth-config\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.561148 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.561101    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46ss6\" (UniqueName: \"kubernetes.io/projected/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-kube-api-access-46ss6\") pod \"console-7dc969467f-f25ln\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") " pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:45.589899 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.589876    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frpn4"]
Jul 07 15:43:45.592884 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:45.592856    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1360da7_5e9b_4c69_8086_bd51152a3eee.slice/crio-38335849c73b75c3505941b402b60965b2bf4c017a6f753519c44afe295484eb WatchSource:0}: Error finding container 38335849c73b75c3505941b402b60965b2bf4c017a6f753519c44afe295484eb: Status 404 returned error can't find the container with id 38335849c73b75c3505941b402b60965b2bf4c017a6f753519c44afe295484eb
Jul 07 15:43:45.611560 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.611539    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55845694c5-bbwph"]
Jul 07 15:43:45.614695 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:45.614675    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd71444a_3030_4e69_81a2_6a3aafd2bb89.slice/crio-ca0cf16f114c6f37bf962dbc8e833514f311d5856f773c0b4e737984ba0dde61 WatchSource:0}: Error finding container ca0cf16f114c6f37bf962dbc8e833514f311d5856f773c0b4e737984ba0dde61: Status 404 returned error can't find the container with id ca0cf16f114c6f37bf962dbc8e833514f311d5856f773c0b4e737984ba0dde61
Jul 07 15:43:45.707250 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:45.707224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:46.014687 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.014660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dc969467f-f25ln"]
Jul 07 15:43:46.017197 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:43:46.017172    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae66244_51e0_4fcb_8c7b_fcae098b2e3b.slice/crio-e0dcc290cc270681a43c87f16c19339e4720b8351cf07380954c60ee8d8841ea WatchSource:0}: Error finding container e0dcc290cc270681a43c87f16c19339e4720b8351cf07380954c60ee8d8841ea: Status 404 returned error can't find the container with id e0dcc290cc270681a43c87f16c19339e4720b8351cf07380954c60ee8d8841ea
Jul 07 15:43:46.205099 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.205029    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxckb" event={"ID":"a24d9075-cfef-47cb-b79b-2a525cbfb6ea","Type":"ContainerStarted","Data":"cb2772235d1c3c4c06a7bc261efcfbeb933189e553486e5a88087f35ec44c0d6"}
Jul 07 15:43:46.205273 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.205112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxckb" event={"ID":"a24d9075-cfef-47cb-b79b-2a525cbfb6ea","Type":"ContainerStarted","Data":"5bd6c551b724fa66822bbe7ce12cc61c3d982dfc10ee4857431245db5af7b521"}
Jul 07 15:43:46.206762 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.206734    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-sm7rm" event={"ID":"4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9","Type":"ContainerStarted","Data":"b5419d7a3ff2d3d1f0c156b30e7d059e25695abef54796e720044c76918ca128"}
Jul 07 15:43:46.206877 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.206790    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-sm7rm"
Jul 07 15:43:46.207976 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.207932    2581 patch_prober.go:28] interesting pod/downloads-685bfb5f64-sm7rm container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" start-of-body=
Jul 07 15:43:46.208132 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.207979    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-sm7rm" podUID="4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused"
Jul 07 15:43:46.208132 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.208035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frpn4" event={"ID":"d1360da7-5e9b-4c69-8086-bd51152a3eee","Type":"ContainerStarted","Data":"38335849c73b75c3505941b402b60965b2bf4c017a6f753519c44afe295484eb"}
Jul 07 15:43:46.210084 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.209992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55845694c5-bbwph" event={"ID":"bd71444a-3030-4e69-81a2-6a3aafd2bb89","Type":"ContainerStarted","Data":"22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783"}
Jul 07 15:43:46.210084 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.210034    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55845694c5-bbwph" event={"ID":"bd71444a-3030-4e69-81a2-6a3aafd2bb89","Type":"ContainerStarted","Data":"ca0cf16f114c6f37bf962dbc8e833514f311d5856f773c0b4e737984ba0dde61"}
Jul 07 15:43:46.212030 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.211813    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc969467f-f25ln" event={"ID":"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b","Type":"ContainerStarted","Data":"b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0"}
Jul 07 15:43:46.212030 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.211855    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc969467f-f25ln" event={"ID":"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b","Type":"ContainerStarted","Data":"e0dcc290cc270681a43c87f16c19339e4720b8351cf07380954c60ee8d8841ea"}
Jul 07 15:43:46.236415 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.236365    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bxckb" podStartSLOduration=9.035681942 podStartE2EDuration="11.236346048s" totalImagesPullingTime="2.10941169s" totalInitContainerRuntime="91.252416ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:46.23497793 +0000 UTC m=+106.090554812" watchObservedRunningTime="2026-07-07 15:43:46.236346048 +0000 UTC m=+106.091922929"
Jul 07 15:43:46.258979 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.258930    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-sm7rm" podStartSLOduration=2.783492228 podStartE2EDuration="22.258911848s" totalImagesPullingTime="19.47541962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:46.258174168 +0000 UTC m=+106.113751049" watchObservedRunningTime="2026-07-07 15:43:46.258911848 +0000 UTC m=+106.114488728"
Jul 07 15:43:46.289013 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.288948    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55845694c5-bbwph" podStartSLOduration=8.28892851 podStartE2EDuration="8.28892851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:46.288056396 +0000 UTC m=+106.143633275" watchObservedRunningTime="2026-07-07 15:43:46.28892851 +0000 UTC m=+106.144505391"
Jul 07 15:43:46.309897 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:46.309820    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dc969467f-f25ln" podStartSLOduration=1.309799274 podStartE2EDuration="1.309799274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:43:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:46.308538625 +0000 UTC m=+106.164115505" watchObservedRunningTime="2026-07-07 15:43:46.309799274 +0000 UTC m=+106.165376154"
Jul 07 15:43:47.229806 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:47.229705    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-sm7rm"
Jul 07 15:43:48.951861 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:48.951795    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:43:49.228209 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:49.228116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frpn4" event={"ID":"d1360da7-5e9b-4c69-8086-bd51152a3eee","Type":"ContainerStarted","Data":"a88d59d3f4c570023265e322af85bbcfaacd93cac2c53df1848210a1f5a0e058"}
Jul 07 15:43:49.228209 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:49.228178    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frpn4" event={"ID":"d1360da7-5e9b-4c69-8086-bd51152a3eee","Type":"ContainerStarted","Data":"5506ccb4f5f22756c5f62029678ec6b8a90d12909975eba770c68ba58842ebec"}
Jul 07 15:43:49.228489 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:49.228297    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-frpn4"
Jul 07 15:43:49.250581 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:49.250532    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-frpn4" podStartSLOduration=70.763954537 podStartE2EDuration="1m13.250515333s" totalImagesPullingTime="2.486560796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:43:49.249498005 +0000 UTC m=+109.105074898" watchObservedRunningTime="2026-07-07 15:43:49.250515333 +0000 UTC m=+109.106092222"
Jul 07 15:43:49.911936 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:49.911896    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-768bb75c95-46rlq" podUID="65429566-aedd-44af-859a-499e3185aefe" containerName="registry" containerID="cri-o://597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c" gracePeriod=30
Jul 07 15:43:50.208505 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.208478    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:50.234455 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.234422    2581 generic.go:356] "Generic (PLEG): container finished" podID="65429566-aedd-44af-859a-499e3185aefe" containerID="597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c" exitCode=0
Jul 07 15:43:50.234633 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.234488    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-768bb75c95-46rlq"
Jul 07 15:43:50.234633 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.234531    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bb75c95-46rlq" event={"ID":"65429566-aedd-44af-859a-499e3185aefe","Type":"ContainerDied","Data":"597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c"}
Jul 07 15:43:50.234633 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.234586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-768bb75c95-46rlq" event={"ID":"65429566-aedd-44af-859a-499e3185aefe","Type":"ContainerDied","Data":"dbf9d37af7093287a5451e6ffeb49f8cc83ab11a3ae7e7eba847441493981f85"}
Jul 07 15:43:50.234633 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.234620    2581 scope.go:117] "RemoveContainer" containerID="597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c"
Jul 07 15:43:50.245861 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.245813    2581 scope.go:117] "RemoveContainer" containerID="597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c"
Jul 07 15:43:50.246347 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:43:50.246318    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c\": container with ID starting with 597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c not found: ID does not exist" containerID="597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c"
Jul 07 15:43:50.246456 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.246356    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c"} err="failed to get container status \"597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c\": rpc error: code = NotFound desc = could not find container \"597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c\": container with ID starting with 597edfbcbf6f7cc89825d1b7cc7afc0d919e51958369b22dfe6ee4b3785f8b6c not found: ID does not exist"
Jul 07 15:43:50.288733 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.288710    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-bound-sa-token\") pod \"65429566-aedd-44af-859a-499e3185aefe\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") "
Jul 07 15:43:50.288854 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.288747    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-image-registry-private-configuration\") pod \"65429566-aedd-44af-859a-499e3185aefe\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") "
Jul 07 15:43:50.288854 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.288767    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") pod \"65429566-aedd-44af-859a-499e3185aefe\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") "
Jul 07 15:43:50.288854 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.288793    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65429566-aedd-44af-859a-499e3185aefe-ca-trust-extracted\") pod \"65429566-aedd-44af-859a-499e3185aefe\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") "
Jul 07 15:43:50.288854 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.288820    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-trusted-ca\") pod \"65429566-aedd-44af-859a-499e3185aefe\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") "
Jul 07 15:43:50.289063 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.288865    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-registry-certificates\") pod \"65429566-aedd-44af-859a-499e3185aefe\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") "
Jul 07 15:43:50.289063 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.288948    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-installation-pull-secrets\") pod \"65429566-aedd-44af-859a-499e3185aefe\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") "
Jul 07 15:43:50.289063 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.288981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x26n7\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-kube-api-access-x26n7\") pod \"65429566-aedd-44af-859a-499e3185aefe\" (UID: \"65429566-aedd-44af-859a-499e3185aefe\") "
Jul 07 15:43:50.289791 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.289262    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "65429566-aedd-44af-859a-499e3185aefe" (UID: "65429566-aedd-44af-859a-499e3185aefe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:43:50.289791 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.289631    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "65429566-aedd-44af-859a-499e3185aefe" (UID: "65429566-aedd-44af-859a-499e3185aefe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:43:50.292015 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.291990    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "65429566-aedd-44af-859a-499e3185aefe" (UID: "65429566-aedd-44af-859a-499e3185aefe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:43:50.292379 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.292348    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "65429566-aedd-44af-859a-499e3185aefe" (UID: "65429566-aedd-44af-859a-499e3185aefe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:43:50.292501 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.292480    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-kube-api-access-x26n7" (OuterVolumeSpecName: "kube-api-access-x26n7") pod "65429566-aedd-44af-859a-499e3185aefe" (UID: "65429566-aedd-44af-859a-499e3185aefe"). InnerVolumeSpecName "kube-api-access-x26n7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:43:50.292742 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.292716    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "65429566-aedd-44af-859a-499e3185aefe" (UID: "65429566-aedd-44af-859a-499e3185aefe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:43:50.293003 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.292974    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "65429566-aedd-44af-859a-499e3185aefe" (UID: "65429566-aedd-44af-859a-499e3185aefe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:43:50.299464 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.299440    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65429566-aedd-44af-859a-499e3185aefe-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "65429566-aedd-44af-859a-499e3185aefe" (UID: "65429566-aedd-44af-859a-499e3185aefe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:43:50.390176 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.390146    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-installation-pull-secrets\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:43:50.390176 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.390170    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x26n7\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-kube-api-access-x26n7\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:43:50.390367 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.390181    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-bound-sa-token\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:43:50.390367 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.390193    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65429566-aedd-44af-859a-499e3185aefe-image-registry-private-configuration\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:43:50.390367 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.390206    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65429566-aedd-44af-859a-499e3185aefe-registry-tls\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:43:50.390367 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.390219    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65429566-aedd-44af-859a-499e3185aefe-ca-trust-extracted\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:43:50.390367 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.390228    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-trusted-ca\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:43:50.390367 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.390236    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65429566-aedd-44af-859a-499e3185aefe-registry-certificates\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:43:50.602674 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.602640    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-768bb75c95-46rlq"]
Jul 07 15:43:50.615892 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.615863    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-768bb75c95-46rlq"]
Jul 07 15:43:50.644582 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:50.644557    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65429566-aedd-44af-859a-499e3185aefe" path="/var/lib/kubelet/pods/65429566-aedd-44af-859a-499e3185aefe/volumes"
Jul 07 15:43:55.708094 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:55.708058    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:55.708515 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:55.708119    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:55.712805 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:55.712782    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:56.263516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:56.263488    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:43:56.332633 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:56.332600    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74b9d76c96-6blt6"]
Jul 07 15:43:59.236719 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:43:59.236691    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-frpn4"
Jul 07 15:44:10.352119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:10.352089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:44:10.354276 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:10.354257    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e462eb51-3312-4c10-b4ed-95708d85ec81-metrics-certs\") pod \"network-metrics-daemon-rxh56\" (UID: \"e462eb51-3312-4c10-b4ed-95708d85ec81\") " pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:44:10.652973 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:10.652908    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-88kw6\""
Jul 07 15:44:10.661538 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:10.661518    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rxh56"
Jul 07 15:44:10.831907 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:10.831881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rxh56"]
Jul 07 15:44:10.833473 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:44:10.833445    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode462eb51_3312_4c10_b4ed_95708d85ec81.slice/crio-7a181f5888ee70903fa48631a38cdbc7f3613f1e9d36886afbf74d2b02e2b34c WatchSource:0}: Error finding container 7a181f5888ee70903fa48631a38cdbc7f3613f1e9d36886afbf74d2b02e2b34c: Status 404 returned error can't find the container with id 7a181f5888ee70903fa48631a38cdbc7f3613f1e9d36886afbf74d2b02e2b34c
Jul 07 15:44:11.234518 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.234488    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55845694c5-bbwph" podUID="bd71444a-3030-4e69-81a2-6a3aafd2bb89" containerName="console" containerID="cri-o://22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783" gracePeriod=15
Jul 07 15:44:11.321689 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.321653    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxh56" event={"ID":"e462eb51-3312-4c10-b4ed-95708d85ec81","Type":"ContainerStarted","Data":"7a181f5888ee70903fa48631a38cdbc7f3613f1e9d36886afbf74d2b02e2b34c"}
Jul 07 15:44:11.525793 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.525768    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:44:11.562816 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.562786    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-config\") pod \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") "
Jul 07 15:44:11.562959 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.562833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-service-ca\") pod \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") "
Jul 07 15:44:11.562959 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.562887    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srbgv\" (UniqueName: \"kubernetes.io/projected/bd71444a-3030-4e69-81a2-6a3aafd2bb89-kube-api-access-srbgv\") pod \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") "
Jul 07 15:44:11.562959 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.562926    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-serving-cert\") pod \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") "
Jul 07 15:44:11.562959 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.562956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-oauth-config\") pod \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") "
Jul 07 15:44:11.563599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.563014    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-trusted-ca-bundle\") pod \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") "
Jul 07 15:44:11.563599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.563038    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-oauth-serving-cert\") pod \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\" (UID: \"bd71444a-3030-4e69-81a2-6a3aafd2bb89\") "
Jul 07 15:44:11.563599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.563241    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-config" (OuterVolumeSpecName: "console-config") pod "bd71444a-3030-4e69-81a2-6a3aafd2bb89" (UID: "bd71444a-3030-4e69-81a2-6a3aafd2bb89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:11.563599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.563329    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd71444a-3030-4e69-81a2-6a3aafd2bb89" (UID: "bd71444a-3030-4e69-81a2-6a3aafd2bb89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:11.563599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.563554    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd71444a-3030-4e69-81a2-6a3aafd2bb89" (UID: "bd71444a-3030-4e69-81a2-6a3aafd2bb89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:11.563599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.563574    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd71444a-3030-4e69-81a2-6a3aafd2bb89" (UID: "bd71444a-3030-4e69-81a2-6a3aafd2bb89"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:11.566066 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.565875    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd71444a-3030-4e69-81a2-6a3aafd2bb89" (UID: "bd71444a-3030-4e69-81a2-6a3aafd2bb89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:44:11.566066 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.565942    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd71444a-3030-4e69-81a2-6a3aafd2bb89" (UID: "bd71444a-3030-4e69-81a2-6a3aafd2bb89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:44:11.566237 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.566104    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd71444a-3030-4e69-81a2-6a3aafd2bb89-kube-api-access-srbgv" (OuterVolumeSpecName: "kube-api-access-srbgv") pod "bd71444a-3030-4e69-81a2-6a3aafd2bb89" (UID: "bd71444a-3030-4e69-81a2-6a3aafd2bb89"). InnerVolumeSpecName "kube-api-access-srbgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:44:11.663534 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.663512    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-trusted-ca-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:11.663534 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.663534    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-oauth-serving-cert\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:11.663660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.663543    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-config\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:11.663660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.663550    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd71444a-3030-4e69-81a2-6a3aafd2bb89-service-ca\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:11.663660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.663558    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srbgv\" (UniqueName: \"kubernetes.io/projected/bd71444a-3030-4e69-81a2-6a3aafd2bb89-kube-api-access-srbgv\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:11.663660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.663567    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-serving-cert\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:11.663660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:11.663575    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd71444a-3030-4e69-81a2-6a3aafd2bb89-console-oauth-config\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:12.326650 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.326622    2581 generic.go:356] "Generic (PLEG): container finished" podID="bd71444a-3030-4e69-81a2-6a3aafd2bb89" containerID="22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783" exitCode=0
Jul 07 15:44:12.326763 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.326672    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55845694c5-bbwph"
Jul 07 15:44:12.326763 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.326663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55845694c5-bbwph" event={"ID":"bd71444a-3030-4e69-81a2-6a3aafd2bb89","Type":"ContainerDied","Data":"22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783"}
Jul 07 15:44:12.326867 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.326789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55845694c5-bbwph" event={"ID":"bd71444a-3030-4e69-81a2-6a3aafd2bb89","Type":"ContainerDied","Data":"ca0cf16f114c6f37bf962dbc8e833514f311d5856f773c0b4e737984ba0dde61"}
Jul 07 15:44:12.326867 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.326809    2581 scope.go:117] "RemoveContainer" containerID="22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783"
Jul 07 15:44:12.335375 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.334998    2581 scope.go:117] "RemoveContainer" containerID="22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783"
Jul 07 15:44:12.335375 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:44:12.335269    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783\": container with ID starting with 22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783 not found: ID does not exist" containerID="22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783"
Jul 07 15:44:12.335479 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.335388    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783"} err="failed to get container status \"22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783\": rpc error: code = NotFound desc = could not find container \"22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783\": container with ID starting with 22e5a91e1d58f88866ca7be0c0377fcd8291fda896484d2f248791fc4856d783 not found: ID does not exist"
Jul 07 15:44:12.357753 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.357734    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55845694c5-bbwph"]
Jul 07 15:44:12.369235 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.369213    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55845694c5-bbwph"]
Jul 07 15:44:12.643181 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:12.643155    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd71444a-3030-4e69-81a2-6a3aafd2bb89" path="/var/lib/kubelet/pods/bd71444a-3030-4e69-81a2-6a3aafd2bb89/volumes"
Jul 07 15:44:13.331541 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:13.331503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxh56" event={"ID":"e462eb51-3312-4c10-b4ed-95708d85ec81","Type":"ContainerStarted","Data":"c2cc6e92b62d59571f1dba2421cfa510aa165dcbe47c166d3fd2a570ca14a0e8"}
Jul 07 15:44:13.331796 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:13.331586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rxh56" event={"ID":"e462eb51-3312-4c10-b4ed-95708d85ec81","Type":"ContainerStarted","Data":"6f236189a069ada21b648b23b84e9f075cb4efe41133db689c353e1c7000dd3e"}
Jul 07 15:44:13.349735 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:13.349690    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rxh56" podStartSLOduration=131.86164373 podStartE2EDuration="2m13.34967553s" totalImagesPullingTime="1.4880318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:44:13.348403163 +0000 UTC m=+133.203980043" watchObservedRunningTime="2026-07-07 15:44:13.34967553 +0000 UTC m=+133.205252422"
Jul 07 15:44:21.352658 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.352591    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74b9d76c96-6blt6" podUID="ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" containerName="console" containerID="cri-o://2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537" gracePeriod=15
Jul 07 15:44:21.621159 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.621103    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:44:21.734329 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734301    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-config\") pod \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") "
Jul 07 15:44:21.734446 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734338    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-oauth-serving-cert\") pod \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") "
Jul 07 15:44:21.734446 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734361    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-serving-cert\") pod \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") "
Jul 07 15:44:21.734527 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734492    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-oauth-config\") pod \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") "
Jul 07 15:44:21.734589 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734575    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-service-ca\") pod \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") "
Jul 07 15:44:21.734630 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734607    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhj9k\" (UniqueName: \"kubernetes.io/projected/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-kube-api-access-nhj9k\") pod \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\" (UID: \"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6\") "
Jul 07 15:44:21.734752 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734720    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-config" (OuterVolumeSpecName: "console-config") pod "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" (UID: "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:21.734849 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734820    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" (UID: "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:21.734913 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734896    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-config\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:21.734989 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.734959    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-service-ca" (OuterVolumeSpecName: "service-ca") pod "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" (UID: "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:44:21.736499 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.736470    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" (UID: "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:44:21.736599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.736570    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" (UID: "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:44:21.736599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.736579    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-kube-api-access-nhj9k" (OuterVolumeSpecName: "kube-api-access-nhj9k") pod "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" (UID: "ea3b0d55-6a10-4b46-87f9-3390dbceb3d6"). InnerVolumeSpecName "kube-api-access-nhj9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:44:21.836027 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.836000    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-oauth-serving-cert\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:21.836027 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.836024    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-serving-cert\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:21.836147 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.836038    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-console-oauth-config\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:21.836147 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.836051    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-service-ca\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:21.836147 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:21.836064    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhj9k\" (UniqueName: \"kubernetes.io/projected/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6-kube-api-access-nhj9k\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:44:22.365148 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.365113    2581 generic.go:356] "Generic (PLEG): container finished" podID="ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" containerID="2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537" exitCode=0
Jul 07 15:44:22.365628 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.365166    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74b9d76c96-6blt6"
Jul 07 15:44:22.365628 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.365198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b9d76c96-6blt6" event={"ID":"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6","Type":"ContainerDied","Data":"2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537"}
Jul 07 15:44:22.365628 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.365244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74b9d76c96-6blt6" event={"ID":"ea3b0d55-6a10-4b46-87f9-3390dbceb3d6","Type":"ContainerDied","Data":"a79dfad9e64604e10d5483e5fa6a5a27555b2f93b2df07ff85138e41475506e0"}
Jul 07 15:44:22.365628 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.365263    2581 scope.go:117] "RemoveContainer" containerID="2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537"
Jul 07 15:44:22.373133 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.373117    2581 scope.go:117] "RemoveContainer" containerID="2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537"
Jul 07 15:44:22.373464 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:44:22.373441    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537\": container with ID starting with 2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537 not found: ID does not exist" containerID="2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537"
Jul 07 15:44:22.373543 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.373471    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537"} err="failed to get container status \"2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537\": rpc error: code = NotFound desc = could not find container \"2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537\": container with ID starting with 2533a05ec3a5f9b12fdc1e7dc6e0fd8961737ef599aff685c1563bb83e2bc537 not found: ID does not exist"
Jul 07 15:44:22.398093 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.398065    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74b9d76c96-6blt6"]
Jul 07 15:44:22.406562 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.406534    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74b9d76c96-6blt6"]
Jul 07 15:44:22.643276 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:22.643210    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" path="/var/lib/kubelet/pods/ea3b0d55-6a10-4b46-87f9-3390dbceb3d6/volumes"
Jul 07 15:44:31.397975 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:31.397938    2581 generic.go:356] "Generic (PLEG): container finished" podID="fa9393d3-c78a-4192-9ea7-d32bee6bc414" containerID="6a81ebbb2f4b44bd3d4e9b73092aa68229997bc83b27aca3662ea568b62dbab6" exitCode=0
Jul 07 15:44:31.398399 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:31.398009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn" event={"ID":"fa9393d3-c78a-4192-9ea7-d32bee6bc414","Type":"ContainerDied","Data":"6a81ebbb2f4b44bd3d4e9b73092aa68229997bc83b27aca3662ea568b62dbab6"}
Jul 07 15:44:31.398399 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:31.398311    2581 scope.go:117] "RemoveContainer" containerID="6a81ebbb2f4b44bd3d4e9b73092aa68229997bc83b27aca3662ea568b62dbab6"
Jul 07 15:44:32.403875 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:32.403842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-bwrxn" event={"ID":"fa9393d3-c78a-4192-9ea7-d32bee6bc414","Type":"ContainerStarted","Data":"95eb13819c038c6a23138a17eecf3f84739125c3691f4cb8490c6ac25c6d6be1"}
Jul 07 15:44:54.667536 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.667329    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568f9c4c88-7f2fr"]
Jul 07 15:44:54.667995 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.667938    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd71444a-3030-4e69-81a2-6a3aafd2bb89" containerName="console"
Jul 07 15:44:54.667995 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.667958    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd71444a-3030-4e69-81a2-6a3aafd2bb89" containerName="console"
Jul 07 15:44:54.667995 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.667977    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" containerName="console"
Jul 07 15:44:54.667995 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.667989    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" containerName="console"
Jul 07 15:44:54.668181 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.668015    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65429566-aedd-44af-859a-499e3185aefe" containerName="registry"
Jul 07 15:44:54.668181 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.668025    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="65429566-aedd-44af-859a-499e3185aefe" containerName="registry"
Jul 07 15:44:54.668181 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.668165    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea3b0d55-6a10-4b46-87f9-3390dbceb3d6" containerName="console"
Jul 07 15:44:54.668181 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.668180    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="65429566-aedd-44af-859a-499e3185aefe" containerName="registry"
Jul 07 15:44:54.668379 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.668195    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd71444a-3030-4e69-81a2-6a3aafd2bb89" containerName="console"
Jul 07 15:44:54.670956 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.670915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.686913 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.686889    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568f9c4c88-7f2fr"]
Jul 07 15:44:54.780490 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.780466    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-service-ca\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.780603 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.780498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzfc\" (UniqueName: \"kubernetes.io/projected/33686f66-58dc-48af-910f-127e9c42871a-kube-api-access-zrzfc\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.780603 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.780524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-trusted-ca-bundle\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.780603 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.780563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-oauth-serving-cert\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.780714 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.780605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-console-config\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.780714 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.780636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-serving-cert\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.780714 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.780667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-oauth-config\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.881439 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.881404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-trusted-ca-bundle\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.881540 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.881441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-oauth-serving-cert\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.881540 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.881461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-console-config\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.881668 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.881647    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-serving-cert\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.881720 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.881706    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-oauth-config\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.881786 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.881771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-service-ca\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.881837 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.881812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzfc\" (UniqueName: \"kubernetes.io/projected/33686f66-58dc-48af-910f-127e9c42871a-kube-api-access-zrzfc\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.882221 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.882193    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-console-config\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.882341 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.882220    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-oauth-serving-cert\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.882414 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.882348    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-trusted-ca-bundle\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.882414 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.882387    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-service-ca\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.884052 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.884031    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-oauth-config\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.884124 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.884097    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-serving-cert\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.898294 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.898254    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzfc\" (UniqueName: \"kubernetes.io/projected/33686f66-58dc-48af-910f-127e9c42871a-kube-api-access-zrzfc\") pod \"console-568f9c4c88-7f2fr\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") " pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:54.980801 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:54.980753    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:44:55.108345 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:55.108321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568f9c4c88-7f2fr"]
Jul 07 15:44:55.110172 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:44:55.110148    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33686f66_58dc_48af_910f_127e9c42871a.slice/crio-2431bee3f84744289dbdf1234b8c13d619e21cd59f51896a8eae6d42ac3e64b5 WatchSource:0}: Error finding container 2431bee3f84744289dbdf1234b8c13d619e21cd59f51896a8eae6d42ac3e64b5: Status 404 returned error can't find the container with id 2431bee3f84744289dbdf1234b8c13d619e21cd59f51896a8eae6d42ac3e64b5
Jul 07 15:44:55.490634 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:55.490598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568f9c4c88-7f2fr" event={"ID":"33686f66-58dc-48af-910f-127e9c42871a","Type":"ContainerStarted","Data":"aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd"}
Jul 07 15:44:55.490812 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:55.490653    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568f9c4c88-7f2fr" event={"ID":"33686f66-58dc-48af-910f-127e9c42871a","Type":"ContainerStarted","Data":"2431bee3f84744289dbdf1234b8c13d619e21cd59f51896a8eae6d42ac3e64b5"}
Jul 07 15:44:55.513416 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:44:55.513370    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568f9c4c88-7f2fr" podStartSLOduration=1.513354879 podStartE2EDuration="1.513354879s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:44:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:44:55.511383819 +0000 UTC m=+175.366960709" watchObservedRunningTime="2026-07-07 15:44:55.513354879 +0000 UTC m=+175.368931790"
Jul 07 15:45:04.980896 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:04.980863    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:45:04.981275 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:04.980926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:45:04.985477 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:04.985455    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:45:05.534749 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:05.534721    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:45:05.593970 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:05.593935    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc969467f-f25ln"]
Jul 07 15:45:30.614043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.613980    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dc969467f-f25ln" podUID="1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" containerName="console" containerID="cri-o://b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0" gracePeriod=15
Jul 07 15:45:30.847503 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.847477    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:45:30.929576 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.929519    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46ss6\" (UniqueName: \"kubernetes.io/projected/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-kube-api-access-46ss6\") pod \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") "
Jul 07 15:45:30.929576 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.929550    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-config\") pod \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") "
Jul 07 15:45:30.929576 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.929576    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-trusted-ca-bundle\") pod \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") "
Jul 07 15:45:30.929741 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.929602    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-service-ca\") pod \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") "
Jul 07 15:45:30.929741 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.929630    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-serving-cert\") pod \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") "
Jul 07 15:45:30.929741 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.929667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-oauth-config\") pod \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") "
Jul 07 15:45:30.929741 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.929691    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-oauth-serving-cert\") pod \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\" (UID: \"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b\") "
Jul 07 15:45:30.929974 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.929954    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" (UID: "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:45:30.930101 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.930067    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-service-ca" (OuterVolumeSpecName: "service-ca") pod "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" (UID: "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:45:30.930203 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.930165    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" (UID: "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:45:30.930203 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.930173    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-config" (OuterVolumeSpecName: "console-config") pod "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" (UID: "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:45:30.931712 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.931690    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" (UID: "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:45:30.931805 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.931737    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-kube-api-access-46ss6" (OuterVolumeSpecName: "kube-api-access-46ss6") pod "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" (UID: "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b"). InnerVolumeSpecName "kube-api-access-46ss6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:45:30.931864 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:30.931815    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" (UID: "1ae66244-51e0-4fcb-8c7b-fcae098b2e3b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:45:31.030624 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.030581    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-trusted-ca-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:45:31.030624 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.030617    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-service-ca\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:45:31.030624 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.030630    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-serving-cert\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:45:31.030855 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.030642    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-oauth-config\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:45:31.030855 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.030654    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-oauth-serving-cert\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:45:31.030855 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.030665    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46ss6\" (UniqueName: \"kubernetes.io/projected/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-kube-api-access-46ss6\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:45:31.030855 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.030677    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b-console-config\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:45:31.622774 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.622738    2581 generic.go:356] "Generic (PLEG): container finished" podID="1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" containerID="b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0" exitCode=0
Jul 07 15:45:31.623152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.622787    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dc969467f-f25ln"
Jul 07 15:45:31.623152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.622828    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc969467f-f25ln" event={"ID":"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b","Type":"ContainerDied","Data":"b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0"}
Jul 07 15:45:31.623152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.622884    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dc969467f-f25ln" event={"ID":"1ae66244-51e0-4fcb-8c7b-fcae098b2e3b","Type":"ContainerDied","Data":"e0dcc290cc270681a43c87f16c19339e4720b8351cf07380954c60ee8d8841ea"}
Jul 07 15:45:31.623152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.622905    2581 scope.go:117] "RemoveContainer" containerID="b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0"
Jul 07 15:45:31.631147 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.631130    2581 scope.go:117] "RemoveContainer" containerID="b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0"
Jul 07 15:45:31.631402 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:45:31.631380    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0\": container with ID starting with b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0 not found: ID does not exist" containerID="b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0"
Jul 07 15:45:31.631475 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.631415    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0"} err="failed to get container status \"b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0\": rpc error: code = NotFound desc = could not find container \"b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0\": container with ID starting with b66e8cfe8b556cfdd5dffd497d201c45e3d0221d7ada70fdf15fdc6fae3605c0 not found: ID does not exist"
Jul 07 15:45:31.652050 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.652027    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dc969467f-f25ln"]
Jul 07 15:45:31.654838 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:31.654819    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dc969467f-f25ln"]
Jul 07 15:45:32.643730 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:45:32.643696    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" path="/var/lib/kubelet/pods/1ae66244-51e0-4fcb-8c7b-fcae098b2e3b/volumes"
Jul 07 15:46:01.011187 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.011153    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"]
Jul 07 15:46:01.011599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.011460    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" containerName="console"
Jul 07 15:46:01.011599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.011472    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" containerName="console"
Jul 07 15:46:01.011599 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.011522    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ae66244-51e0-4fcb-8c7b-fcae098b2e3b" containerName="console"
Jul 07 15:46:01.013971 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.013952    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.016171 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.016147    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:46:01.016461 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.016440    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:46:01.016752 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.016737    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hc8tb\""
Jul 07 15:46:01.023427 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.023404    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"]
Jul 07 15:46:01.135401 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.135368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4k4w\" (UniqueName: \"kubernetes.io/projected/e1063803-27ef-4513-8273-ce144e495149-kube-api-access-m4k4w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.135522 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.135415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.135522 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.135480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.236009 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.235976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.236200 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.236024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.236200 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.236062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4k4w\" (UniqueName: \"kubernetes.io/projected/e1063803-27ef-4513-8273-ce144e495149-kube-api-access-m4k4w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.236447 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.236425    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.236447 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.236441    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.246062 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.246039    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4k4w\" (UniqueName: \"kubernetes.io/projected/e1063803-27ef-4513-8273-ce144e495149-kube-api-access-m4k4w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.323608 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.323557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:01.447943 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.447918    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"]
Jul 07 15:46:01.450273 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:46:01.450248    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1063803_27ef_4513_8273_ce144e495149.slice/crio-0076ffb98b0f23ecc28847a4106e82938928c70d2205347b81c246d28f26bc86 WatchSource:0}: Error finding container 0076ffb98b0f23ecc28847a4106e82938928c70d2205347b81c246d28f26bc86: Status 404 returned error can't find the container with id 0076ffb98b0f23ecc28847a4106e82938928c70d2205347b81c246d28f26bc86
Jul 07 15:46:01.725409 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:01.725378    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4" event={"ID":"e1063803-27ef-4513-8273-ce144e495149","Type":"ContainerStarted","Data":"0076ffb98b0f23ecc28847a4106e82938928c70d2205347b81c246d28f26bc86"}
Jul 07 15:46:06.746352 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:06.746318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4" event={"ID":"e1063803-27ef-4513-8273-ce144e495149","Type":"ContainerStarted","Data":"406e201b8b0906965cc309c56ae17781c5f104d89d98c3dfbf5d41f066d8ebe2"}
Jul 07 15:46:07.751263 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:07.751228    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1063803-27ef-4513-8273-ce144e495149" containerID="406e201b8b0906965cc309c56ae17781c5f104d89d98c3dfbf5d41f066d8ebe2" exitCode=0
Jul 07 15:46:07.751630 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:07.751318    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4" event={"ID":"e1063803-27ef-4513-8273-ce144e495149","Type":"ContainerDied","Data":"406e201b8b0906965cc309c56ae17781c5f104d89d98c3dfbf5d41f066d8ebe2"}
Jul 07 15:46:09.760767 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:09.760700    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1063803-27ef-4513-8273-ce144e495149" containerID="59eb50afc9eb62342a0a8793a060260518178ce9ee3357a38948b44379a99fea" exitCode=0
Jul 07 15:46:09.761065 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:09.760765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4" event={"ID":"e1063803-27ef-4513-8273-ce144e495149","Type":"ContainerDied","Data":"59eb50afc9eb62342a0a8793a060260518178ce9ee3357a38948b44379a99fea"}
Jul 07 15:46:17.791136 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:17.791103    2581 generic.go:356] "Generic (PLEG): container finished" podID="e1063803-27ef-4513-8273-ce144e495149" containerID="c66ae4cc14db44a0675e338e6f568c31e1a9f56e97a8d6c121811e1e99251e28" exitCode=0
Jul 07 15:46:17.791521 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:17.791147    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4" event={"ID":"e1063803-27ef-4513-8273-ce144e495149","Type":"ContainerDied","Data":"c66ae4cc14db44a0675e338e6f568c31e1a9f56e97a8d6c121811e1e99251e28"}
Jul 07 15:46:18.917676 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:18.917653    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:19.076733 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.076706    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4k4w\" (UniqueName: \"kubernetes.io/projected/e1063803-27ef-4513-8273-ce144e495149-kube-api-access-m4k4w\") pod \"e1063803-27ef-4513-8273-ce144e495149\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") "
Jul 07 15:46:19.076865 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.076745    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-util\") pod \"e1063803-27ef-4513-8273-ce144e495149\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") "
Jul 07 15:46:19.076865 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.076808    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-bundle\") pod \"e1063803-27ef-4513-8273-ce144e495149\" (UID: \"e1063803-27ef-4513-8273-ce144e495149\") "
Jul 07 15:46:19.077659 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.077629    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-bundle" (OuterVolumeSpecName: "bundle") pod "e1063803-27ef-4513-8273-ce144e495149" (UID: "e1063803-27ef-4513-8273-ce144e495149"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:19.078870 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.078841    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1063803-27ef-4513-8273-ce144e495149-kube-api-access-m4k4w" (OuterVolumeSpecName: "kube-api-access-m4k4w") pod "e1063803-27ef-4513-8273-ce144e495149" (UID: "e1063803-27ef-4513-8273-ce144e495149"). InnerVolumeSpecName "kube-api-access-m4k4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:46:19.081456 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.081420    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-util" (OuterVolumeSpecName: "util") pod "e1063803-27ef-4513-8273-ce144e495149" (UID: "e1063803-27ef-4513-8273-ce144e495149"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:19.177690 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.177664    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4k4w\" (UniqueName: \"kubernetes.io/projected/e1063803-27ef-4513-8273-ce144e495149-kube-api-access-m4k4w\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:19.177690 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.177687    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-util\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:19.177842 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.177697    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e1063803-27ef-4513-8273-ce144e495149-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:19.799808 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.799770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4" event={"ID":"e1063803-27ef-4513-8273-ce144e495149","Type":"ContainerDied","Data":"0076ffb98b0f23ecc28847a4106e82938928c70d2205347b81c246d28f26bc86"}
Jul 07 15:46:19.799808 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.799814    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0076ffb98b0f23ecc28847a4106e82938928c70d2205347b81c246d28f26bc86"
Jul 07 15:46:19.800047 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:19.799783    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jqxl4"
Jul 07 15:46:24.117561 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.117488    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"]
Jul 07 15:46:24.117901 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.117749    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1063803-27ef-4513-8273-ce144e495149" containerName="pull"
Jul 07 15:46:24.117901 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.117758    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1063803-27ef-4513-8273-ce144e495149" containerName="pull"
Jul 07 15:46:24.117901 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.117771    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1063803-27ef-4513-8273-ce144e495149" containerName="util"
Jul 07 15:46:24.117901 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.117776    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1063803-27ef-4513-8273-ce144e495149" containerName="util"
Jul 07 15:46:24.117901 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.117782    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1063803-27ef-4513-8273-ce144e495149" containerName="extract"
Jul 07 15:46:24.117901 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.117787    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1063803-27ef-4513-8273-ce144e495149" containerName="extract"
Jul 07 15:46:24.117901 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.117831    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1063803-27ef-4513-8273-ce144e495149" containerName="extract"
Jul 07 15:46:24.130093 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.130069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"
Jul 07 15:46:24.132873 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.132843    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:46:24.132989 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.132911    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-6knm7\""
Jul 07 15:46:24.133137 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.133124    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 15:46:24.141765 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.141735    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"]
Jul 07 15:46:24.215973 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.215942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a593f78c-477d-4d06-9e4f-5bbdad964465-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-98b7t\" (UID: \"a593f78c-477d-4d06-9e4f-5bbdad964465\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"
Jul 07 15:46:24.216080 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.215976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r65lm\" (UniqueName: \"kubernetes.io/projected/a593f78c-477d-4d06-9e4f-5bbdad964465-kube-api-access-r65lm\") pod \"cert-manager-operator-controller-manager-55c444bf86-98b7t\" (UID: \"a593f78c-477d-4d06-9e4f-5bbdad964465\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"
Jul 07 15:46:24.316850 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.316821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a593f78c-477d-4d06-9e4f-5bbdad964465-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-98b7t\" (UID: \"a593f78c-477d-4d06-9e4f-5bbdad964465\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"
Jul 07 15:46:24.316958 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.316854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r65lm\" (UniqueName: \"kubernetes.io/projected/a593f78c-477d-4d06-9e4f-5bbdad964465-kube-api-access-r65lm\") pod \"cert-manager-operator-controller-manager-55c444bf86-98b7t\" (UID: \"a593f78c-477d-4d06-9e4f-5bbdad964465\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"
Jul 07 15:46:24.317194 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.317174    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a593f78c-477d-4d06-9e4f-5bbdad964465-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-98b7t\" (UID: \"a593f78c-477d-4d06-9e4f-5bbdad964465\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"
Jul 07 15:46:24.329950 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.329919    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r65lm\" (UniqueName: \"kubernetes.io/projected/a593f78c-477d-4d06-9e4f-5bbdad964465-kube-api-access-r65lm\") pod \"cert-manager-operator-controller-manager-55c444bf86-98b7t\" (UID: \"a593f78c-477d-4d06-9e4f-5bbdad964465\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"
Jul 07 15:46:24.441699 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.441629    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"
Jul 07 15:46:24.597925 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.597897    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t"]
Jul 07 15:46:24.601130 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:46:24.601104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda593f78c_477d_4d06_9e4f_5bbdad964465.slice/crio-e7c11c618fc21698c186479cd4dc8cd3d76172475e20518c7c732dd501c92427 WatchSource:0}: Error finding container e7c11c618fc21698c186479cd4dc8cd3d76172475e20518c7c732dd501c92427: Status 404 returned error can't find the container with id e7c11c618fc21698c186479cd4dc8cd3d76172475e20518c7c732dd501c92427
Jul 07 15:46:24.817563 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:24.817491    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t" event={"ID":"a593f78c-477d-4d06-9e4f-5bbdad964465","Type":"ContainerStarted","Data":"e7c11c618fc21698c186479cd4dc8cd3d76172475e20518c7c732dd501c92427"}
Jul 07 15:46:26.827486 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:26.827452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t" event={"ID":"a593f78c-477d-4d06-9e4f-5bbdad964465","Type":"ContainerStarted","Data":"e5e3e1d48c13d5945dbe994e728cba067744246b137411cb109fdfc01d887371"}
Jul 07 15:46:26.856714 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:26.856665    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-98b7t" podStartSLOduration=1.347239789 podStartE2EDuration="2.85665024s" totalImagesPullingTime="1.509410451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:46:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:26.855409492 +0000 UTC m=+266.710986373" watchObservedRunningTime="2026-07-07 15:46:26.85665024 +0000 UTC m=+266.712227119"
Jul 07 15:46:28.151786 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.151757    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"]
Jul 07 15:46:28.153849 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.153831    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.156035 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.156009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:46:28.156543 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.156523    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:46:28.156660 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.156526    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hc8tb\""
Jul 07 15:46:28.164488 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.164466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"]
Jul 07 15:46:28.243869 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.243830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.244042 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.243897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.244042 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.243958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqhhx\" (UniqueName: \"kubernetes.io/projected/2fd7a4c6-6976-4cd8-aa55-58c142999f03-kube-api-access-fqhhx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.344937 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.344844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.345049 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.344972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqhhx\" (UniqueName: \"kubernetes.io/projected/2fd7a4c6-6976-4cd8-aa55-58c142999f03-kube-api-access-fqhhx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.345049 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.345033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.345144 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.345127    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.345294 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.345269    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.353687 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.353662    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqhhx\" (UniqueName: \"kubernetes.io/projected/2fd7a4c6-6976-4cd8-aa55-58c142999f03-kube-api-access-fqhhx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.464070 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.463994    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:28.599323 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.599297    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"]
Jul 07 15:46:28.601657 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:46:28.601625    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd7a4c6_6976_4cd8_aa55_58c142999f03.slice/crio-4c00ec4b380e13f4c1e906a2b488b53c8cdd21450a315840935b66d9b42af3ee WatchSource:0}: Error finding container 4c00ec4b380e13f4c1e906a2b488b53c8cdd21450a315840935b66d9b42af3ee: Status 404 returned error can't find the container with id 4c00ec4b380e13f4c1e906a2b488b53c8cdd21450a315840935b66d9b42af3ee
Jul 07 15:46:28.836950 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.836921    2581 generic.go:356] "Generic (PLEG): container finished" podID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerID="ffee44ce2c2536467660901bf685b3c217dc19356f4a5dfe8fcb5dcd918c4411" exitCode=0
Jul 07 15:46:28.837088 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.836970    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6" event={"ID":"2fd7a4c6-6976-4cd8-aa55-58c142999f03","Type":"ContainerDied","Data":"ffee44ce2c2536467660901bf685b3c217dc19356f4a5dfe8fcb5dcd918c4411"}
Jul 07 15:46:28.837088 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:28.837016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6" event={"ID":"2fd7a4c6-6976-4cd8-aa55-58c142999f03","Type":"ContainerStarted","Data":"4c00ec4b380e13f4c1e906a2b488b53c8cdd21450a315840935b66d9b42af3ee"}
Jul 07 15:46:29.776350 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:29.776251    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"]
Jul 07 15:46:29.778428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:29.778406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"
Jul 07 15:46:29.780706 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:29.780682    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 15:46:29.781197 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:29.781178    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 15:46:29.781302 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:29.781202    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-pzhbk\""
Jul 07 15:46:29.790272 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:29.790249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"]
Jul 07 15:46:29.958052 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:29.958022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4hwn\" (UniqueName: \"kubernetes.io/projected/be6cff89-a619-457d-9ccb-c4a850441fbe-kube-api-access-v4hwn\") pod \"cert-manager-cainjector-559cdd8c87-9l62t\" (UID: \"be6cff89-a619-457d-9ccb-c4a850441fbe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"
Jul 07 15:46:29.958205 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:29.958133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be6cff89-a619-457d-9ccb-c4a850441fbe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9l62t\" (UID: \"be6cff89-a619-457d-9ccb-c4a850441fbe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"
Jul 07 15:46:30.059093 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.059009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be6cff89-a619-457d-9ccb-c4a850441fbe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9l62t\" (UID: \"be6cff89-a619-457d-9ccb-c4a850441fbe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"
Jul 07 15:46:30.059093 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.059066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4hwn\" (UniqueName: \"kubernetes.io/projected/be6cff89-a619-457d-9ccb-c4a850441fbe-kube-api-access-v4hwn\") pod \"cert-manager-cainjector-559cdd8c87-9l62t\" (UID: \"be6cff89-a619-457d-9ccb-c4a850441fbe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"
Jul 07 15:46:30.069223 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.069197    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/be6cff89-a619-457d-9ccb-c4a850441fbe-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9l62t\" (UID: \"be6cff89-a619-457d-9ccb-c4a850441fbe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"
Jul 07 15:46:30.069393 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.069369    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4hwn\" (UniqueName: \"kubernetes.io/projected/be6cff89-a619-457d-9ccb-c4a850441fbe-kube-api-access-v4hwn\") pod \"cert-manager-cainjector-559cdd8c87-9l62t\" (UID: \"be6cff89-a619-457d-9ccb-c4a850441fbe\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"
Jul 07 15:46:30.103109 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.103084    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"
Jul 07 15:46:30.799914 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.799891    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9l62t"]
Jul 07 15:46:30.801711 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:46:30.801679    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe6cff89_a619_457d_9ccb_c4a850441fbe.slice/crio-0f78600dc77927b8ceb4d56340b79530974c7e6c2f1adac92c8c1d81bf9e189a WatchSource:0}: Error finding container 0f78600dc77927b8ceb4d56340b79530974c7e6c2f1adac92c8c1d81bf9e189a: Status 404 returned error can't find the container with id 0f78600dc77927b8ceb4d56340b79530974c7e6c2f1adac92c8c1d81bf9e189a
Jul 07 15:46:30.846033 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.846011    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t" event={"ID":"be6cff89-a619-457d-9ccb-c4a850441fbe","Type":"ContainerStarted","Data":"0f78600dc77927b8ceb4d56340b79530974c7e6c2f1adac92c8c1d81bf9e189a"}
Jul 07 15:46:30.847545 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.847523    2581 generic.go:356] "Generic (PLEG): container finished" podID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerID="877b48455133e088c526bf24745bc05e4e131c863abea74249b1ddfe848d2334" exitCode=0
Jul 07 15:46:30.847690 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:30.847582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6" event={"ID":"2fd7a4c6-6976-4cd8-aa55-58c142999f03","Type":"ContainerDied","Data":"877b48455133e088c526bf24745bc05e4e131c863abea74249b1ddfe848d2334"}
Jul 07 15:46:31.853454 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:31.853419    2581 generic.go:356] "Generic (PLEG): container finished" podID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerID="8203105e07b9a9656fbc3c42721225c61f6a2832772c649052f69bb59ea2526b" exitCode=0
Jul 07 15:46:31.853811 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:31.853511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6" event={"ID":"2fd7a4c6-6976-4cd8-aa55-58c142999f03","Type":"ContainerDied","Data":"8203105e07b9a9656fbc3c42721225c61f6a2832772c649052f69bb59ea2526b"}
Jul 07 15:46:33.583999 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.583965    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pmb95"]
Jul 07 15:46:33.588299 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.588266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:33.590576 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.590551    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z6t8l\""
Jul 07 15:46:33.597603 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.597580    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pmb95"]
Jul 07 15:46:33.688250 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.688217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c73bb8c-3075-4541-90d2-2e1813c836bd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pmb95\" (UID: \"6c73bb8c-3075-4541-90d2-2e1813c836bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:33.688433 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.688296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp4cz\" (UniqueName: \"kubernetes.io/projected/6c73bb8c-3075-4541-90d2-2e1813c836bd-kube-api-access-wp4cz\") pod \"cert-manager-webhook-6486ffd997-pmb95\" (UID: \"6c73bb8c-3075-4541-90d2-2e1813c836bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:33.789268 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.789232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp4cz\" (UniqueName: \"kubernetes.io/projected/6c73bb8c-3075-4541-90d2-2e1813c836bd-kube-api-access-wp4cz\") pod \"cert-manager-webhook-6486ffd997-pmb95\" (UID: \"6c73bb8c-3075-4541-90d2-2e1813c836bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:33.789424 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.789350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c73bb8c-3075-4541-90d2-2e1813c836bd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pmb95\" (UID: \"6c73bb8c-3075-4541-90d2-2e1813c836bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:33.800096 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.800059    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6c73bb8c-3075-4541-90d2-2e1813c836bd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-pmb95\" (UID: \"6c73bb8c-3075-4541-90d2-2e1813c836bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:33.800204 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.800106    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp4cz\" (UniqueName: \"kubernetes.io/projected/6c73bb8c-3075-4541-90d2-2e1813c836bd-kube-api-access-wp4cz\") pod \"cert-manager-webhook-6486ffd997-pmb95\" (UID: \"6c73bb8c-3075-4541-90d2-2e1813c836bd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:33.843593 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.843544    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:33.863313 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.863272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6" event={"ID":"2fd7a4c6-6976-4cd8-aa55-58c142999f03","Type":"ContainerDied","Data":"4c00ec4b380e13f4c1e906a2b488b53c8cdd21450a315840935b66d9b42af3ee"}
Jul 07 15:46:33.863402 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.863332    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhjvd6"
Jul 07 15:46:33.863402 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.863364    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c00ec4b380e13f4c1e906a2b488b53c8cdd21450a315840935b66d9b42af3ee"
Jul 07 15:46:33.899306 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.899271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:33.990862 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.990834    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-bundle\") pod \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") "
Jul 07 15:46:33.991022 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.990885    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqhhx\" (UniqueName: \"kubernetes.io/projected/2fd7a4c6-6976-4cd8-aa55-58c142999f03-kube-api-access-fqhhx\") pod \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") "
Jul 07 15:46:33.991022 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.990930    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-util\") pod \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\" (UID: \"2fd7a4c6-6976-4cd8-aa55-58c142999f03\") "
Jul 07 15:46:33.991142 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.991105    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-bundle" (OuterVolumeSpecName: "bundle") pod "2fd7a4c6-6976-4cd8-aa55-58c142999f03" (UID: "2fd7a4c6-6976-4cd8-aa55-58c142999f03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:33.993790 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:33.993758    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd7a4c6-6976-4cd8-aa55-58c142999f03-kube-api-access-fqhhx" (OuterVolumeSpecName: "kube-api-access-fqhhx") pod "2fd7a4c6-6976-4cd8-aa55-58c142999f03" (UID: "2fd7a4c6-6976-4cd8-aa55-58c142999f03"). InnerVolumeSpecName "kube-api-access-fqhhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:46:34.015457 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.015428    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-util" (OuterVolumeSpecName: "util") pod "2fd7a4c6-6976-4cd8-aa55-58c142999f03" (UID: "2fd7a4c6-6976-4cd8-aa55-58c142999f03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:34.032407 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.032361    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-pmb95"]
Jul 07 15:46:34.034412 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:46:34.034389    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c73bb8c_3075_4541_90d2_2e1813c836bd.slice/crio-19e6064ba34ab581b3d5154aa4670498baf7013035437e46617aaa2d978655b7 WatchSource:0}: Error finding container 19e6064ba34ab581b3d5154aa4670498baf7013035437e46617aaa2d978655b7: Status 404 returned error can't find the container with id 19e6064ba34ab581b3d5154aa4670498baf7013035437e46617aaa2d978655b7
Jul 07 15:46:34.092444 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.092386    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:34.092444 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.092409    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqhhx\" (UniqueName: \"kubernetes.io/projected/2fd7a4c6-6976-4cd8-aa55-58c142999f03-kube-api-access-fqhhx\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:34.092444 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.092421    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2fd7a4c6-6976-4cd8-aa55-58c142999f03-util\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:34.868454 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.868417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t" event={"ID":"be6cff89-a619-457d-9ccb-c4a850441fbe","Type":"ContainerStarted","Data":"e27341d11e4f15d8997d315f7a3fac3bf30a185db31c0508a431c9c6b8dfb25d"}
Jul 07 15:46:34.869831 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.869810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95" event={"ID":"6c73bb8c-3075-4541-90d2-2e1813c836bd","Type":"ContainerStarted","Data":"f92004c99ec79b2a18d7f6641cfdb7d5864dbefa17aa874a7adcd53d30977e8b"}
Jul 07 15:46:34.869893 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.869845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95" event={"ID":"6c73bb8c-3075-4541-90d2-2e1813c836bd","Type":"ContainerStarted","Data":"19e6064ba34ab581b3d5154aa4670498baf7013035437e46617aaa2d978655b7"}
Jul 07 15:46:34.869893 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.869860    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:34.893429 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.893378    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9l62t" podStartSLOduration=2.805764414 podStartE2EDuration="5.893364851s" totalImagesPullingTime="3.087600437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:34.892109655 +0000 UTC m=+274.747686548" watchObservedRunningTime="2026-07-07 15:46:34.893364851 +0000 UTC m=+274.748941730"
Jul 07 15:46:34.925795 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:34.925751    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95" podStartSLOduration=1.92573676 podStartE2EDuration="1.92573676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:46:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:34.92502443 +0000 UTC m=+274.780601310" watchObservedRunningTime="2026-07-07 15:46:34.92573676 +0000 UTC m=+274.781313639"
Jul 07 15:46:40.825698 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.825659    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"]
Jul 07 15:46:40.826191 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.826128    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerName="extract"
Jul 07 15:46:40.826191 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.826193    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerName="extract"
Jul 07 15:46:40.826357 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.826207    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerName="util"
Jul 07 15:46:40.826357 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.826213    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerName="util"
Jul 07 15:46:40.826357 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.826226    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerName="pull"
Jul 07 15:46:40.826357 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.826231    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerName="pull"
Jul 07 15:46:40.826357 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.826349    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd7a4c6-6976-4cd8-aa55-58c142999f03" containerName="extract"
Jul 07 15:46:40.829521 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.829499    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"
Jul 07 15:46:40.831639 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.831618    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:46:40.831791 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.831772    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 15:46:40.832511 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.832494    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-pbxkc\""
Jul 07 15:46:40.840882 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.840857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ac782ad-e00a-48f6-b459-39b0947190ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w8bjc\" (UID: \"2ac782ad-e00a-48f6-b459-39b0947190ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"
Jul 07 15:46:40.840994 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.840936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfwlf\" (UniqueName: \"kubernetes.io/projected/2ac782ad-e00a-48f6-b459-39b0947190ec-kube-api-access-qfwlf\") pod \"openshift-lws-operator-fd8ccff4c-w8bjc\" (UID: \"2ac782ad-e00a-48f6-b459-39b0947190ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"
Jul 07 15:46:40.841395 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.841378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"]
Jul 07 15:46:40.876300 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.876265    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-pmb95"
Jul 07 15:46:40.941617 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.941586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfwlf\" (UniqueName: \"kubernetes.io/projected/2ac782ad-e00a-48f6-b459-39b0947190ec-kube-api-access-qfwlf\") pod \"openshift-lws-operator-fd8ccff4c-w8bjc\" (UID: \"2ac782ad-e00a-48f6-b459-39b0947190ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"
Jul 07 15:46:40.941732 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.941642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ac782ad-e00a-48f6-b459-39b0947190ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w8bjc\" (UID: \"2ac782ad-e00a-48f6-b459-39b0947190ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"
Jul 07 15:46:40.942049 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.942031    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ac782ad-e00a-48f6-b459-39b0947190ec-tmp\") pod \"openshift-lws-operator-fd8ccff4c-w8bjc\" (UID: \"2ac782ad-e00a-48f6-b459-39b0947190ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"
Jul 07 15:46:40.951241 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:40.951214    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfwlf\" (UniqueName: \"kubernetes.io/projected/2ac782ad-e00a-48f6-b459-39b0947190ec-kube-api-access-qfwlf\") pod \"openshift-lws-operator-fd8ccff4c-w8bjc\" (UID: \"2ac782ad-e00a-48f6-b459-39b0947190ec\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"
Jul 07 15:46:41.139589 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:41.139519    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"
Jul 07 15:46:41.266841 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:41.266760    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc"]
Jul 07 15:46:41.269615 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:46:41.269579    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ac782ad_e00a_48f6_b459_39b0947190ec.slice/crio-d492b830d49198ae4cd1fdd7181fe7967da0eddddf0600e4773801306d5667b0 WatchSource:0}: Error finding container d492b830d49198ae4cd1fdd7181fe7967da0eddddf0600e4773801306d5667b0: Status 404 returned error can't find the container with id d492b830d49198ae4cd1fdd7181fe7967da0eddddf0600e4773801306d5667b0
Jul 07 15:46:41.898073 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:41.898035    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc" event={"ID":"2ac782ad-e00a-48f6-b459-39b0947190ec","Type":"ContainerStarted","Data":"d492b830d49198ae4cd1fdd7181fe7967da0eddddf0600e4773801306d5667b0"}
Jul 07 15:46:43.907348 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:43.907313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc" event={"ID":"2ac782ad-e00a-48f6-b459-39b0947190ec","Type":"ContainerStarted","Data":"82932b5949f1a64aca09f5b1fed8be98710fd2587bcdd3ec5e7cff6c453533ab"}
Jul 07 15:46:43.928087 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:43.928042    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-w8bjc" podStartSLOduration=1.752281711 podStartE2EDuration="3.928026767s" totalImagesPullingTime="2.175745056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:46:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:43.926004798 +0000 UTC m=+283.781581676" watchObservedRunningTime="2026-07-07 15:46:43.928026767 +0000 UTC m=+283.783603646"
Jul 07 15:46:47.835069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.835033    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"]
Jul 07 15:46:47.859237 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.859212    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"]
Jul 07 15:46:47.859379 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.859320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:47.861488 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.861466    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 15:46:47.861827 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.861810    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hc8tb\""
Jul 07 15:46:47.861895 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.861827    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 15:46:47.889304 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.889264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:47.889428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.889391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:47.889492 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.889446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvfm\" (UniqueName: \"kubernetes.io/projected/e4598d74-868d-49cb-b50b-7418c2bb2c67-kube-api-access-wdvfm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:47.990195 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.990165    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:47.990345 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.990205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvfm\" (UniqueName: \"kubernetes.io/projected/e4598d74-868d-49cb-b50b-7418c2bb2c67-kube-api-access-wdvfm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:47.990345 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.990252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:47.990621 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.990604    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:47.990666 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:47.990639    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:48.002449 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:48.002424    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvfm\" (UniqueName: \"kubernetes.io/projected/e4598d74-868d-49cb-b50b-7418c2bb2c67-kube-api-access-wdvfm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:48.167600 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:48.167547    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:48.295903 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:48.295839    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"]
Jul 07 15:46:48.298118 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:46:48.298092    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4598d74_868d_49cb_b50b_7418c2bb2c67.slice/crio-e55195dfd7d5d31567e5d7b0fe877de19aca6bcba9f8e2b6657b545bd294bddd WatchSource:0}: Error finding container e55195dfd7d5d31567e5d7b0fe877de19aca6bcba9f8e2b6657b545bd294bddd: Status 404 returned error can't find the container with id e55195dfd7d5d31567e5d7b0fe877de19aca6bcba9f8e2b6657b545bd294bddd
Jul 07 15:46:48.927105 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:48.927071    2581 generic.go:356] "Generic (PLEG): container finished" podID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerID="46bf62819ca56154fa7ca78cc2406778985c70bb9f2d48c9cae34c96e93cf33f" exitCode=0
Jul 07 15:46:48.927105 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:48.927108    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh" event={"ID":"e4598d74-868d-49cb-b50b-7418c2bb2c67","Type":"ContainerDied","Data":"46bf62819ca56154fa7ca78cc2406778985c70bb9f2d48c9cae34c96e93cf33f"}
Jul 07 15:46:48.927558 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:48.927143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh" event={"ID":"e4598d74-868d-49cb-b50b-7418c2bb2c67","Type":"ContainerStarted","Data":"e55195dfd7d5d31567e5d7b0fe877de19aca6bcba9f8e2b6657b545bd294bddd"}
Jul 07 15:46:49.933107 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:49.933028    2581 generic.go:356] "Generic (PLEG): container finished" podID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerID="bbca3d39d24d50229e099a5e38c1ff2f977338e749f6f9d4cac430886debbcdd" exitCode=0
Jul 07 15:46:49.933107 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:49.933083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh" event={"ID":"e4598d74-868d-49cb-b50b-7418c2bb2c67","Type":"ContainerDied","Data":"bbca3d39d24d50229e099a5e38c1ff2f977338e749f6f9d4cac430886debbcdd"}
Jul 07 15:46:50.939301 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:50.939242    2581 generic.go:356] "Generic (PLEG): container finished" podID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerID="dce380dea557249b5c7135e09b71a93bd07811ec6d47cc54c2d1a42c55f61caf" exitCode=0
Jul 07 15:46:50.939682 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:50.939301    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh" event={"ID":"e4598d74-868d-49cb-b50b-7418c2bb2c67","Type":"ContainerDied","Data":"dce380dea557249b5c7135e09b71a93bd07811ec6d47cc54c2d1a42c55f61caf"}
Jul 07 15:46:52.061442 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.061417    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:52.118229 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.118204    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-bundle\") pod \"e4598d74-868d-49cb-b50b-7418c2bb2c67\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") "
Jul 07 15:46:52.118368 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.118249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-util\") pod \"e4598d74-868d-49cb-b50b-7418c2bb2c67\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") "
Jul 07 15:46:52.118368 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.118312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdvfm\" (UniqueName: \"kubernetes.io/projected/e4598d74-868d-49cb-b50b-7418c2bb2c67-kube-api-access-wdvfm\") pod \"e4598d74-868d-49cb-b50b-7418c2bb2c67\" (UID: \"e4598d74-868d-49cb-b50b-7418c2bb2c67\") "
Jul 07 15:46:52.118876 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.118853    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-bundle" (OuterVolumeSpecName: "bundle") pod "e4598d74-868d-49cb-b50b-7418c2bb2c67" (UID: "e4598d74-868d-49cb-b50b-7418c2bb2c67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:52.120188 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.120158    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4598d74-868d-49cb-b50b-7418c2bb2c67-kube-api-access-wdvfm" (OuterVolumeSpecName: "kube-api-access-wdvfm") pod "e4598d74-868d-49cb-b50b-7418c2bb2c67" (UID: "e4598d74-868d-49cb-b50b-7418c2bb2c67"). InnerVolumeSpecName "kube-api-access-wdvfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:46:52.123728 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.123707    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-util" (OuterVolumeSpecName: "util") pod "e4598d74-868d-49cb-b50b-7418c2bb2c67" (UID: "e4598d74-868d-49cb-b50b-7418c2bb2c67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:46:52.219478 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.219423    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdvfm\" (UniqueName: \"kubernetes.io/projected/e4598d74-868d-49cb-b50b-7418c2bb2c67-kube-api-access-wdvfm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:52.219478 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.219445    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:52.219478 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.219455    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4598d74-868d-49cb-b50b-7418c2bb2c67-util\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:46:52.949350 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.949259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh" event={"ID":"e4598d74-868d-49cb-b50b-7418c2bb2c67","Type":"ContainerDied","Data":"e55195dfd7d5d31567e5d7b0fe877de19aca6bcba9f8e2b6657b545bd294bddd"}
Jul 07 15:46:52.949350 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.949329    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afpjfjh"
Jul 07 15:46:52.949510 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:52.949329    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e55195dfd7d5d31567e5d7b0fe877de19aca6bcba9f8e2b6657b545bd294bddd"
Jul 07 15:46:55.065123 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.065089    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"]
Jul 07 15:46:55.065516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.065388    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerName="extract"
Jul 07 15:46:55.065516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.065400    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerName="extract"
Jul 07 15:46:55.065516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.065411    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerName="util"
Jul 07 15:46:55.065516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.065416    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerName="util"
Jul 07 15:46:55.065516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.065430    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerName="pull"
Jul 07 15:46:55.065516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.065436    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerName="pull"
Jul 07 15:46:55.065516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.065485    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4598d74-868d-49cb-b50b-7418c2bb2c67" containerName="extract"
Jul 07 15:46:55.068251 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.068229    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.072128 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.072106    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ppjfm\""
Jul 07 15:46:55.072247 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.072210    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 15:46:55.072368 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.072340    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 15:46:55.080809 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.080784    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"]
Jul 07 15:46:55.082468 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.082451    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 15:46:55.139032 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.139009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbvb9\" (UniqueName: \"kubernetes.io/projected/f15a127f-5c91-4adc-850c-888677a102bd-kube-api-access-wbvb9\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.139137 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.139070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f15a127f-5c91-4adc-850c-888677a102bd-manager-config\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.139203 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.139127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f15a127f-5c91-4adc-850c-888677a102bd-metrics-cert\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.139203 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.139168    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f15a127f-5c91-4adc-850c-888677a102bd-cert\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.240560 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.240529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbvb9\" (UniqueName: \"kubernetes.io/projected/f15a127f-5c91-4adc-850c-888677a102bd-kube-api-access-wbvb9\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.240707 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.240592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f15a127f-5c91-4adc-850c-888677a102bd-manager-config\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.240707 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.240625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f15a127f-5c91-4adc-850c-888677a102bd-metrics-cert\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.240707 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.240648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f15a127f-5c91-4adc-850c-888677a102bd-cert\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.241227 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.241204    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f15a127f-5c91-4adc-850c-888677a102bd-manager-config\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.243145 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.243118    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f15a127f-5c91-4adc-850c-888677a102bd-cert\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.243145 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.243138    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f15a127f-5c91-4adc-850c-888677a102bd-metrics-cert\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.253750 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.253724    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbvb9\" (UniqueName: \"kubernetes.io/projected/f15a127f-5c91-4adc-850c-888677a102bd-kube-api-access-wbvb9\") pod \"lws-controller-manager-86b7f856ff-kxns4\" (UID: \"f15a127f-5c91-4adc-850c-888677a102bd\") " pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.377223 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.377200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:55.515531 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.515505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"]
Jul 07 15:46:55.517048 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:46:55.517021    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15a127f_5c91_4adc_850c_888677a102bd.slice/crio-b097e8187ff6de90b34133468b44ef9f43bde9f52607288c7667f88770eb8fe0 WatchSource:0}: Error finding container b097e8187ff6de90b34133468b44ef9f43bde9f52607288c7667f88770eb8fe0: Status 404 returned error can't find the container with id b097e8187ff6de90b34133468b44ef9f43bde9f52607288c7667f88770eb8fe0
Jul 07 15:46:55.977483 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:55.977441    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4" event={"ID":"f15a127f-5c91-4adc-850c-888677a102bd","Type":"ContainerStarted","Data":"b097e8187ff6de90b34133468b44ef9f43bde9f52607288c7667f88770eb8fe0"}
Jul 07 15:46:56.983883 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:56.983849    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4" event={"ID":"f15a127f-5c91-4adc-850c-888677a102bd","Type":"ContainerStarted","Data":"8a6044ee9d3eb04afb2bd7a09a8ec425e485173f3d646acd341f67511fd8ab56"}
Jul 07 15:46:56.984265 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:56.983965    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:46:57.027979 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:46:57.027890    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4" podStartSLOduration=0.803512052 podStartE2EDuration="2.027873349s" totalImagesPullingTime="1.224361297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:46:57.026108161 +0000 UTC m=+296.881685041" watchObservedRunningTime="2026-07-07 15:46:57.027873349 +0000 UTC m=+296.883450228"
Jul 07 15:47:00.548585 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.548554    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 15:47:00.648385 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.648356    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"]
Jul 07 15:47:00.652692 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.652670    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.655815 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.655794    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hvlrf\""
Jul 07 15:47:00.655929 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.655813    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 15:47:00.655929 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.655898    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 15:47:00.656543 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.656522    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 15:47:00.656785 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.656765    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 15:47:00.668064 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.668033    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"]
Jul 07 15:47:00.684562 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.684540    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n59h2\" (UniqueName: \"kubernetes.io/projected/561d3fb1-f8fd-4137-af28-f031bbc9837e-kube-api-access-n59h2\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.684671 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.684577    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/561d3fb1-f8fd-4137-af28-f031bbc9837e-manifests\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.684671 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.684611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/561d3fb1-f8fd-4137-af28-f031bbc9837e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.684671 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.684652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561d3fb1-f8fd-4137-af28-f031bbc9837e-tmp\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.684796 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.684675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/561d3fb1-f8fd-4137-af28-f031bbc9837e-webhook-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.786114 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.785984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n59h2\" (UniqueName: \"kubernetes.io/projected/561d3fb1-f8fd-4137-af28-f031bbc9837e-kube-api-access-n59h2\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.786114 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.786026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/561d3fb1-f8fd-4137-af28-f031bbc9837e-manifests\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.786114 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.786046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/561d3fb1-f8fd-4137-af28-f031bbc9837e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.786114 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.786072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561d3fb1-f8fd-4137-af28-f031bbc9837e-tmp\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.786114 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.786092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/561d3fb1-f8fd-4137-af28-f031bbc9837e-webhook-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.791556 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.786505    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/561d3fb1-f8fd-4137-af28-f031bbc9837e-manifests\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.791556 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.788486    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561d3fb1-f8fd-4137-af28-f031bbc9837e-tmp\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.791556 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.788697    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/561d3fb1-f8fd-4137-af28-f031bbc9837e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.791556 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.788697    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/561d3fb1-f8fd-4137-af28-f031bbc9837e-webhook-cert\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.799541 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.799494    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n59h2\" (UniqueName: \"kubernetes.io/projected/561d3fb1-f8fd-4137-af28-f031bbc9837e-kube-api-access-n59h2\") pod \"opendatahub-operator-controller-manager-865bb77d7b-vqwbm\" (UID: \"561d3fb1-f8fd-4137-af28-f031bbc9837e\") " pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:00.965122 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:00.965094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:01.123204 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:01.123179    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"]
Jul 07 15:47:01.125378 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:47:01.125344    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561d3fb1_f8fd_4137_af28_f031bbc9837e.slice/crio-f5711472d4e24567ef3fb51da519516e223fe83715b98315a9fd325c1214fc2c WatchSource:0}: Error finding container f5711472d4e24567ef3fb51da519516e223fe83715b98315a9fd325c1214fc2c: Status 404 returned error can't find the container with id f5711472d4e24567ef3fb51da519516e223fe83715b98315a9fd325c1214fc2c
Jul 07 15:47:02.006958 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:02.006923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm" event={"ID":"561d3fb1-f8fd-4137-af28-f031bbc9837e","Type":"ContainerStarted","Data":"f5711472d4e24567ef3fb51da519516e223fe83715b98315a9fd325c1214fc2c"}
Jul 07 15:47:05.023371 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:05.023332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm" event={"ID":"561d3fb1-f8fd-4137-af28-f031bbc9837e","Type":"ContainerStarted","Data":"79d9673dcb19fd62f234e61dbea7afc6c4091277996c1f955d34e84347ad03a2"}
Jul 07 15:47:06.030125 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:06.030093    2581 generic.go:356] "Generic (PLEG): container finished" podID="561d3fb1-f8fd-4137-af28-f031bbc9837e" containerID="79d9673dcb19fd62f234e61dbea7afc6c4091277996c1f955d34e84347ad03a2" exitCode=0
Jul 07 15:47:06.030548 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:06.030182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm" event={"ID":"561d3fb1-f8fd-4137-af28-f031bbc9837e","Type":"ContainerDied","Data":"79d9673dcb19fd62f234e61dbea7afc6c4091277996c1f955d34e84347ad03a2"}
Jul 07 15:47:06.030675 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:06.030659    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:47:07.036543 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:07.036509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm" event={"ID":"561d3fb1-f8fd-4137-af28-f031bbc9837e","Type":"ContainerStarted","Data":"c57292932042ccd6aa41c8d73b124b3533525aca97ed005c28504f2350d63994"}
Jul 07 15:47:07.036940 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:07.036659    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:07.070785 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:07.070736    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm" podStartSLOduration=2.570013201 podStartE2EDuration="7.070721589s" totalImagesPullingTime="3.458832291s" totalInitContainerRuntime="1.041876097s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:07.06893868 +0000 UTC m=+306.924515559" watchObservedRunningTime="2026-07-07 15:47:07.070721589 +0000 UTC m=+306.926298469"
Jul 07 15:47:07.990701 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:07.990675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86b7f856ff-kxns4"
Jul 07 15:47:18.044254 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:18.044226    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-865bb77d7b-vqwbm"
Jul 07 15:47:26.334575 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.334533    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f99849b54-wndbc"]
Jul 07 15:47:26.337864 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.337843    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.340605 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.340579    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cgfvb\""
Jul 07 15:47:26.340719 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.340626    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 15:47:26.340882 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.340855    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 15:47:26.340978 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.340896    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 15:47:26.340978 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.340924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 15:47:26.354298 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.354266    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f99849b54-wndbc"]
Jul 07 15:47:26.467845 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.467819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39ef33a-149a-4c5e-a91e-4b5730474d46-tmp\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.467956 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.467848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lr4p\" (UniqueName: \"kubernetes.io/projected/d39ef33a-149a-4c5e-a91e-4b5730474d46-kube-api-access-5lr4p\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.467996 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.467947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d39ef33a-149a-4c5e-a91e-4b5730474d46-tls-certs\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.568930 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.568902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d39ef33a-149a-4c5e-a91e-4b5730474d46-tls-certs\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.569035 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.568941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39ef33a-149a-4c5e-a91e-4b5730474d46-tmp\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.569035 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.568966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lr4p\" (UniqueName: \"kubernetes.io/projected/d39ef33a-149a-4c5e-a91e-4b5730474d46-kube-api-access-5lr4p\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.571137 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.571116    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39ef33a-149a-4c5e-a91e-4b5730474d46-tmp\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.571483 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.571461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d39ef33a-149a-4c5e-a91e-4b5730474d46-tls-certs\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.578501 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.578481    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lr4p\" (UniqueName: \"kubernetes.io/projected/d39ef33a-149a-4c5e-a91e-4b5730474d46-kube-api-access-5lr4p\") pod \"kube-auth-proxy-f99849b54-wndbc\" (UID: \"d39ef33a-149a-4c5e-a91e-4b5730474d46\") " pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.647412 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.647359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc"
Jul 07 15:47:26.783495 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:26.783471    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f99849b54-wndbc"]
Jul 07 15:47:26.785588 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:47:26.785560    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39ef33a_149a_4c5e_a91e_4b5730474d46.slice/crio-7416ce91bde1009657a06b3be5e2bbe4669be69fbd308e28a5957e921f443d03 WatchSource:0}: Error finding container 7416ce91bde1009657a06b3be5e2bbe4669be69fbd308e28a5957e921f443d03: Status 404 returned error can't find the container with id 7416ce91bde1009657a06b3be5e2bbe4669be69fbd308e28a5957e921f443d03
Jul 07 15:47:27.130423 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:27.130387    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc" event={"ID":"d39ef33a-149a-4c5e-a91e-4b5730474d46","Type":"ContainerStarted","Data":"7416ce91bde1009657a06b3be5e2bbe4669be69fbd308e28a5957e921f443d03"}
Jul 07 15:47:30.145754 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:30.145714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc" event={"ID":"d39ef33a-149a-4c5e-a91e-4b5730474d46","Type":"ContainerStarted","Data":"a236446093cbfe0cbaa9d1925ce943147282fd79b3989c7502ffe17f962aae25"}
Jul 07 15:47:30.171602 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:47:30.171548    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f99849b54-wndbc" podStartSLOduration=1.522499143 podStartE2EDuration="4.171528797s" totalImagesPullingTime="2.649029654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:47:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:47:30.170191126 +0000 UTC m=+330.025768006" watchObservedRunningTime="2026-07-07 15:47:30.171528797 +0000 UTC m=+330.027105677"
Jul 07 15:48:37.145716 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.145678    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"]
Jul 07 15:48:37.148977 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.148960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.151467 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.151444    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:48:37.151584 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.151446    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z8hpb\""
Jul 07 15:48:37.151829 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.151814    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:48:37.158994 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.158974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"]
Jul 07 15:48:37.214575 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.214552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fp97\" (UniqueName: \"kubernetes.io/projected/f523fe42-db47-4ca9-8cc3-5590854c4ca1-kube-api-access-8fp97\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.214678 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.214586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.214678 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.214617    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.315437 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.315412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.315533 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.315468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fp97\" (UniqueName: \"kubernetes.io/projected/f523fe42-db47-4ca9-8cc3-5590854c4ca1-kube-api-access-8fp97\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.315533 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.315498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.315772 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.315755    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.315826 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.315810    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.325790 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.325765    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fp97\" (UniqueName: \"kubernetes.io/projected/f523fe42-db47-4ca9-8cc3-5590854c4ca1-kube-api-access-8fp97\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.459443 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.459386    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:37.517936 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.517909    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"]
Jul 07 15:48:37.521549 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.521525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.531033 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.530975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"]
Jul 07 15:48:37.594762 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.594736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"]
Jul 07 15:48:37.596305 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:48:37.596266    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf523fe42_db47_4ca9_8cc3_5590854c4ca1.slice/crio-cf2c9c1cd433c3dab5b7877458364ca76c10b97469add20fe37e6b2d9a7ea829 WatchSource:0}: Error finding container cf2c9c1cd433c3dab5b7877458364ca76c10b97469add20fe37e6b2d9a7ea829: Status 404 returned error can't find the container with id cf2c9c1cd433c3dab5b7877458364ca76c10b97469add20fe37e6b2d9a7ea829
Jul 07 15:48:37.617451 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.617425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.617581 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.617558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.617632 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.617618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6frk\" (UniqueName: \"kubernetes.io/projected/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-kube-api-access-z6frk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.719019 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.718964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.719019 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.719012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6frk\" (UniqueName: \"kubernetes.io/projected/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-kube-api-access-z6frk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.719152 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.719089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.719386 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.719363    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.719477 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.719433    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.729064 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.729045    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6frk\" (UniqueName: \"kubernetes.io/projected/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-kube-api-access-z6frk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.834532 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.834511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:37.916798 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.916763    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"]
Jul 07 15:48:37.920986 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.920963    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:37.935835 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.935803    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"]
Jul 07 15:48:37.964239 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:37.964219    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"]
Jul 07 15:48:37.966537 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:48:37.966517    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c59268c_d5bc_4b54_be06_d6c7ca24d7b7.slice/crio-5770603977db798248c5ede067d3322ff2987fc021c8f4a81e0e18dad3e324fa WatchSource:0}: Error finding container 5770603977db798248c5ede067d3322ff2987fc021c8f4a81e0e18dad3e324fa: Status 404 returned error can't find the container with id 5770603977db798248c5ede067d3322ff2987fc021c8f4a81e0e18dad3e324fa
Jul 07 15:48:38.022368 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.022346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.022471 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.022453    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.022531 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.022482    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jdvr\" (UniqueName: \"kubernetes.io/projected/f27e3c08-8b58-47b2-993a-c5356a60c778-kube-api-access-5jdvr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.123906 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.123877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.124155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.123912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jdvr\" (UniqueName: \"kubernetes.io/projected/f27e3c08-8b58-47b2-993a-c5356a60c778-kube-api-access-5jdvr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.124155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.123957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.124303 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.124262    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.124349 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.124273    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.136516 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.136491    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jdvr\" (UniqueName: \"kubernetes.io/projected/f27e3c08-8b58-47b2-993a-c5356a60c778-kube-api-access-5jdvr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.231142 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.231096    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:38.355850 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.355811    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"]
Jul 07 15:48:38.362225 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.362202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.365269 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.365245    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"]
Jul 07 15:48:38.369012 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:48:38.368979    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27e3c08_8b58_47b2_993a_c5356a60c778.slice/crio-66fc5431f4eb2c272a872d14a27243d8bedc68dd92a3ebfde7d8310e445c7495 WatchSource:0}: Error finding container 66fc5431f4eb2c272a872d14a27243d8bedc68dd92a3ebfde7d8310e445c7495: Status 404 returned error can't find the container with id 66fc5431f4eb2c272a872d14a27243d8bedc68dd92a3ebfde7d8310e445c7495
Jul 07 15:48:38.369720 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.369695    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"]
Jul 07 15:48:38.426530 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.426507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdmrk\" (UniqueName: \"kubernetes.io/projected/a008af73-7dd3-4619-aeea-013f2774a619-kube-api-access-kdmrk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.426635 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.426605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.426697 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.426647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.452723 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.452691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g" event={"ID":"f27e3c08-8b58-47b2-993a-c5356a60c778","Type":"ContainerStarted","Data":"01f9a9badf6e1e1ff353eb5cb24a6f2ddd35e3d372e61026530006d251b18fc5"}
Jul 07 15:48:38.452877 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.452745    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g" event={"ID":"f27e3c08-8b58-47b2-993a-c5356a60c778","Type":"ContainerStarted","Data":"66fc5431f4eb2c272a872d14a27243d8bedc68dd92a3ebfde7d8310e445c7495"}
Jul 07 15:48:38.454439 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.454404    2581 generic.go:356] "Generic (PLEG): container finished" podID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerID="36b7aa20b23be7f4dc011a2260f41c88500eb4563ff9fb2354d87cfa63b3bd4e" exitCode=0
Jul 07 15:48:38.454537 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.454480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx" event={"ID":"f523fe42-db47-4ca9-8cc3-5590854c4ca1","Type":"ContainerDied","Data":"36b7aa20b23be7f4dc011a2260f41c88500eb4563ff9fb2354d87cfa63b3bd4e"}
Jul 07 15:48:38.454537 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.454531    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx" event={"ID":"f523fe42-db47-4ca9-8cc3-5590854c4ca1","Type":"ContainerStarted","Data":"cf2c9c1cd433c3dab5b7877458364ca76c10b97469add20fe37e6b2d9a7ea829"}
Jul 07 15:48:38.456107 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.456085    2581 generic.go:356] "Generic (PLEG): container finished" podID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerID="cecf786aec1b59363aafa33c7db4876db22e19bab58ece85495e2b6f4d54053f" exitCode=0
Jul 07 15:48:38.456210 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.456112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx" event={"ID":"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7","Type":"ContainerDied","Data":"cecf786aec1b59363aafa33c7db4876db22e19bab58ece85495e2b6f4d54053f"}
Jul 07 15:48:38.456210 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.456141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx" event={"ID":"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7","Type":"ContainerStarted","Data":"5770603977db798248c5ede067d3322ff2987fc021c8f4a81e0e18dad3e324fa"}
Jul 07 15:48:38.527387 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.527303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.527387 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.527360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.527586 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.527431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdmrk\" (UniqueName: \"kubernetes.io/projected/a008af73-7dd3-4619-aeea-013f2774a619-kube-api-access-kdmrk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.527741 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.527717    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.527814 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.527775    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.537082 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.537057    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdmrk\" (UniqueName: \"kubernetes.io/projected/a008af73-7dd3-4619-aeea-013f2774a619-kube-api-access-kdmrk\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.682898 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.682874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:38.809035 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:38.808931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"]
Jul 07 15:48:38.810990 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:48:38.810958    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda008af73_7dd3_4619_aeea_013f2774a619.slice/crio-4508c846e6651f128117c2274f3061316494c495f6f75cfaa512a87cd76a9230 WatchSource:0}: Error finding container 4508c846e6651f128117c2274f3061316494c495f6f75cfaa512a87cd76a9230: Status 404 returned error can't find the container with id 4508c846e6651f128117c2274f3061316494c495f6f75cfaa512a87cd76a9230
Jul 07 15:48:39.463078 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:39.463049    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx" event={"ID":"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7","Type":"ContainerStarted","Data":"ebcae3b3626be102dfa97c17af6854db6cf7730cea94b542597ddb218b5643d6"}
Jul 07 15:48:39.464691 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:39.464664    2581 generic.go:356] "Generic (PLEG): container finished" podID="a008af73-7dd3-4619-aeea-013f2774a619" containerID="9d4cc7c3a403d7a053042d1ca7a2c84a06898892fc62398b0369304acebc70b3" exitCode=0
Jul 07 15:48:39.464820 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:39.464738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw" event={"ID":"a008af73-7dd3-4619-aeea-013f2774a619","Type":"ContainerDied","Data":"9d4cc7c3a403d7a053042d1ca7a2c84a06898892fc62398b0369304acebc70b3"}
Jul 07 15:48:39.464820 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:39.464776    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw" event={"ID":"a008af73-7dd3-4619-aeea-013f2774a619","Type":"ContainerStarted","Data":"4508c846e6651f128117c2274f3061316494c495f6f75cfaa512a87cd76a9230"}
Jul 07 15:48:39.466128 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:39.466093    2581 generic.go:356] "Generic (PLEG): container finished" podID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerID="01f9a9badf6e1e1ff353eb5cb24a6f2ddd35e3d372e61026530006d251b18fc5" exitCode=0
Jul 07 15:48:39.466210 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:39.466166    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g" event={"ID":"f27e3c08-8b58-47b2-993a-c5356a60c778","Type":"ContainerDied","Data":"01f9a9badf6e1e1ff353eb5cb24a6f2ddd35e3d372e61026530006d251b18fc5"}
Jul 07 15:48:39.468062 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:39.468042    2581 generic.go:356] "Generic (PLEG): container finished" podID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerID="72d044b04cf01622e4d7486be7b93340c474d6af6cbd7b682b12f9b49bc606f9" exitCode=0
Jul 07 15:48:39.468140 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:39.468073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx" event={"ID":"f523fe42-db47-4ca9-8cc3-5590854c4ca1","Type":"ContainerDied","Data":"72d044b04cf01622e4d7486be7b93340c474d6af6cbd7b682b12f9b49bc606f9"}
Jul 07 15:48:40.474634 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:40.474554    2581 generic.go:356] "Generic (PLEG): container finished" podID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerID="eb5af68cb56ca2fe87b2d08e5662d343e3bf2ed220018db8f1151bddff292add" exitCode=0
Jul 07 15:48:40.475019 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:40.474639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g" event={"ID":"f27e3c08-8b58-47b2-993a-c5356a60c778","Type":"ContainerDied","Data":"eb5af68cb56ca2fe87b2d08e5662d343e3bf2ed220018db8f1151bddff292add"}
Jul 07 15:48:40.476812 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:40.476791    2581 generic.go:356] "Generic (PLEG): container finished" podID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerID="c7f762efae142fa2c22a1ac27b6970ab5892be2550bc10bce299261a8750f59d" exitCode=0
Jul 07 15:48:40.476910 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:40.476823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx" event={"ID":"f523fe42-db47-4ca9-8cc3-5590854c4ca1","Type":"ContainerDied","Data":"c7f762efae142fa2c22a1ac27b6970ab5892be2550bc10bce299261a8750f59d"}
Jul 07 15:48:40.478602 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:40.478584    2581 generic.go:356] "Generic (PLEG): container finished" podID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerID="ebcae3b3626be102dfa97c17af6854db6cf7730cea94b542597ddb218b5643d6" exitCode=0
Jul 07 15:48:40.478681 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:40.478641    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx" event={"ID":"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7","Type":"ContainerDied","Data":"ebcae3b3626be102dfa97c17af6854db6cf7730cea94b542597ddb218b5643d6"}
Jul 07 15:48:40.480600 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:40.480572    2581 generic.go:356] "Generic (PLEG): container finished" podID="a008af73-7dd3-4619-aeea-013f2774a619" containerID="b5fc9c5237608a336faecd8d68dacdb5971cb7a99b185808ea78cd9a5a8b095b" exitCode=0
Jul 07 15:48:40.480706 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:40.480620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw" event={"ID":"a008af73-7dd3-4619-aeea-013f2774a619","Type":"ContainerDied","Data":"b5fc9c5237608a336faecd8d68dacdb5971cb7a99b185808ea78cd9a5a8b095b"}
Jul 07 15:48:41.487102 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.487064    2581 generic.go:356] "Generic (PLEG): container finished" podID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerID="1545993cea7b8219e59ea92091a95b6439c47f6a1819114d3c7a9e63e9a75331" exitCode=0
Jul 07 15:48:41.487471 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.487146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g" event={"ID":"f27e3c08-8b58-47b2-993a-c5356a60c778","Type":"ContainerDied","Data":"1545993cea7b8219e59ea92091a95b6439c47f6a1819114d3c7a9e63e9a75331"}
Jul 07 15:48:41.489111 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.489091    2581 generic.go:356] "Generic (PLEG): container finished" podID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerID="b5754fd4de5c32c1ecd9930d941c8ccaf271f1d6842549468dfb356cab2d9878" exitCode=0
Jul 07 15:48:41.489231 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.489152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx" event={"ID":"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7","Type":"ContainerDied","Data":"b5754fd4de5c32c1ecd9930d941c8ccaf271f1d6842549468dfb356cab2d9878"}
Jul 07 15:48:41.491201 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.491174    2581 generic.go:356] "Generic (PLEG): container finished" podID="a008af73-7dd3-4619-aeea-013f2774a619" containerID="e93481d0a582a8231c6947c4745bb18b0ba1bc42986ff8a95e0acb8ab031ae91" exitCode=0
Jul 07 15:48:41.491308 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.491237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw" event={"ID":"a008af73-7dd3-4619-aeea-013f2774a619","Type":"ContainerDied","Data":"e93481d0a582a8231c6947c4745bb18b0ba1bc42986ff8a95e0acb8ab031ae91"}
Jul 07 15:48:41.617654 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.617630    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:41.754673 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.754641    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-util\") pod \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") "
Jul 07 15:48:41.754797 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.754715    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8fp97\" (UniqueName: \"kubernetes.io/projected/f523fe42-db47-4ca9-8cc3-5590854c4ca1-kube-api-access-8fp97\") pod \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") "
Jul 07 15:48:41.754797 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.754741    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-bundle\") pod \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\" (UID: \"f523fe42-db47-4ca9-8cc3-5590854c4ca1\") "
Jul 07 15:48:41.755240 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.755212    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-bundle" (OuterVolumeSpecName: "bundle") pod "f523fe42-db47-4ca9-8cc3-5590854c4ca1" (UID: "f523fe42-db47-4ca9-8cc3-5590854c4ca1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:41.756906 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.756881    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f523fe42-db47-4ca9-8cc3-5590854c4ca1-kube-api-access-8fp97" (OuterVolumeSpecName: "kube-api-access-8fp97") pod "f523fe42-db47-4ca9-8cc3-5590854c4ca1" (UID: "f523fe42-db47-4ca9-8cc3-5590854c4ca1"). InnerVolumeSpecName "kube-api-access-8fp97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:41.759885 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.759852    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-util" (OuterVolumeSpecName: "util") pod "f523fe42-db47-4ca9-8cc3-5590854c4ca1" (UID: "f523fe42-db47-4ca9-8cc3-5590854c4ca1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:41.855628 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.855575    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-util\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:41.855628 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.855596    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8fp97\" (UniqueName: \"kubernetes.io/projected/f523fe42-db47-4ca9-8cc3-5590854c4ca1-kube-api-access-8fp97\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:41.855628 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:41.855607    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f523fe42-db47-4ca9-8cc3-5590854c4ca1-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.497843 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.497812    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx"
Jul 07 15:48:42.498245 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.497860    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx" event={"ID":"f523fe42-db47-4ca9-8cc3-5590854c4ca1","Type":"ContainerDied","Data":"cf2c9c1cd433c3dab5b7877458364ca76c10b97469add20fe37e6b2d9a7ea829"}
Jul 07 15:48:42.498245 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.497899    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf2c9c1cd433c3dab5b7877458364ca76c10b97469add20fe37e6b2d9a7ea829"
Jul 07 15:48:42.635573 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.635549    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:42.681235 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.681214    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:42.684110 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.684092    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:42.762812 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.762753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-util\") pod \"f27e3c08-8b58-47b2-993a-c5356a60c778\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") "
Jul 07 15:48:42.762918 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.762816    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdmrk\" (UniqueName: \"kubernetes.io/projected/a008af73-7dd3-4619-aeea-013f2774a619-kube-api-access-kdmrk\") pod \"a008af73-7dd3-4619-aeea-013f2774a619\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") "
Jul 07 15:48:42.762918 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.762836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-util\") pod \"a008af73-7dd3-4619-aeea-013f2774a619\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") "
Jul 07 15:48:42.762996 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.762960    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-bundle\") pod \"f27e3c08-8b58-47b2-993a-c5356a60c778\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") "
Jul 07 15:48:42.763036 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.762998    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-util\") pod \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") "
Jul 07 15:48:42.763036 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.763028    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jdvr\" (UniqueName: \"kubernetes.io/projected/f27e3c08-8b58-47b2-993a-c5356a60c778-kube-api-access-5jdvr\") pod \"f27e3c08-8b58-47b2-993a-c5356a60c778\" (UID: \"f27e3c08-8b58-47b2-993a-c5356a60c778\") "
Jul 07 15:48:42.763130 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.763054    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-bundle\") pod \"a008af73-7dd3-4619-aeea-013f2774a619\" (UID: \"a008af73-7dd3-4619-aeea-013f2774a619\") "
Jul 07 15:48:42.763130 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.763091    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6frk\" (UniqueName: \"kubernetes.io/projected/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-kube-api-access-z6frk\") pod \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") "
Jul 07 15:48:42.763231 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.763148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-bundle\") pod \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\" (UID: \"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7\") "
Jul 07 15:48:42.763503 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.763473    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-bundle" (OuterVolumeSpecName: "bundle") pod "f27e3c08-8b58-47b2-993a-c5356a60c778" (UID: "f27e3c08-8b58-47b2-993a-c5356a60c778"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:42.763921 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.763895    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-bundle" (OuterVolumeSpecName: "bundle") pod "9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" (UID: "9c59268c-d5bc-4b54-be06-d6c7ca24d7b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:42.764204 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.764174    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-bundle" (OuterVolumeSpecName: "bundle") pod "a008af73-7dd3-4619-aeea-013f2774a619" (UID: "a008af73-7dd3-4619-aeea-013f2774a619"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:42.765320 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.765294    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a008af73-7dd3-4619-aeea-013f2774a619-kube-api-access-kdmrk" (OuterVolumeSpecName: "kube-api-access-kdmrk") pod "a008af73-7dd3-4619-aeea-013f2774a619" (UID: "a008af73-7dd3-4619-aeea-013f2774a619"). InnerVolumeSpecName "kube-api-access-kdmrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:42.765554 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.765531    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-kube-api-access-z6frk" (OuterVolumeSpecName: "kube-api-access-z6frk") pod "9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" (UID: "9c59268c-d5bc-4b54-be06-d6c7ca24d7b7"). InnerVolumeSpecName "kube-api-access-z6frk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:42.765675 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.765649    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27e3c08-8b58-47b2-993a-c5356a60c778-kube-api-access-5jdvr" (OuterVolumeSpecName: "kube-api-access-5jdvr") pod "f27e3c08-8b58-47b2-993a-c5356a60c778" (UID: "f27e3c08-8b58-47b2-993a-c5356a60c778"). InnerVolumeSpecName "kube-api-access-5jdvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:42.768609 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.768578    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-util" (OuterVolumeSpecName: "util") pod "a008af73-7dd3-4619-aeea-013f2774a619" (UID: "a008af73-7dd3-4619-aeea-013f2774a619"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:42.769475 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.769451    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-util" (OuterVolumeSpecName: "util") pod "9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" (UID: "9c59268c-d5bc-4b54-be06-d6c7ca24d7b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:42.769594 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.769574    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-util" (OuterVolumeSpecName: "util") pod "f27e3c08-8b58-47b2-993a-c5356a60c778" (UID: "f27e3c08-8b58-47b2-993a-c5356a60c778"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:42.864457 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864425    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.864457 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864455    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-util\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.864457 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864464    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jdvr\" (UniqueName: \"kubernetes.io/projected/f27e3c08-8b58-47b2-993a-c5356a60c778-kube-api-access-5jdvr\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.864587 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864475    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.864587 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864483    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6frk\" (UniqueName: \"kubernetes.io/projected/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-kube-api-access-z6frk\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.864587 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864491    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c59268c-d5bc-4b54-be06-d6c7ca24d7b7-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.864587 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864498    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f27e3c08-8b58-47b2-993a-c5356a60c778-util\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.864587 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864506    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdmrk\" (UniqueName: \"kubernetes.io/projected/a008af73-7dd3-4619-aeea-013f2774a619-kube-api-access-kdmrk\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:42.864587 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:42.864514    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a008af73-7dd3-4619-aeea-013f2774a619-util\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:48:43.504461 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.504430    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g"
Jul 07 15:48:43.504461 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.504436    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g" event={"ID":"f27e3c08-8b58-47b2-993a-c5356a60c778","Type":"ContainerDied","Data":"66fc5431f4eb2c272a872d14a27243d8bedc68dd92a3ebfde7d8310e445c7495"}
Jul 07 15:48:43.504904 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.504489    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66fc5431f4eb2c272a872d14a27243d8bedc68dd92a3ebfde7d8310e445c7495"
Jul 07 15:48:43.506473 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.506451    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx"
Jul 07 15:48:43.506875 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.506437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx" event={"ID":"9c59268c-d5bc-4b54-be06-d6c7ca24d7b7","Type":"ContainerDied","Data":"5770603977db798248c5ede067d3322ff2987fc021c8f4a81e0e18dad3e324fa"}
Jul 07 15:48:43.506875 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.506850    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5770603977db798248c5ede067d3322ff2987fc021c8f4a81e0e18dad3e324fa"
Jul 07 15:48:43.514963 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.514935    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw" event={"ID":"a008af73-7dd3-4619-aeea-013f2774a619","Type":"ContainerDied","Data":"4508c846e6651f128117c2274f3061316494c495f6f75cfaa512a87cd76a9230"}
Jul 07 15:48:43.515074 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.514990    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw"
Jul 07 15:48:43.515074 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:43.515005    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4508c846e6651f128117c2274f3061316494c495f6f75cfaa512a87cd76a9230"
Jul 07 15:48:46.673184 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673153    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bdc6f467d-2zq4q"]
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673462    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerName="util"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673475    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerName="util"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673485    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerName="pull"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673490    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerName="pull"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673500    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerName="util"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673505    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerName="util"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673515    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerName="pull"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673520    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerName="pull"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673529    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerName="extract"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673535    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerName="extract"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673541    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a008af73-7dd3-4619-aeea-013f2774a619" containerName="util"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673547    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a008af73-7dd3-4619-aeea-013f2774a619" containerName="util"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673556    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerName="extract"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673561    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerName="extract"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673567    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a008af73-7dd3-4619-aeea-013f2774a619" containerName="pull"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673572    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a008af73-7dd3-4619-aeea-013f2774a619" containerName="pull"
Jul 07 15:48:46.673570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673579    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerName="util"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673583    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerName="util"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673589    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerName="pull"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673594    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerName="pull"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673599    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerName="extract"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673603    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerName="extract"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673609    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a008af73-7dd3-4619-aeea-013f2774a619" containerName="extract"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673614    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a008af73-7dd3-4619-aeea-013f2774a619" containerName="extract"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673660    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f523fe42-db47-4ca9-8cc3-5590854c4ca1" containerName="extract"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673668    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c59268c-d5bc-4b54-be06-d6c7ca24d7b7" containerName="extract"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673674    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a008af73-7dd3-4619-aeea-013f2774a619" containerName="extract"
Jul 07 15:48:46.674069 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.673683    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27e3c08-8b58-47b2-993a-c5356a60c778" containerName="extract"
Jul 07 15:48:46.677976 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.677959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.688689 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.688660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bdc6f467d-2zq4q"]
Jul 07 15:48:46.796815 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.796777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxr4m\" (UniqueName: \"kubernetes.io/projected/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-kube-api-access-sxr4m\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.796921 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.796822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-oauth-config\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.796921 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.796854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-trusted-ca-bundle\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.796921 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.796896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-serving-cert\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.796921 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.796912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-oauth-serving-cert\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.797060 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.796934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-service-ca\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.797060 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.796965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-config\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.897966 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.897938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-config\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898078 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.897985    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxr4m\" (UniqueName: \"kubernetes.io/projected/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-kube-api-access-sxr4m\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898119 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898090    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-oauth-config\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898153 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898134    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-trusted-ca-bundle\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898195 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-serving-cert\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898229 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-oauth-serving-cert\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898348 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-service-ca\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898816 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898792    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-config\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898949 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898924    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-service-ca\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.898949 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898861    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-oauth-serving-cert\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.899105 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.898992    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-trusted-ca-bundle\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.900641 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.900614    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-serving-cert\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.900705 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.900655    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-console-oauth-config\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.907626 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.907607    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxr4m\" (UniqueName: \"kubernetes.io/projected/5e4f3937-4c86-4dc8-820b-08777b3dd6b1-kube-api-access-sxr4m\") pod \"console-5bdc6f467d-2zq4q\" (UID: \"5e4f3937-4c86-4dc8-820b-08777b3dd6b1\") " pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:46.987799 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:46.987750    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:47.124023 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:47.123998    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bdc6f467d-2zq4q"]
Jul 07 15:48:47.125318 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:48:47.125270    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4f3937_4c86_4dc8_820b_08777b3dd6b1.slice/crio-74eb5ed1df09e71c264a7b581cdff7e7eee372966b19ae7b0ec28140fd60224a WatchSource:0}: Error finding container 74eb5ed1df09e71c264a7b581cdff7e7eee372966b19ae7b0ec28140fd60224a: Status 404 returned error can't find the container with id 74eb5ed1df09e71c264a7b581cdff7e7eee372966b19ae7b0ec28140fd60224a
Jul 07 15:48:47.541167 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:47.541132    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdc6f467d-2zq4q" event={"ID":"5e4f3937-4c86-4dc8-820b-08777b3dd6b1","Type":"ContainerStarted","Data":"9da50c2444c636b9c905bb75882fe359eac6973358ab1175404661184e82c46e"}
Jul 07 15:48:47.541344 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:47.541202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdc6f467d-2zq4q" event={"ID":"5e4f3937-4c86-4dc8-820b-08777b3dd6b1","Type":"ContainerStarted","Data":"74eb5ed1df09e71c264a7b581cdff7e7eee372966b19ae7b0ec28140fd60224a"}
Jul 07 15:48:47.562155 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:47.562110    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bdc6f467d-2zq4q" podStartSLOduration=1.562096311 podStartE2EDuration="1.562096311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:48:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:48:47.56024245 +0000 UTC m=+407.415819331" watchObservedRunningTime="2026-07-07 15:48:47.562096311 +0000 UTC m=+407.417673190"
Jul 07 15:48:56.988615 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:56.988583    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:56.989058 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:56.988670    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:56.993138 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:56.993116    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:57.590205 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:57.590177    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bdc6f467d-2zq4q"
Jul 07 15:48:57.647907 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:48:57.647878    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568f9c4c88-7f2fr"]
Jul 07 15:49:19.014093 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.014058    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"]
Jul 07 15:49:19.019393 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.019366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"
Jul 07 15:49:19.021384 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.021353    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:49:19.021851 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.021831    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ggfzz\""
Jul 07 15:49:19.021953 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.021858    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:49:19.027809 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.027430    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"]
Jul 07 15:49:19.035106 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.035079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7fxs\" (UniqueName: \"kubernetes.io/projected/d046ee91-9252-43b5-9915-7c217d0cf1f1-kube-api-access-f7fxs\") pod \"limitador-operator-controller-manager-859d7b78bd-6drmg\" (UID: \"d046ee91-9252-43b5-9915-7c217d0cf1f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"
Jul 07 15:49:19.136263 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.136235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7fxs\" (UniqueName: \"kubernetes.io/projected/d046ee91-9252-43b5-9915-7c217d0cf1f1-kube-api-access-f7fxs\") pod \"limitador-operator-controller-manager-859d7b78bd-6drmg\" (UID: \"d046ee91-9252-43b5-9915-7c217d0cf1f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"
Jul 07 15:49:19.150972 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.150950    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7fxs\" (UniqueName: \"kubernetes.io/projected/d046ee91-9252-43b5-9915-7c217d0cf1f1-kube-api-access-f7fxs\") pod \"limitador-operator-controller-manager-859d7b78bd-6drmg\" (UID: \"d046ee91-9252-43b5-9915-7c217d0cf1f1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"
Jul 07 15:49:19.332907 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.332873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"
Jul 07 15:49:19.469407 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.469384    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"]
Jul 07 15:49:19.471252 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:49:19.471225    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd046ee91_9252_43b5_9915_7c217d0cf1f1.slice/crio-2799a19825c4952ebf44f9111cb826fd253be40d6676d3ca175d1f385ede8241 WatchSource:0}: Error finding container 2799a19825c4952ebf44f9111cb826fd253be40d6676d3ca175d1f385ede8241: Status 404 returned error can't find the container with id 2799a19825c4952ebf44f9111cb826fd253be40d6676d3ca175d1f385ede8241
Jul 07 15:49:19.702293 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:19.702202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg" event={"ID":"d046ee91-9252-43b5-9915-7c217d0cf1f1","Type":"ContainerStarted","Data":"2799a19825c4952ebf44f9111cb826fd253be40d6676d3ca175d1f385ede8241"}
Jul 07 15:49:21.714120 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:21.714080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg" event={"ID":"d046ee91-9252-43b5-9915-7c217d0cf1f1","Type":"ContainerStarted","Data":"bd4d0e73c86faba3b47ee013738a1547b396c838e9a58f24fac5a4f752185235"}
Jul 07 15:49:21.714510 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:21.714230    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"
Jul 07 15:49:21.735058 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:21.735015    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg" podStartSLOduration=2.13445565 podStartE2EDuration="3.735001281s" totalImagesPullingTime="1.600545631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:21.734185363 +0000 UTC m=+441.589762241" watchObservedRunningTime="2026-07-07 15:49:21.735001281 +0000 UTC m=+441.590578218"
Jul 07 15:49:22.668214 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.668181    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-568f9c4c88-7f2fr" podUID="33686f66-58dc-48af-910f-127e9c42871a" containerName="console" containerID="cri-o://aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd" gracePeriod=15
Jul 07 15:49:22.915130 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.915107    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:49:22.968802 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.968743    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-console-config\") pod \"33686f66-58dc-48af-910f-127e9c42871a\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") "
Jul 07 15:49:22.968802 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.968781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-trusted-ca-bundle\") pod \"33686f66-58dc-48af-910f-127e9c42871a\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") "
Jul 07 15:49:22.968802 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.968803    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-oauth-serving-cert\") pod \"33686f66-58dc-48af-910f-127e9c42871a\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") "
Jul 07 15:49:22.968992 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.968917    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-service-ca\") pod \"33686f66-58dc-48af-910f-127e9c42871a\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") "
Jul 07 15:49:22.968992 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.968957    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrzfc\" (UniqueName: \"kubernetes.io/projected/33686f66-58dc-48af-910f-127e9c42871a-kube-api-access-zrzfc\") pod \"33686f66-58dc-48af-910f-127e9c42871a\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") "
Jul 07 15:49:22.969096 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.968993    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-oauth-config\") pod \"33686f66-58dc-48af-910f-127e9c42871a\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") "
Jul 07 15:49:22.969096 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969084    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-serving-cert\") pod \"33686f66-58dc-48af-910f-127e9c42871a\" (UID: \"33686f66-58dc-48af-910f-127e9c42871a\") "
Jul 07 15:49:22.969213 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969186    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-console-config" (OuterVolumeSpecName: "console-config") pod "33686f66-58dc-48af-910f-127e9c42871a" (UID: "33686f66-58dc-48af-910f-127e9c42871a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:49:22.969213 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969194    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "33686f66-58dc-48af-910f-127e9c42871a" (UID: "33686f66-58dc-48af-910f-127e9c42871a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:49:22.969351 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969213    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "33686f66-58dc-48af-910f-127e9c42871a" (UID: "33686f66-58dc-48af-910f-127e9c42871a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:49:22.969351 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969232    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-service-ca" (OuterVolumeSpecName: "service-ca") pod "33686f66-58dc-48af-910f-127e9c42871a" (UID: "33686f66-58dc-48af-910f-127e9c42871a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:49:22.969418 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969386    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-service-ca\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:49:22.969418 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969409    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-console-config\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:49:22.969483 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969425    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-trusted-ca-bundle\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:49:22.969483 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.969441    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33686f66-58dc-48af-910f-127e9c42871a-oauth-serving-cert\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:49:22.971141 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.971119    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "33686f66-58dc-48af-910f-127e9c42871a" (UID: "33686f66-58dc-48af-910f-127e9c42871a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:49:22.971256 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.971169    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "33686f66-58dc-48af-910f-127e9c42871a" (UID: "33686f66-58dc-48af-910f-127e9c42871a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:49:22.971256 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:22.971182    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33686f66-58dc-48af-910f-127e9c42871a-kube-api-access-zrzfc" (OuterVolumeSpecName: "kube-api-access-zrzfc") pod "33686f66-58dc-48af-910f-127e9c42871a" (UID: "33686f66-58dc-48af-910f-127e9c42871a"). InnerVolumeSpecName "kube-api-access-zrzfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:49:23.070276 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.070250    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrzfc\" (UniqueName: \"kubernetes.io/projected/33686f66-58dc-48af-910f-127e9c42871a-kube-api-access-zrzfc\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:49:23.070276 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.070273    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-oauth-config\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:49:23.070276 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.070299    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33686f66-58dc-48af-910f-127e9c42871a-console-serving-cert\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 15:49:23.725433 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.725395    2581 generic.go:356] "Generic (PLEG): container finished" podID="33686f66-58dc-48af-910f-127e9c42871a" containerID="aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd" exitCode=0
Jul 07 15:49:23.725626 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.725441    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568f9c4c88-7f2fr"
Jul 07 15:49:23.725626 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.725451    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568f9c4c88-7f2fr" event={"ID":"33686f66-58dc-48af-910f-127e9c42871a","Type":"ContainerDied","Data":"aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd"}
Jul 07 15:49:23.725626 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.725497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568f9c4c88-7f2fr" event={"ID":"33686f66-58dc-48af-910f-127e9c42871a","Type":"ContainerDied","Data":"2431bee3f84744289dbdf1234b8c13d619e21cd59f51896a8eae6d42ac3e64b5"}
Jul 07 15:49:23.725626 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.725522    2581 scope.go:117] "RemoveContainer" containerID="aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd"
Jul 07 15:49:23.734842 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.734824    2581 scope.go:117] "RemoveContainer" containerID="aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd"
Jul 07 15:49:23.735131 ip-10-0-128-7 kubenswrapper[2581]: E0707 15:49:23.735113    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd\": container with ID starting with aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd not found: ID does not exist" containerID="aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd"
Jul 07 15:49:23.735184 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.735137    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd"} err="failed to get container status \"aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd\": rpc error: code = NotFound desc = could not find container \"aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd\": container with ID starting with aef0368f8ac82ad12e266d00ddb466dbff9f5968153724441ce95a4f85a713fd not found: ID does not exist"
Jul 07 15:49:23.749372 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.749351    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568f9c4c88-7f2fr"]
Jul 07 15:49:23.754692 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:23.754672    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568f9c4c88-7f2fr"]
Jul 07 15:49:24.644252 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:24.644215    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33686f66-58dc-48af-910f-127e9c42871a" path="/var/lib/kubelet/pods/33686f66-58dc-48af-910f-127e9c42871a/volumes"
Jul 07 15:49:32.720954 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:49:32.720925    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6drmg"
Jul 07 15:50:14.317356 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.317319    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:50:14.317736 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.317641    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33686f66-58dc-48af-910f-127e9c42871a" containerName="console"
Jul 07 15:50:14.317736 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.317652    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="33686f66-58dc-48af-910f-127e9c42871a" containerName="console"
Jul 07 15:50:14.317736 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.317705    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="33686f66-58dc-48af-910f-127e9c42871a" containerName="console"
Jul 07 15:50:14.323528 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.323503    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:14.325617 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.325585    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 15:50:14.325730 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.325680    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z8hpb\""
Jul 07 15:50:14.334574 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.334549    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:50:14.369428 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.369405    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:50:14.444631 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.444608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2rvx\" (UniqueName: \"kubernetes.io/projected/00b85f02-0d38-4946-ba69-f2a46fcd9f2f-kube-api-access-v2rvx\") pod \"limitador-limitador-54d6d988d5-chlqz\" (UID: \"00b85f02-0d38-4946-ba69-f2a46fcd9f2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:14.444729 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.444671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00b85f02-0d38-4946-ba69-f2a46fcd9f2f-config-file\") pod \"limitador-limitador-54d6d988d5-chlqz\" (UID: \"00b85f02-0d38-4946-ba69-f2a46fcd9f2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:14.545545 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.545499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00b85f02-0d38-4946-ba69-f2a46fcd9f2f-config-file\") pod \"limitador-limitador-54d6d988d5-chlqz\" (UID: \"00b85f02-0d38-4946-ba69-f2a46fcd9f2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:14.545687 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.545587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2rvx\" (UniqueName: \"kubernetes.io/projected/00b85f02-0d38-4946-ba69-f2a46fcd9f2f-kube-api-access-v2rvx\") pod \"limitador-limitador-54d6d988d5-chlqz\" (UID: \"00b85f02-0d38-4946-ba69-f2a46fcd9f2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:14.546118 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.546099    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00b85f02-0d38-4946-ba69-f2a46fcd9f2f-config-file\") pod \"limitador-limitador-54d6d988d5-chlqz\" (UID: \"00b85f02-0d38-4946-ba69-f2a46fcd9f2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:14.558534 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.558507    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2rvx\" (UniqueName: \"kubernetes.io/projected/00b85f02-0d38-4946-ba69-f2a46fcd9f2f-kube-api-access-v2rvx\") pod \"limitador-limitador-54d6d988d5-chlqz\" (UID: \"00b85f02-0d38-4946-ba69-f2a46fcd9f2f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:14.634083 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.634060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:14.773132 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.773108    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:50:14.775156 ip-10-0-128-7 kubenswrapper[2581]: W0707 15:50:14.775124    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b85f02_0d38_4946_ba69_f2a46fcd9f2f.slice/crio-fbfc203651efa03f473dfc19282be05a5d595582692069d82dbcc1e483c2c80a WatchSource:0}: Error finding container fbfc203651efa03f473dfc19282be05a5d595582692069d82dbcc1e483c2c80a: Status 404 returned error can't find the container with id fbfc203651efa03f473dfc19282be05a5d595582692069d82dbcc1e483c2c80a
Jul 07 15:50:14.966319 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:14.966232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz" event={"ID":"00b85f02-0d38-4946-ba69-f2a46fcd9f2f","Type":"ContainerStarted","Data":"fbfc203651efa03f473dfc19282be05a5d595582692069d82dbcc1e483c2c80a"}
Jul 07 15:50:17.989143 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:17.989092    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz" event={"ID":"00b85f02-0d38-4946-ba69-f2a46fcd9f2f","Type":"ContainerStarted","Data":"db1ccc7464b8ff85e1105adcb08682392c946073b3793c461b4c5678ce04e0a1"}
Jul 07 15:50:17.989546 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:17.989232    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:50:18.008520 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:18.008478    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz" podStartSLOduration=1.637008744 podStartE2EDuration="4.008465446s" totalImagesPullingTime="2.371456702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:50:18.006694024 +0000 UTC m=+497.862270902" watchObservedRunningTime="2026-07-07 15:50:18.008465446 +0000 UTC m=+497.864042325"
Jul 07 15:50:28.994343 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:50:28.994302    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-chlqz"
Jul 07 15:51:31.581467 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:51:31.581432    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:51:49.633838 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:51:49.633800    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:51:56.471741 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:51:56.471705    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:52:01.358570 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:52:01.358535    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:52:07.836798 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:52:07.836761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:52:29.663203 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:52:29.663124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:52:44.553450 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:52:44.553414    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:54:00.447243 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:54:00.447164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:54:10.356393 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:54:10.356359    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:54:21.654997 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:54:21.654960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:54:29.678738 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:54:29.678702    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:54:40.249650 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:54:40.249609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:55:07.562043 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:55:07.562007    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:55:20.748850 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:55:20.748818    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:56:02.577083 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:56:02.577047    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:56:11.549942 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:56:11.549908    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:56:21.788986 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:56:21.788946    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:56:29.856928 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:56:29.856893    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:56:39.755828 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:56:39.755781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:56:55.745759 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:56:55.745680    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:57:01.649921 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:57:01.649881    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:57:10.253524 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:57:10.253489    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:57:32.256063 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:57:32.256029    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:57:44.855168 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:57:44.855121    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:58:08.749200 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:58:08.749163    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:58:18.848066 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:58:18.848031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:58:34.040168 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:58:34.040092    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:58:45.639559 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:58:45.639525    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:58:54.838032 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:58:54.837996    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:59:04.545769 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:59:04.545726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 15:59:13.945578 ip-10-0-128-7 kubenswrapper[2581]: I0707 15:59:13.945546    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:01:01.050339 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:01:01.050300    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:01:12.173705 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:01:12.173673    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:01:22.998624 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:01:22.998585    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:01:35.453514 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:01:35.453479    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:01:47.254768 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:01:47.254728    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:01:57.663952 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:01:57.663914    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:02:05.947073 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:02:05.947042    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:02:16.775000 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:02:16.774964    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:02:28.145152 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:02:28.145121    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:02:35.947545 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:02:35.947506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:02:44.960315 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:02:44.960263    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:02:54.155333 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:02:54.155246    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:03:12.650927 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:03:12.650896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:03:22.044124 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:03:22.044091    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:03:31.559094 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:03:31.559056    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:03:42.450053 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:03:42.450020    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:03:50.085130 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:03:50.085094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:04:01.672368 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:04:01.672332    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:04:10.854365 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:04:10.854330    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:04:20.748931 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:04:20.748896    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:04:30.750202 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:04:30.750128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:04:39.979297 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:04:39.979256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:04:49.569811 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:04:49.569778    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:05:03.548793 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:05:03.548759    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:05:12.940602 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:05:12.940569    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:05:22.450056 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:05:22.450021    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:05:34.753647 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:05:34.753615    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:05:45.939585 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:05:45.939553    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:05:54.252470 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:05:54.252391    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:06:06.343019 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:06:06.342977    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:06:18.341485 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:06:18.341443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:06:30.654961 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:06:30.654930    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:06:39.350919 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:06:39.350882    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:06:52.645559 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:06:52.645527    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:07:01.441201 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:07:01.441164    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:07:16.246418 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:07:16.246386    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:07:26.457711 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:07:26.457673    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:09:26.946828 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:09:26.946745    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:09:34.844614 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:09:34.844581    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:09:42.748493 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:09:42.748455    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:09:50.340074 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:09:50.340038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:10:01.350122 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:01.350089    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:10:35.445634 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:35.445553    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:10:38.342160 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.342129    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"]
Jul 07 16:10:38.345471 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.345450    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.347502 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.347477    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2f31ab17\"/\"openshift-service-ca.crt\""
Jul 07 16:10:38.347647 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.347609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2f31ab17\"/\"default-dockercfg-kcgrx\""
Jul 07 16:10:38.348186 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.348163    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-2f31ab17\"/\"kube-root-ca.crt\""
Jul 07 16:10:38.348303 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.348220    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-2f31ab17\"/\"e2e-lifecycle-model-2f31ab17-kserve-self-signed-certs\""
Jul 07 16:10:38.358660 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.358638    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"]
Jul 07 16:10:38.380336 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.380310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-model-cache\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.380422 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.380350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tls-certs\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.380422 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.380372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-dshm\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.380508 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.380439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-home\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.380508 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.380486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f94rx\" (UniqueName: \"kubernetes.io/projected/dae12eec-c5cd-4266-a672-2f13ec4efa7d-kube-api-access-f94rx\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.380600 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.380558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tmp-dir\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481097 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tmp-dir\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481214 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-model-cache\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481214 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tls-certs\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481214 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-dshm\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481214 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-home\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481442 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f94rx\" (UniqueName: \"kubernetes.io/projected/dae12eec-c5cd-4266-a672-2f13ec4efa7d-kube-api-access-f94rx\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481608 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481585    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-model-cache\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481689 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481624    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tmp-dir\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.481730 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.481680    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-home\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.483445 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.483428    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-dshm\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.483727 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.483708    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tls-certs\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.491400 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.491375    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f94rx\" (UniqueName: \"kubernetes.io/projected/dae12eec-c5cd-4266-a672-2f13ec4efa7d-kube-api-access-f94rx\") pod \"e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") " pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.654815 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.654525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:38.784420 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.784394    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"]
Jul 07 16:10:38.786248 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:10:38.786220    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddae12eec_c5cd_4266_a672_2f13ec4efa7d.slice/crio-7bd79c0d00c4301dc74d048f3c4df2bc4245efc2f0299f06b6dab5fb78fcce3b WatchSource:0}: Error finding container 7bd79c0d00c4301dc74d048f3c4df2bc4245efc2f0299f06b6dab5fb78fcce3b: Status 404 returned error can't find the container with id 7bd79c0d00c4301dc74d048f3c4df2bc4245efc2f0299f06b6dab5fb78fcce3b
Jul 07 16:10:38.787961 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.787938    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:10:38.841817 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:38.841791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk" event={"ID":"dae12eec-c5cd-4266-a672-2f13ec4efa7d","Type":"ContainerStarted","Data":"7bd79c0d00c4301dc74d048f3c4df2bc4245efc2f0299f06b6dab5fb78fcce3b"}
Jul 07 16:10:40.853861 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:40.853826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk" event={"ID":"dae12eec-c5cd-4266-a672-2f13ec4efa7d","Type":"ContainerStarted","Data":"69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558"}
Jul 07 16:10:40.874982 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:40.874933    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk" podStartSLOduration=1.728984812 podStartE2EDuration="2.874918513s" totalImagesPullingTime="1.145933701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:10:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:40.87405202 +0000 UTC m=+1720.729628900" watchObservedRunningTime="2026-07-07 16:10:40.874918513 +0000 UTC m=+1720.730495391"
Jul 07 16:10:47.255399 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:47.255362    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:10:48.657971 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:48.657941    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:48.658468 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:48.657994    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:48.670229 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:48.670203    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:10:48.901997 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:10:48.901971    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:11:10.142239 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:10.142205    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:11:22.646371 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:22.646338    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:11:23.705744 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:23.705711    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"]
Jul 07 16:11:38.725739 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:38.725695    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk" podUID="dae12eec-c5cd-4266-a672-2f13ec4efa7d" containerName="main" containerID="cri-o://69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558" gracePeriod=45
Jul 07 16:11:38.891732 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:38.891688    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk" podUID="dae12eec-c5cd-4266-a672-2f13ec4efa7d" containerName="main" probeResult="failure" output="Get \"https://10.133.0.40:8000/ready\": dial tcp 10.133.0.40:8000: connect: connection refused"
Jul 07 16:11:38.970526 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:38.970501    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:11:39.043619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043545    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-dshm\") pod \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") "
Jul 07 16:11:39.043619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tmp-dir\") pod \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") "
Jul 07 16:11:39.043619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043615    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-home\") pod \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") "
Jul 07 16:11:39.043876 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043667    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-model-cache\") pod \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") "
Jul 07 16:11:39.043876 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043722    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f94rx\" (UniqueName: \"kubernetes.io/projected/dae12eec-c5cd-4266-a672-2f13ec4efa7d-kube-api-access-f94rx\") pod \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") "
Jul 07 16:11:39.043876 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043749    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tls-certs\") pod \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\" (UID: \"dae12eec-c5cd-4266-a672-2f13ec4efa7d\") "
Jul 07 16:11:39.043876 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043846    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dae12eec-c5cd-4266-a672-2f13ec4efa7d" (UID: "dae12eec-c5cd-4266-a672-2f13ec4efa7d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:39.044072 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043900    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-home" (OuterVolumeSpecName: "home") pod "dae12eec-c5cd-4266-a672-2f13ec4efa7d" (UID: "dae12eec-c5cd-4266-a672-2f13ec4efa7d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:39.044072 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.043944    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-model-cache" (OuterVolumeSpecName: "model-cache") pod "dae12eec-c5cd-4266-a672-2f13ec4efa7d" (UID: "dae12eec-c5cd-4266-a672-2f13ec4efa7d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:39.044072 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.044033    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:11:39.044072 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.044049    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:11:39.044072 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.044062    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:11:39.045778 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.045754    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dae12eec-c5cd-4266-a672-2f13ec4efa7d" (UID: "dae12eec-c5cd-4266-a672-2f13ec4efa7d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:11:39.045850 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.045792    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-dshm" (OuterVolumeSpecName: "dshm") pod "dae12eec-c5cd-4266-a672-2f13ec4efa7d" (UID: "dae12eec-c5cd-4266-a672-2f13ec4efa7d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:39.045886 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.045849    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae12eec-c5cd-4266-a672-2f13ec4efa7d-kube-api-access-f94rx" (OuterVolumeSpecName: "kube-api-access-f94rx") pod "dae12eec-c5cd-4266-a672-2f13ec4efa7d" (UID: "dae12eec-c5cd-4266-a672-2f13ec4efa7d"). InnerVolumeSpecName "kube-api-access-f94rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:11:39.142890 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.142865    2581 generic.go:356] "Generic (PLEG): container finished" podID="dae12eec-c5cd-4266-a672-2f13ec4efa7d" containerID="69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558" exitCode=0
Jul 07 16:11:39.143013 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.142909    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"
Jul 07 16:11:39.143013 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.142910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk" event={"ID":"dae12eec-c5cd-4266-a672-2f13ec4efa7d","Type":"ContainerDied","Data":"69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558"}
Jul 07 16:11:39.143013 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.142999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk" event={"ID":"dae12eec-c5cd-4266-a672-2f13ec4efa7d","Type":"ContainerDied","Data":"7bd79c0d00c4301dc74d048f3c4df2bc4245efc2f0299f06b6dab5fb78fcce3b"}
Jul 07 16:11:39.143112 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.143019    2581 scope.go:117] "RemoveContainer" containerID="69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558"
Jul 07 16:11:39.144584 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.144564    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dae12eec-c5cd-4266-a672-2f13ec4efa7d-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:11:39.144698 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.144587    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f94rx\" (UniqueName: \"kubernetes.io/projected/dae12eec-c5cd-4266-a672-2f13ec4efa7d-kube-api-access-f94rx\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:11:39.144698 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.144607    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dae12eec-c5cd-4266-a672-2f13ec4efa7d-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:11:39.152100 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.152084    2581 scope.go:117] "RemoveContainer" containerID="69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558"
Jul 07 16:11:39.152368 ip-10-0-128-7 kubenswrapper[2581]: E0707 16:11:39.152350    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558\": container with ID starting with 69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558 not found: ID does not exist" containerID="69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558"
Jul 07 16:11:39.152425 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.152376    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558"} err="failed to get container status \"69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558\": rpc error: code = NotFound desc = could not find container \"69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558\": container with ID starting with 69f8b047991c4b16e4ff7c9cb80f91c546668690fc719dd42c5f8be6f6421558 not found: ID does not exist"
Jul 07 16:11:39.167224 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.167202    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"]
Jul 07 16:11:39.169945 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:39.169922    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-2f31ab17/e2e-lifecycle-model-2f31ab17-kserve-bd95947-8smlk"]
Jul 07 16:11:40.644444 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:11:40.644410    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae12eec-c5cd-4266-a672-2f13ec4efa7d" path="/var/lib/kubelet/pods/dae12eec-c5cd-4266-a672-2f13ec4efa7d/volumes"
Jul 07 16:12:03.241547 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:12:03.241494    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:12:14.154747 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:12:14.154711    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:12:27.052499 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:12:27.052466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:13:16.362346 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:16.362304    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:13:26.743125 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.743040    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"]
Jul 07 16:13:26.743573 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.743536    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae12eec-c5cd-4266-a672-2f13ec4efa7d" containerName="main"
Jul 07 16:13:26.743573 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.743551    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae12eec-c5cd-4266-a672-2f13ec4efa7d" containerName="main"
Jul 07 16:13:26.743646 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.743635    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae12eec-c5cd-4266-a672-2f13ec4efa7d" containerName="main"
Jul 07 16:13:26.746990 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.746971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.749769 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.749747    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d4320a\"/\"default-dockercfg-64clq\""
Jul 07 16:13:26.749896 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.749748    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d4320a\"/\"test-model-d4320a-kserve-self-signed-certs\""
Jul 07 16:13:26.749896 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.749786    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d4320a\"/\"kube-root-ca.crt\""
Jul 07 16:13:26.749896 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.749821    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d4320a\"/\"openshift-service-ca.crt\""
Jul 07 16:13:26.755445 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.755424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"]
Jul 07 16:13:26.841029 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.841008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75b55600-6fda-415b-bb65-11e2b6f70e17-tls-certs\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.841118 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.841046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-home\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.841118 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.841076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-model-cache\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.841118 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.841115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrqsn\" (UniqueName: \"kubernetes.io/projected/75b55600-6fda-415b-bb65-11e2b6f70e17-kube-api-access-nrqsn\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.841224 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.841137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-dshm\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.841224 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.841165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-tmp-dir\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942086 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-model-cache\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942255 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrqsn\" (UniqueName: \"kubernetes.io/projected/75b55600-6fda-415b-bb65-11e2b6f70e17-kube-api-access-nrqsn\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942255 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-dshm\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942255 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-tmp-dir\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942255 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75b55600-6fda-415b-bb65-11e2b6f70e17-tls-certs\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942255 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942188    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-home\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942596 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942536    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-model-cache\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942596 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942548    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-home\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.942684 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.942589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-tmp-dir\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.944435 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.944413    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-dshm\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.944739 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.944719    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75b55600-6fda-415b-bb65-11e2b6f70e17-tls-certs\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:26.951590 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.951554    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:13:26.954146 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:26.954123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrqsn\" (UniqueName: \"kubernetes.io/projected/75b55600-6fda-415b-bb65-11e2b6f70e17-kube-api-access-nrqsn\") pod \"test-model-d4320a-kserve-67d958587c-j7ddd\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") " pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:27.057169 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:27.057104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:27.196372 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:27.196345    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"]
Jul 07 16:13:27.197716 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:13:27.197691    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75b55600_6fda_415b_bb65_11e2b6f70e17.slice/crio-6a5a3a18ed7fecae2e47e142477733afe103e97e60584a36e11cce5e943d9402 WatchSource:0}: Error finding container 6a5a3a18ed7fecae2e47e142477733afe103e97e60584a36e11cce5e943d9402: Status 404 returned error can't find the container with id 6a5a3a18ed7fecae2e47e142477733afe103e97e60584a36e11cce5e943d9402
Jul 07 16:13:27.673069 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:27.673032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd" event={"ID":"75b55600-6fda-415b-bb65-11e2b6f70e17","Type":"ContainerStarted","Data":"9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a"}
Jul 07 16:13:27.673238 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:27.673078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd" event={"ID":"75b55600-6fda-415b-bb65-11e2b6f70e17","Type":"ContainerStarted","Data":"6a5a3a18ed7fecae2e47e142477733afe103e97e60584a36e11cce5e943d9402"}
Jul 07 16:13:27.694485 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:27.694430    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd" podStartSLOduration=1.694415182 podStartE2EDuration="1.694415182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:13:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:13:27.692163715 +0000 UTC m=+1887.547740597" watchObservedRunningTime="2026-07-07 16:13:27.694415182 +0000 UTC m=+1887.549992063"
Jul 07 16:13:37.057275 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:37.057235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:37.057669 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:37.057310    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:37.069905 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:37.069881    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:37.731755 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:37.731728    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:13:38.352980 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:38.352947    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:13:47.056011 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.055975    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"]
Jul 07 16:13:47.059039 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.059019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.063400 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.063376    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-eb74cf\"/\"openshift-service-ca.crt\""
Jul 07 16:13:47.063512 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.063412    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-eb74cf\"/\"default-dockercfg-5rkrt\""
Jul 07 16:13:47.064389 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.064371    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-eb74cf\"/\"test-model-eb74cf-kserve-self-signed-certs\""
Jul 07 16:13:47.064478 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.064417    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-eb74cf\"/\"kube-root-ca.crt\""
Jul 07 16:13:47.073729 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.073706    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"]
Jul 07 16:13:47.100387 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.100364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-home\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.100507 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.100425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tls-certs\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.100507 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.100486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-dshm\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.100617 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.100512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-model-cache\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.100617 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.100572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqnz9\" (UniqueName: \"kubernetes.io/projected/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-kube-api-access-dqnz9\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.100690 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.100645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tmp-dir\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.201911 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.201887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tmp-dir\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.202021 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.201923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-home\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.202021 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.201970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tls-certs\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.202021 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.201991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-dshm\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.202021 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.202007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-model-cache\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.202215 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.202029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqnz9\" (UniqueName: \"kubernetes.io/projected/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-kube-api-access-dqnz9\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.202304 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.202267    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tmp-dir\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.202398 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.202378    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-home\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.202453 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.202419    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-model-cache\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.204252 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.204227    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-dshm\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.204436 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.204419    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tls-certs\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.211714 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.211695    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqnz9\" (UniqueName: \"kubernetes.io/projected/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-kube-api-access-dqnz9\") pod \"test-model-eb74cf-kserve-bc95b896c-2wjvv\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") " pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.368343 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.368319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:47.502474 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.502445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"]
Jul 07 16:13:47.504151 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:13:47.504123    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0ec03a0_8cee_46c2_9fec_820f466fb3f2.slice/crio-3279ab5782357825a045fbf131b39528c976386de38e3697c262f93a690747ea WatchSource:0}: Error finding container 3279ab5782357825a045fbf131b39528c976386de38e3697c262f93a690747ea: Status 404 returned error can't find the container with id 3279ab5782357825a045fbf131b39528c976386de38e3697c262f93a690747ea
Jul 07 16:13:47.776773 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.776687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv" event={"ID":"d0ec03a0-8cee-46c2-9fec-820f466fb3f2","Type":"ContainerStarted","Data":"866aa7684e45e21ca112fcebf037123cf0aa26dbff83c9cb5d1a86fb8992c202"}
Jul 07 16:13:47.776773 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.776741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv" event={"ID":"d0ec03a0-8cee-46c2-9fec-820f466fb3f2","Type":"ContainerStarted","Data":"3279ab5782357825a045fbf131b39528c976386de38e3697c262f93a690747ea"}
Jul 07 16:13:47.794941 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:47.794893    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv" podStartSLOduration=0.794879883 podStartE2EDuration="794.879883ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:13:47.793783706 +0000 UTC m=+1907.649360586" watchObservedRunningTime="2026-07-07 16:13:47.794879883 +0000 UTC m=+1907.650456761"
Jul 07 16:13:51.764477 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:51.764441    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:13:57.368850 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:57.368815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:57.368850 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:57.368858    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:57.381197 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:57.381175    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:13:57.835898 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:13:57.835875    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:14:04.800182 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:04.800145    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"]
Jul 07 16:14:05.774652 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:05.774619    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"]
Jul 07 16:14:10.560584 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:10.560548    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:14:19.819751 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:19.819705    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd" podUID="75b55600-6fda-415b-bb65-11e2b6f70e17" containerName="main" containerID="cri-o://9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a" gracePeriod=45
Jul 07 16:14:20.060884 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.060860    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:14:20.253918 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.253872    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75b55600-6fda-415b-bb65-11e2b6f70e17-tls-certs\") pod \"75b55600-6fda-415b-bb65-11e2b6f70e17\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") "
Jul 07 16:14:20.253918 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.253923    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrqsn\" (UniqueName: \"kubernetes.io/projected/75b55600-6fda-415b-bb65-11e2b6f70e17-kube-api-access-nrqsn\") pod \"75b55600-6fda-415b-bb65-11e2b6f70e17\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") "
Jul 07 16:14:20.254177 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.253944    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-tmp-dir\") pod \"75b55600-6fda-415b-bb65-11e2b6f70e17\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") "
Jul 07 16:14:20.254177 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.254012    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-home\") pod \"75b55600-6fda-415b-bb65-11e2b6f70e17\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") "
Jul 07 16:14:20.254177 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.254031    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-model-cache\") pod \"75b55600-6fda-415b-bb65-11e2b6f70e17\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") "
Jul 07 16:14:20.254177 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.254049    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-dshm\") pod \"75b55600-6fda-415b-bb65-11e2b6f70e17\" (UID: \"75b55600-6fda-415b-bb65-11e2b6f70e17\") "
Jul 07 16:14:20.254403 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.254318    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75b55600-6fda-415b-bb65-11e2b6f70e17" (UID: "75b55600-6fda-415b-bb65-11e2b6f70e17"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:14:20.254403 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.254273    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-model-cache" (OuterVolumeSpecName: "model-cache") pod "75b55600-6fda-415b-bb65-11e2b6f70e17" (UID: "75b55600-6fda-415b-bb65-11e2b6f70e17"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:14:20.254403 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.254358    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-home" (OuterVolumeSpecName: "home") pod "75b55600-6fda-415b-bb65-11e2b6f70e17" (UID: "75b55600-6fda-415b-bb65-11e2b6f70e17"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:14:20.256186 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.256159    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-dshm" (OuterVolumeSpecName: "dshm") pod "75b55600-6fda-415b-bb65-11e2b6f70e17" (UID: "75b55600-6fda-415b-bb65-11e2b6f70e17"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:14:20.256322 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.256247    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b55600-6fda-415b-bb65-11e2b6f70e17-kube-api-access-nrqsn" (OuterVolumeSpecName: "kube-api-access-nrqsn") pod "75b55600-6fda-415b-bb65-11e2b6f70e17" (UID: "75b55600-6fda-415b-bb65-11e2b6f70e17"). InnerVolumeSpecName "kube-api-access-nrqsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:14:20.256322 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.256303    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75b55600-6fda-415b-bb65-11e2b6f70e17-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75b55600-6fda-415b-bb65-11e2b6f70e17" (UID: "75b55600-6fda-415b-bb65-11e2b6f70e17"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:14:20.354844 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.354819    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:20.354844 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.354841    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:20.354976 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.354851    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:20.354976 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.354858    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75b55600-6fda-415b-bb65-11e2b6f70e17-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:20.354976 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.354868    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrqsn\" (UniqueName: \"kubernetes.io/projected/75b55600-6fda-415b-bb65-11e2b6f70e17-kube-api-access-nrqsn\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:20.354976 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.354875    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75b55600-6fda-415b-bb65-11e2b6f70e17-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:20.794300 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.794247    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv" podUID="d0ec03a0-8cee-46c2-9fec-820f466fb3f2" containerName="main" containerID="cri-o://866aa7684e45e21ca112fcebf037123cf0aa26dbff83c9cb5d1a86fb8992c202" gracePeriod=45
Jul 07 16:14:20.933893 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.933851    2581 generic.go:356] "Generic (PLEG): container finished" podID="d0ec03a0-8cee-46c2-9fec-820f466fb3f2" containerID="866aa7684e45e21ca112fcebf037123cf0aa26dbff83c9cb5d1a86fb8992c202" exitCode=0
Jul 07 16:14:20.934365 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.934044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv" event={"ID":"d0ec03a0-8cee-46c2-9fec-820f466fb3f2","Type":"ContainerDied","Data":"866aa7684e45e21ca112fcebf037123cf0aa26dbff83c9cb5d1a86fb8992c202"}
Jul 07 16:14:20.935495 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.935471    2581 generic.go:356] "Generic (PLEG): container finished" podID="75b55600-6fda-415b-bb65-11e2b6f70e17" containerID="9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a" exitCode=0
Jul 07 16:14:20.935619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.935512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd" event={"ID":"75b55600-6fda-415b-bb65-11e2b6f70e17","Type":"ContainerDied","Data":"9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a"}
Jul 07 16:14:20.935619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.935525    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"
Jul 07 16:14:20.935619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.935535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd" event={"ID":"75b55600-6fda-415b-bb65-11e2b6f70e17","Type":"ContainerDied","Data":"6a5a3a18ed7fecae2e47e142477733afe103e97e60584a36e11cce5e943d9402"}
Jul 07 16:14:20.935619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.935550    2581 scope.go:117] "RemoveContainer" containerID="9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a"
Jul 07 16:14:20.944659 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.944631    2581 scope.go:117] "RemoveContainer" containerID="9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a"
Jul 07 16:14:20.944914 ip-10-0-128-7 kubenswrapper[2581]: E0707 16:14:20.944892    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a\": container with ID starting with 9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a not found: ID does not exist" containerID="9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a"
Jul 07 16:14:20.944967 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.944925    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a"} err="failed to get container status \"9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a\": rpc error: code = NotFound desc = could not find container \"9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a\": container with ID starting with 9a44c752c24630d0b9b669278627f7fb97e60f1b740856caaa23d0505788596a not found: ID does not exist"
Jul 07 16:14:20.962783 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.962760    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"]
Jul 07 16:14:20.977641 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:20.977611    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d4320a/test-model-d4320a-kserve-67d958587c-j7ddd"]
Jul 07 16:14:21.031263 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.031242    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:14:21.160836 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.160771    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqnz9\" (UniqueName: \"kubernetes.io/projected/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-kube-api-access-dqnz9\") pod \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") "
Jul 07 16:14:21.160836 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.160804    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-model-cache\") pod \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") "
Jul 07 16:14:21.160836 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.160832    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tls-certs\") pod \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") "
Jul 07 16:14:21.161319 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.160865    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-home\") pod \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") "
Jul 07 16:14:21.161319 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.160887    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tmp-dir\") pod \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") "
Jul 07 16:14:21.161319 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.160911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-dshm\") pod \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\" (UID: \"d0ec03a0-8cee-46c2-9fec-820f466fb3f2\") "
Jul 07 16:14:21.161319 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.161077    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0ec03a0-8cee-46c2-9fec-820f466fb3f2" (UID: "d0ec03a0-8cee-46c2-9fec-820f466fb3f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:14:21.161319 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.161120    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-home" (OuterVolumeSpecName: "home") pod "d0ec03a0-8cee-46c2-9fec-820f466fb3f2" (UID: "d0ec03a0-8cee-46c2-9fec-820f466fb3f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:14:21.161319 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.161154    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0ec03a0-8cee-46c2-9fec-820f466fb3f2" (UID: "d0ec03a0-8cee-46c2-9fec-820f466fb3f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:14:21.163052 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.163034    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-kube-api-access-dqnz9" (OuterVolumeSpecName: "kube-api-access-dqnz9") pod "d0ec03a0-8cee-46c2-9fec-820f466fb3f2" (UID: "d0ec03a0-8cee-46c2-9fec-820f466fb3f2"). InnerVolumeSpecName "kube-api-access-dqnz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:14:21.163477 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.163457    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0ec03a0-8cee-46c2-9fec-820f466fb3f2" (UID: "d0ec03a0-8cee-46c2-9fec-820f466fb3f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:14:21.163546 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.163472    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-dshm" (OuterVolumeSpecName: "dshm") pod "d0ec03a0-8cee-46c2-9fec-820f466fb3f2" (UID: "d0ec03a0-8cee-46c2-9fec-820f466fb3f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:14:21.261775 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.261742    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:21.261936 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.261786    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:21.261936 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.261796    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:21.261936 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.261805    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqnz9\" (UniqueName: \"kubernetes.io/projected/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-kube-api-access-dqnz9\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:21.261936 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.261816    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:21.261936 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.261824    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0ec03a0-8cee-46c2-9fec-820f466fb3f2-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:14:21.942934 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.942905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv" event={"ID":"d0ec03a0-8cee-46c2-9fec-820f466fb3f2","Type":"ContainerDied","Data":"3279ab5782357825a045fbf131b39528c976386de38e3697c262f93a690747ea"}
Jul 07 16:14:21.942934 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.942935    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"
Jul 07 16:14:21.943393 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.942953    2581 scope.go:117] "RemoveContainer" containerID="866aa7684e45e21ca112fcebf037123cf0aa26dbff83c9cb5d1a86fb8992c202"
Jul 07 16:14:21.968800 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.968779    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"]
Jul 07 16:14:21.974277 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:21.974257    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-eb74cf/test-model-eb74cf-kserve-bc95b896c-2wjvv"]
Jul 07 16:14:22.643822 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:22.643782    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b55600-6fda-415b-bb65-11e2b6f70e17" path="/var/lib/kubelet/pods/75b55600-6fda-415b-bb65-11e2b6f70e17/volumes"
Jul 07 16:14:22.644235 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:22.644214    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0ec03a0-8cee-46c2-9fec-820f466fb3f2" path="/var/lib/kubelet/pods/d0ec03a0-8cee-46c2-9fec-820f466fb3f2/volumes"
Jul 07 16:14:53.148642 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:14:53.148605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:15:07.557132 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:07.557083    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:15:19.472926 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:19.472890    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:15:33.652807 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:33.652767    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:15:46.955921 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:46.955880    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:15:58.561983 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.561945    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:15:58.863065 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.863032    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"]
Jul 07 16:15:58.863365 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.863352    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ec03a0-8cee-46c2-9fec-820f466fb3f2" containerName="main"
Jul 07 16:15:58.863365 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.863366    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ec03a0-8cee-46c2-9fec-820f466fb3f2" containerName="main"
Jul 07 16:15:58.863446 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.863374    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75b55600-6fda-415b-bb65-11e2b6f70e17" containerName="main"
Jul 07 16:15:58.863446 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.863381    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="75b55600-6fda-415b-bb65-11e2b6f70e17" containerName="main"
Jul 07 16:15:58.863446 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.863437    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ec03a0-8cee-46c2-9fec-820f466fb3f2" containerName="main"
Jul 07 16:15:58.863543 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.863447    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="75b55600-6fda-415b-bb65-11e2b6f70e17" containerName="main"
Jul 07 16:15:58.866486 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.866470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.868513 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.868491    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"openshift-service-ca.crt\""
Jul 07 16:15:58.869169 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.869144    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"default-dockercfg-bvkb9\""
Jul 07 16:15:58.869307 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.869196    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"auth-test-model-9ac19f-kserve-self-signed-certs\""
Jul 07 16:15:58.869307 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.869156    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"kube-root-ca.crt\""
Jul 07 16:15:58.882114 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.882094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"]
Jul 07 16:15:58.888183 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.888157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-tmp-dir\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.888316 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.888187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zztjz\" (UniqueName: \"kubernetes.io/projected/83d9d0c3-c703-4b00-b3f0-edab341579f7-kube-api-access-zztjz\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.888316 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.888217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-model-cache\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.888316 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.888296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-home\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.888580 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.888330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-dshm\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.888580 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.888355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83d9d0c3-c703-4b00-b3f0-edab341579f7-tls-certs\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989467 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-tmp-dir\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989657 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zztjz\" (UniqueName: \"kubernetes.io/projected/83d9d0c3-c703-4b00-b3f0-edab341579f7-kube-api-access-zztjz\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989657 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-model-cache\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989657 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-home\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989657 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-dshm\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989657 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83d9d0c3-c703-4b00-b3f0-edab341579f7-tls-certs\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989887 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989773    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-tmp-dir\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989887 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989824    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-model-cache\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.989955 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.989943    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-home\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.991888 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.991854    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-dshm\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.992115 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.992098    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83d9d0c3-c703-4b00-b3f0-edab341579f7-tls-certs\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:58.999699 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:58.999676    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zztjz\" (UniqueName: \"kubernetes.io/projected/83d9d0c3-c703-4b00-b3f0-edab341579f7-kube-api-access-zztjz\") pod \"auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") " pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:59.175550 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:59.175473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:15:59.306464 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:59.306441    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"]
Jul 07 16:15:59.308737 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:15:59.308711    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83d9d0c3_c703_4b00_b3f0_edab341579f7.slice/crio-be388ef8721c45847208a3ba258a7e901aa718f3f5f177d05cb86136a6a68df3 WatchSource:0}: Error finding container be388ef8721c45847208a3ba258a7e901aa718f3f5f177d05cb86136a6a68df3: Status 404 returned error can't find the container with id be388ef8721c45847208a3ba258a7e901aa718f3f5f177d05cb86136a6a68df3
Jul 07 16:15:59.418526 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:59.418498    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn" event={"ID":"83d9d0c3-c703-4b00-b3f0-edab341579f7","Type":"ContainerStarted","Data":"92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a"}
Jul 07 16:15:59.418661 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:59.418536    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn" event={"ID":"83d9d0c3-c703-4b00-b3f0-edab341579f7","Type":"ContainerStarted","Data":"be388ef8721c45847208a3ba258a7e901aa718f3f5f177d05cb86136a6a68df3"}
Jul 07 16:15:59.442669 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:15:59.442583    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn" podStartSLOduration=1.442566454 podStartE2EDuration="1.442566454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:59.440079937 +0000 UTC m=+2039.295656819" watchObservedRunningTime="2026-07-07 16:15:59.442566454 +0000 UTC m=+2039.298143328"
Jul 07 16:16:08.279296 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:08.279244    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:16:09.176361 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:09.176320    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:16:09.176535 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:09.176404    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:16:09.188757 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:09.188730    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:16:09.484929 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:09.484848    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:16:23.152525 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.152482    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"]
Jul 07 16:16:23.155852 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.155831    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.158616 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.158595    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"kube-root-ca.crt\""
Jul 07 16:16:23.158735 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.158595    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"auth-test-model-132358-kserve-self-signed-certs\""
Jul 07 16:16:23.158735 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.158637    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"openshift-service-ca.crt\""
Jul 07 16:16:23.158735 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.158664    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"default-dockercfg-d2rz4\""
Jul 07 16:16:23.177785 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.177763    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"]
Jul 07 16:16:23.273092 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.273025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tls-certs\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.273092 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.273063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-model-cache\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.273092 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.273091    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-dshm\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.273333 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.273135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tmp-dir\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.273333 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.273171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l4sb\" (UniqueName: \"kubernetes.io/projected/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-kube-api-access-8l4sb\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.273333 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.273193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-home\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.373803 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.373777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-dshm\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.373912 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.373813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tmp-dir\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.373912 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.373835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l4sb\" (UniqueName: \"kubernetes.io/projected/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-kube-api-access-8l4sb\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.373912 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.373855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-home\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.374012 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.373927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tls-certs\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.374012 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.373968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-model-cache\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.374322 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.374268    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tmp-dir\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.374322 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.374317    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-home\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.374467 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.374353    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-model-cache\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.376099 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.376081    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-dshm\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.376277 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.376260    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tls-certs\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.384166 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.384147    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l4sb\" (UniqueName: \"kubernetes.io/projected/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-kube-api-access-8l4sb\") pod \"auth-test-model-132358-kserve-7f74986f9f-fnkdl\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") " pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.464918 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.464856    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:23.600115 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:23.600095    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"]
Jul 07 16:16:23.601944 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:16:23.601914    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode371b732_ee8b_4db9_b9d6_2d4a8d6a4a31.slice/crio-595cca28d8676e48f2145288e0130a75110cc9b2e1e2d3af3573196e9b91ca13 WatchSource:0}: Error finding container 595cca28d8676e48f2145288e0130a75110cc9b2e1e2d3af3573196e9b91ca13: Status 404 returned error can't find the container with id 595cca28d8676e48f2145288e0130a75110cc9b2e1e2d3af3573196e9b91ca13
Jul 07 16:16:24.548175 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:24.548141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl" event={"ID":"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31","Type":"ContainerStarted","Data":"d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96"}
Jul 07 16:16:24.548648 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:24.548184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl" event={"ID":"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31","Type":"ContainerStarted","Data":"595cca28d8676e48f2145288e0130a75110cc9b2e1e2d3af3573196e9b91ca13"}
Jul 07 16:16:24.570722 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:24.570669    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl" podStartSLOduration=1.570651507 podStartE2EDuration="1.570651507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:16:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:16:24.569471364 +0000 UTC m=+2064.425048271" watchObservedRunningTime="2026-07-07 16:16:24.570651507 +0000 UTC m=+2064.426228386"
Jul 07 16:16:26.549336 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:26.549302    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:16:33.465675 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:33.465632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:33.466143 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:33.465687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:33.477955 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:33.477931    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:33.602030 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:33.602003    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:16:40.148820 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:40.148786    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:16:58.656401 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:16:58.656370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:17:11.658470 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:17:11.658434    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:17:28.653987 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:17:28.653955    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:17:42.572608 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:17:42.572574    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:18:00.451416 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:00.451332    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:18:17.742245 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:17.742209    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:18:21.467792 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:21.467763    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"]
Jul 07 16:18:22.368668 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:22.368636    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"]
Jul 07 16:18:28.754452 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.754420    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"]
Jul 07 16:18:28.757852 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.757833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:28.759949 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.759930    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"sub-test-model-9ac19f-kserve-self-signed-certs\""
Jul 07 16:18:28.769407 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.769386    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"]
Jul 07 16:18:28.919747 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.919710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-dshm\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:28.919912 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.919763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-model-cache\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:28.919912 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.919842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdk7z\" (UniqueName: \"kubernetes.io/projected/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-kube-api-access-wdk7z\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:28.920007 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.919909    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-home\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:28.920007 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.919933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tls-certs\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:28.920007 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:28.919961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tmp-dir\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.020642 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.020550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-model-cache\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.020642 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.020612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdk7z\" (UniqueName: \"kubernetes.io/projected/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-kube-api-access-wdk7z\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.020879 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.020658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-home\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.020879 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.020674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tls-certs\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.020879 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.020700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tmp-dir\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.020879 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.020733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-dshm\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.021094 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.021002    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-model-cache\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.021094 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.021081    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-home\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.021174 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.021097    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tmp-dir\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.023062 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.023041    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-dshm\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.023198 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.023180    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tls-certs\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.030991 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.030968    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdk7z\" (UniqueName: \"kubernetes.io/projected/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-kube-api-access-wdk7z\") pod \"sub-test-model-9ac19f-kserve-9b97498d9-w7frv\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") " pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.066936 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.066912    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:29.198869 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:29.198844    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"]
Jul 07 16:18:29.200184 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:18:29.200161    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd4e7e1e_c54d_49e6_9058_56c6da9a9a22.slice/crio-4168593fca98ae1a29097abab834f4f50a8f377b6c7289b8ec144c9745e67d51 WatchSource:0}: Error finding container 4168593fca98ae1a29097abab834f4f50a8f377b6c7289b8ec144c9745e67d51: Status 404 returned error can't find the container with id 4168593fca98ae1a29097abab834f4f50a8f377b6c7289b8ec144c9745e67d51
Jul 07 16:18:30.155080 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:30.155043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv" event={"ID":"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22","Type":"ContainerStarted","Data":"b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67"}
Jul 07 16:18:30.155080 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:30.155083    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv" event={"ID":"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22","Type":"ContainerStarted","Data":"4168593fca98ae1a29097abab834f4f50a8f377b6c7289b8ec144c9745e67d51"}
Jul 07 16:18:30.174974 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:30.174924    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv" podStartSLOduration=2.174909654 podStartE2EDuration="2.174909654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:30.172900236 +0000 UTC m=+2190.028477115" watchObservedRunningTime="2026-07-07 16:18:30.174909654 +0000 UTC m=+2190.030486540"
Jul 07 16:18:34.647572 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:34.647540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:18:36.487700 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.487661    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn" podUID="83d9d0c3-c703-4b00-b3f0-edab341579f7" containerName="main" containerID="cri-o://92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a" gracePeriod=45
Jul 07 16:18:36.733950 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.733926    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:18:36.881257 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881217    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-dshm\") pod \"83d9d0c3-c703-4b00-b3f0-edab341579f7\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") "
Jul 07 16:18:36.881257 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881258    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83d9d0c3-c703-4b00-b3f0-edab341579f7-tls-certs\") pod \"83d9d0c3-c703-4b00-b3f0-edab341579f7\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") "
Jul 07 16:18:36.881496 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881351    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-tmp-dir\") pod \"83d9d0c3-c703-4b00-b3f0-edab341579f7\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") "
Jul 07 16:18:36.881496 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881376    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-model-cache\") pod \"83d9d0c3-c703-4b00-b3f0-edab341579f7\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") "
Jul 07 16:18:36.881496 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zztjz\" (UniqueName: \"kubernetes.io/projected/83d9d0c3-c703-4b00-b3f0-edab341579f7-kube-api-access-zztjz\") pod \"83d9d0c3-c703-4b00-b3f0-edab341579f7\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") "
Jul 07 16:18:36.881496 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881480    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-home\") pod \"83d9d0c3-c703-4b00-b3f0-edab341579f7\" (UID: \"83d9d0c3-c703-4b00-b3f0-edab341579f7\") "
Jul 07 16:18:36.881743 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881568    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "83d9d0c3-c703-4b00-b3f0-edab341579f7" (UID: "83d9d0c3-c703-4b00-b3f0-edab341579f7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:18:36.881743 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881670    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-model-cache" (OuterVolumeSpecName: "model-cache") pod "83d9d0c3-c703-4b00-b3f0-edab341579f7" (UID: "83d9d0c3-c703-4b00-b3f0-edab341579f7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:18:36.881835 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881737    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-home" (OuterVolumeSpecName: "home") pod "83d9d0c3-c703-4b00-b3f0-edab341579f7" (UID: "83d9d0c3-c703-4b00-b3f0-edab341579f7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:18:36.881835 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.881745    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:36.883539 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.883516    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d9d0c3-c703-4b00-b3f0-edab341579f7-kube-api-access-zztjz" (OuterVolumeSpecName: "kube-api-access-zztjz") pod "83d9d0c3-c703-4b00-b3f0-edab341579f7" (UID: "83d9d0c3-c703-4b00-b3f0-edab341579f7"). InnerVolumeSpecName "kube-api-access-zztjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:18:36.883762 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.883746    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-dshm" (OuterVolumeSpecName: "dshm") pod "83d9d0c3-c703-4b00-b3f0-edab341579f7" (UID: "83d9d0c3-c703-4b00-b3f0-edab341579f7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:18:36.883823 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.883759    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83d9d0c3-c703-4b00-b3f0-edab341579f7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "83d9d0c3-c703-4b00-b3f0-edab341579f7" (UID: "83d9d0c3-c703-4b00-b3f0-edab341579f7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:18:36.982240 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.982215    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:36.982240 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.982237    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zztjz\" (UniqueName: \"kubernetes.io/projected/83d9d0c3-c703-4b00-b3f0-edab341579f7-kube-api-access-zztjz\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:36.982396 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.982246    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:36.982396 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.982255    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83d9d0c3-c703-4b00-b3f0-edab341579f7-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:36.982396 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:36.982263    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83d9d0c3-c703-4b00-b3f0-edab341579f7-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:37.192422 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.192337    2581 generic.go:356] "Generic (PLEG): container finished" podID="83d9d0c3-c703-4b00-b3f0-edab341579f7" containerID="92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a" exitCode=0
Jul 07 16:18:37.192422 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.192389    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"
Jul 07 16:18:37.192422 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.192412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn" event={"ID":"83d9d0c3-c703-4b00-b3f0-edab341579f7","Type":"ContainerDied","Data":"92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a"}
Jul 07 16:18:37.192686 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.192452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn" event={"ID":"83d9d0c3-c703-4b00-b3f0-edab341579f7","Type":"ContainerDied","Data":"be388ef8721c45847208a3ba258a7e901aa718f3f5f177d05cb86136a6a68df3"}
Jul 07 16:18:37.192686 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.192473    2581 scope.go:117] "RemoveContainer" containerID="92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a"
Jul 07 16:18:37.201260 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.201241    2581 scope.go:117] "RemoveContainer" containerID="92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a"
Jul 07 16:18:37.201538 ip-10-0-128-7 kubenswrapper[2581]: E0707 16:18:37.201519    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a\": container with ID starting with 92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a not found: ID does not exist" containerID="92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a"
Jul 07 16:18:37.201603 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.201545    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a"} err="failed to get container status \"92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a\": rpc error: code = NotFound desc = could not find container \"92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a\": container with ID starting with 92e8b1b9a0017276473f5110d7b29c8aa6b4f18cc6ddb4781ed8acfea6994e8a not found: ID does not exist"
Jul 07 16:18:37.216236 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.216215    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"]
Jul 07 16:18:37.224133 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.224115    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/auth-test-model-9ac19f-kserve-5b8b48d67f-7zrmn"]
Jul 07 16:18:37.388437 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.388398    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl" podUID="e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" containerName="main" containerID="cri-o://d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96" gracePeriod=45
Jul 07 16:18:37.627467 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.627442    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:18:37.789859 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.789790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-model-cache\") pod \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") "
Jul 07 16:18:37.789859 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.789821    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-home\") pod \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") "
Jul 07 16:18:37.790058 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.789875    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l4sb\" (UniqueName: \"kubernetes.io/projected/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-kube-api-access-8l4sb\") pod \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") "
Jul 07 16:18:37.790058 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.789898    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tmp-dir\") pod \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") "
Jul 07 16:18:37.790058 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.789916    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tls-certs\") pod \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") "
Jul 07 16:18:37.790058 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.789941    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-dshm\") pod \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\" (UID: \"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31\") "
Jul 07 16:18:37.790058 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.790034    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-model-cache" (OuterVolumeSpecName: "model-cache") pod "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" (UID: "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:18:37.790348 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.790164    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" (UID: "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:18:37.790348 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.790210    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-home" (OuterVolumeSpecName: "home") pod "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" (UID: "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:18:37.790348 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.790237    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:37.790348 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.790256    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:37.792140 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.792114    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-dshm" (OuterVolumeSpecName: "dshm") pod "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" (UID: "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:18:37.792244 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.792174    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-kube-api-access-8l4sb" (OuterVolumeSpecName: "kube-api-access-8l4sb") pod "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" (UID: "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31"). InnerVolumeSpecName "kube-api-access-8l4sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:18:37.792244 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.792186    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" (UID: "e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:18:37.890981 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.890957    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l4sb\" (UniqueName: \"kubernetes.io/projected/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-kube-api-access-8l4sb\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:37.890981 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.890981    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:37.891159 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.890991    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:37.891159 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:37.890998    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:18:38.199473 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.199444    2581 generic.go:356] "Generic (PLEG): container finished" podID="e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" containerID="d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96" exitCode=0
Jul 07 16:18:38.199627 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.199487    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"
Jul 07 16:18:38.199627 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.199488    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl" event={"ID":"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31","Type":"ContainerDied","Data":"d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96"}
Jul 07 16:18:38.199627 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.199613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl" event={"ID":"e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31","Type":"ContainerDied","Data":"595cca28d8676e48f2145288e0130a75110cc9b2e1e2d3af3573196e9b91ca13"}
Jul 07 16:18:38.199751 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.199636    2581 scope.go:117] "RemoveContainer" containerID="d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96"
Jul 07 16:18:38.211142 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.211127    2581 scope.go:117] "RemoveContainer" containerID="d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96"
Jul 07 16:18:38.211389 ip-10-0-128-7 kubenswrapper[2581]: E0707 16:18:38.211370    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96\": container with ID starting with d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96 not found: ID does not exist" containerID="d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96"
Jul 07 16:18:38.211467 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.211398    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96"} err="failed to get container status \"d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96\": rpc error: code = NotFound desc = could not find container \"d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96\": container with ID starting with d28dd7cf908b136e1d63f6cc62575611aafddb29e9ab0a71bdcb96b819e4cc96 not found: ID does not exist"
Jul 07 16:18:38.224813 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.224792    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"]
Jul 07 16:18:38.232197 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.232175    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-132358/auth-test-model-132358-kserve-7f74986f9f-fnkdl"]
Jul 07 16:18:38.647601 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.644819    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83d9d0c3-c703-4b00-b3f0-edab341579f7" path="/var/lib/kubelet/pods/83d9d0c3-c703-4b00-b3f0-edab341579f7/volumes"
Jul 07 16:18:38.647601 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:38.645414    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" path="/var/lib/kubelet/pods/e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31/volumes"
Jul 07 16:18:39.067096 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:39.067010    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:39.067096 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:39.067052    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:39.079356 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:39.079326    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:18:39.217668 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:18:39.217638    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:19:04.644562 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.644523    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"]
Jul 07 16:19:04.645101 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.644972    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" containerName="main"
Jul 07 16:19:04.645101 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.644992    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" containerName="main"
Jul 07 16:19:04.645101 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.645017    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d9d0c3-c703-4b00-b3f0-edab341579f7" containerName="main"
Jul 07 16:19:04.645101 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.645026    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d9d0c3-c703-4b00-b3f0-edab341579f7" containerName="main"
Jul 07 16:19:04.645330 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.645121    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="83d9d0c3-c703-4b00-b3f0-edab341579f7" containerName="main"
Jul 07 16:19:04.645330 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.645132    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e371b732-ee8b-4db9-b9d6-2d4a8d6a4a31" containerName="main"
Jul 07 16:19:04.649387 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.649368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.652069 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.652047    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"default-dockercfg-d2rz4\""
Jul 07 16:19:04.652181 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.652070    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"openshift-service-ca.crt\""
Jul 07 16:19:04.652181 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.652083    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"sub-test-model-132358-kserve-self-signed-certs\""
Jul 07 16:19:04.652181 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.652110    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"kube-root-ca.crt\""
Jul 07 16:19:04.660949 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.660929    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"]
Jul 07 16:19:04.693295 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.693243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-dshm\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.693394 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.693308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-tmp-dir\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.693394 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.693326    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff79c86-968d-424c-bd96-6a2308ff4fe2-tls-certs\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.693470 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.693409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-model-cache\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.693470 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.693436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6tp9\" (UniqueName: \"kubernetes.io/projected/eff79c86-968d-424c-bd96-6a2308ff4fe2-kube-api-access-v6tp9\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.693470 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.693459    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-home\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794221 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-model-cache\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794346 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6tp9\" (UniqueName: \"kubernetes.io/projected/eff79c86-968d-424c-bd96-6a2308ff4fe2-kube-api-access-v6tp9\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794346 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-home\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794426 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-dshm\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794468 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-tmp-dir\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794522 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff79c86-968d-424c-bd96-6a2308ff4fe2-tls-certs\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794577 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794551    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-home\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794643 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794622    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-model-cache\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.794805 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.794785    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-tmp-dir\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.796550 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.796517    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-dshm\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.796810 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.796791    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff79c86-968d-424c-bd96-6a2308ff4fe2-tls-certs\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.803243 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.803225    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6tp9\" (UniqueName: \"kubernetes.io/projected/eff79c86-968d-424c-bd96-6a2308ff4fe2-kube-api-access-v6tp9\") pod \"sub-test-model-132358-kserve-6cb8b754c5-x4gm5\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") " pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:04.958723 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:04.958658    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:05.088658 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:05.088633    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"]
Jul 07 16:19:05.090352 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:19:05.090324    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeff79c86_968d_424c_bd96_6a2308ff4fe2.slice/crio-b8f56e46cf59580ef91fc0ab7ae5f4f55fe10acf14baa05975f05cbfdea834b9 WatchSource:0}: Error finding container b8f56e46cf59580ef91fc0ab7ae5f4f55fe10acf14baa05975f05cbfdea834b9: Status 404 returned error can't find the container with id b8f56e46cf59580ef91fc0ab7ae5f4f55fe10acf14baa05975f05cbfdea834b9
Jul 07 16:19:05.334274 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:05.334247    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5" event={"ID":"eff79c86-968d-424c-bd96-6a2308ff4fe2","Type":"ContainerStarted","Data":"4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2"}
Jul 07 16:19:05.334448 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:05.334306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5" event={"ID":"eff79c86-968d-424c-bd96-6a2308ff4fe2","Type":"ContainerStarted","Data":"b8f56e46cf59580ef91fc0ab7ae5f4f55fe10acf14baa05975f05cbfdea834b9"}
Jul 07 16:19:05.356230 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:05.356186    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5" podStartSLOduration=1.356170251 podStartE2EDuration="1.356170251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:05.353969688 +0000 UTC m=+2225.209546567" watchObservedRunningTime="2026-07-07 16:19:05.356170251 +0000 UTC m=+2225.211747130"
Jul 07 16:19:08.737557 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:08.737525    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:19:14.959670 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:14.959635    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:14.960164 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:14.959687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:14.971842 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:14.971818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:15.392620 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:15.392593    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:28.241083 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:28.241009    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:19:41.863334 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:41.863271    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"]
Jul 07 16:19:42.835193 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:42.835165    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"]
Jul 07 16:19:46.644782 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:46.644752    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:19:56.882546 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:56.882476    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv" podUID="dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" containerName="main" containerID="cri-o://b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67" gracePeriod=45
Jul 07 16:19:57.126023 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.125997    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:19:57.305337 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305239    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-dshm\") pod \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") "
Jul 07 16:19:57.305337 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdk7z\" (UniqueName: \"kubernetes.io/projected/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-kube-api-access-wdk7z\") pod \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") "
Jul 07 16:19:57.305337 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305324    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tls-certs\") pod \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") "
Jul 07 16:19:57.305337 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305340    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tmp-dir\") pod \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") "
Jul 07 16:19:57.305641 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305360    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-model-cache\") pod \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") "
Jul 07 16:19:57.305641 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305385    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-home\") pod \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\" (UID: \"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22\") "
Jul 07 16:19:57.305641 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305614    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" (UID: "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:57.305641 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305637    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" (UID: "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:57.305831 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.305743    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-home" (OuterVolumeSpecName: "home") pod "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" (UID: "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:57.307480 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.307450    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-kube-api-access-wdk7z" (OuterVolumeSpecName: "kube-api-access-wdk7z") pod "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" (UID: "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22"). InnerVolumeSpecName "kube-api-access-wdk7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:19:57.307480 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.307464    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" (UID: "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:19:57.307618 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.307511    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-dshm" (OuterVolumeSpecName: "dshm") pod "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" (UID: "dd4e7e1e-c54d-49e6-9058-56c6da9a9a22"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:57.406039 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.406012    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:57.406039 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.406036    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdk7z\" (UniqueName: \"kubernetes.io/projected/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-kube-api-access-wdk7z\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:57.406190 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.406048    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:57.406190 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.406057    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:57.406190 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.406064    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:57.406190 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.406073    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:57.587902 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.587872    2581 generic.go:356] "Generic (PLEG): container finished" podID="dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" containerID="b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67" exitCode=0
Jul 07 16:19:57.588069 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.587920    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"
Jul 07 16:19:57.588069 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.587919    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv" event={"ID":"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22","Type":"ContainerDied","Data":"b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67"}
Jul 07 16:19:57.588069 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.588041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv" event={"ID":"dd4e7e1e-c54d-49e6-9058-56c6da9a9a22","Type":"ContainerDied","Data":"4168593fca98ae1a29097abab834f4f50a8f377b6c7289b8ec144c9745e67d51"}
Jul 07 16:19:57.588069 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.588065    2581 scope.go:117] "RemoveContainer" containerID="b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67"
Jul 07 16:19:57.596973 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.596954    2581 scope.go:117] "RemoveContainer" containerID="b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67"
Jul 07 16:19:57.597217 ip-10-0-128-7 kubenswrapper[2581]: E0707 16:19:57.597196    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67\": container with ID starting with b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67 not found: ID does not exist" containerID="b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67"
Jul 07 16:19:57.597316 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.597228    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67"} err="failed to get container status \"b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67\": rpc error: code = NotFound desc = could not find container \"b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67\": container with ID starting with b69c0d50ca8fbce4b4baa37c34a8f179a5cb0a21be9a244a617b52c92fb19e67 not found: ID does not exist"
Jul 07 16:19:57.611481 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.611457    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"]
Jul 07 16:19:57.616220 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.616200    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/sub-test-model-9ac19f-kserve-9b97498d9-w7frv"]
Jul 07 16:19:57.854943 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:57.854867    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5" podUID="eff79c86-968d-424c-bd96-6a2308ff4fe2" containerName="main" containerID="cri-o://4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2" gracePeriod=45
Jul 07 16:19:58.092061 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.092040    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:58.212221 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff79c86-968d-424c-bd96-6a2308ff4fe2-tls-certs\") pod \"eff79c86-968d-424c-bd96-6a2308ff4fe2\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") "
Jul 07 16:19:58.212221 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-home\") pod \"eff79c86-968d-424c-bd96-6a2308ff4fe2\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") "
Jul 07 16:19:58.212221 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212207    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6tp9\" (UniqueName: \"kubernetes.io/projected/eff79c86-968d-424c-bd96-6a2308ff4fe2-kube-api-access-v6tp9\") pod \"eff79c86-968d-424c-bd96-6a2308ff4fe2\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") "
Jul 07 16:19:58.212481 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-tmp-dir\") pod \"eff79c86-968d-424c-bd96-6a2308ff4fe2\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") "
Jul 07 16:19:58.212481 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212299    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-dshm\") pod \"eff79c86-968d-424c-bd96-6a2308ff4fe2\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") "
Jul 07 16:19:58.212481 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-model-cache\") pod \"eff79c86-968d-424c-bd96-6a2308ff4fe2\" (UID: \"eff79c86-968d-424c-bd96-6a2308ff4fe2\") "
Jul 07 16:19:58.212650 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212447    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-home" (OuterVolumeSpecName: "home") pod "eff79c86-968d-424c-bd96-6a2308ff4fe2" (UID: "eff79c86-968d-424c-bd96-6a2308ff4fe2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:58.212650 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212484    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eff79c86-968d-424c-bd96-6a2308ff4fe2" (UID: "eff79c86-968d-424c-bd96-6a2308ff4fe2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:58.212650 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212583    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:58.212650 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212603    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:58.212807 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.212644    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-model-cache" (OuterVolumeSpecName: "model-cache") pod "eff79c86-968d-424c-bd96-6a2308ff4fe2" (UID: "eff79c86-968d-424c-bd96-6a2308ff4fe2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:58.214250 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.214220    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eff79c86-968d-424c-bd96-6a2308ff4fe2-kube-api-access-v6tp9" (OuterVolumeSpecName: "kube-api-access-v6tp9") pod "eff79c86-968d-424c-bd96-6a2308ff4fe2" (UID: "eff79c86-968d-424c-bd96-6a2308ff4fe2"). InnerVolumeSpecName "kube-api-access-v6tp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:19:58.214250 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.214234    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-dshm" (OuterVolumeSpecName: "dshm") pod "eff79c86-968d-424c-bd96-6a2308ff4fe2" (UID: "eff79c86-968d-424c-bd96-6a2308ff4fe2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:19:58.214250 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.214222    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eff79c86-968d-424c-bd96-6a2308ff4fe2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eff79c86-968d-424c-bd96-6a2308ff4fe2" (UID: "eff79c86-968d-424c-bd96-6a2308ff4fe2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:19:58.313793 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.313770    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:58.313793 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.313791    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eff79c86-968d-424c-bd96-6a2308ff4fe2-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:58.313926 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.313799    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6tp9\" (UniqueName: \"kubernetes.io/projected/eff79c86-968d-424c-bd96-6a2308ff4fe2-kube-api-access-v6tp9\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:58.313926 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.313808    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eff79c86-968d-424c-bd96-6a2308ff4fe2-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:19:58.594122 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.594092    2581 generic.go:356] "Generic (PLEG): container finished" podID="eff79c86-968d-424c-bd96-6a2308ff4fe2" containerID="4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2" exitCode=0
Jul 07 16:19:58.594277 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.594132    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"
Jul 07 16:19:58.594277 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.594182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5" event={"ID":"eff79c86-968d-424c-bd96-6a2308ff4fe2","Type":"ContainerDied","Data":"4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2"}
Jul 07 16:19:58.594277 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.594225    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5" event={"ID":"eff79c86-968d-424c-bd96-6a2308ff4fe2","Type":"ContainerDied","Data":"b8f56e46cf59580ef91fc0ab7ae5f4f55fe10acf14baa05975f05cbfdea834b9"}
Jul 07 16:19:58.594277 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.594250    2581 scope.go:117] "RemoveContainer" containerID="4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2"
Jul 07 16:19:58.603328 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.603312    2581 scope.go:117] "RemoveContainer" containerID="4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2"
Jul 07 16:19:58.603563 ip-10-0-128-7 kubenswrapper[2581]: E0707 16:19:58.603548    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2\": container with ID starting with 4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2 not found: ID does not exist" containerID="4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2"
Jul 07 16:19:58.603622 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.603570    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2"} err="failed to get container status \"4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2\": rpc error: code = NotFound desc = could not find container \"4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2\": container with ID starting with 4ce84727344bd7db200bb3f027eaf7d1879505d3b6a17764cf49ea1f44e978a2 not found: ID does not exist"
Jul 07 16:19:58.616213 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.616190    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"]
Jul 07 16:19:58.621162 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.621143    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-132358/sub-test-model-132358-kserve-6cb8b754c5-x4gm5"]
Jul 07 16:19:58.643188 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.643166    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" path="/var/lib/kubelet/pods/dd4e7e1e-c54d-49e6-9058-56c6da9a9a22/volumes"
Jul 07 16:19:58.643543 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:19:58.643530    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eff79c86-968d-424c-bd96-6a2308ff4fe2" path="/var/lib/kubelet/pods/eff79c86-968d-424c-bd96-6a2308ff4fe2/volumes"
Jul 07 16:20:09.151398 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.151369    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"]
Jul 07 16:20:09.151758 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.151680    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eff79c86-968d-424c-bd96-6a2308ff4fe2" containerName="main"
Jul 07 16:20:09.151758 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.151690    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="eff79c86-968d-424c-bd96-6a2308ff4fe2" containerName="main"
Jul 07 16:20:09.151758 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.151700    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" containerName="main"
Jul 07 16:20:09.151758 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.151705    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" containerName="main"
Jul 07 16:20:09.151758 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.151755    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd4e7e1e-c54d-49e6-9058-56c6da9a9a22" containerName="main"
Jul 07 16:20:09.152010 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.151764    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="eff79c86-968d-424c-bd96-6a2308ff4fe2" containerName="main"
Jul 07 16:20:09.154589 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.154563    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.156788 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.156749    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"openshift-service-ca.crt\""
Jul 07 16:20:09.156894 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.156837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"default-dockercfg-bvkb9\""
Jul 07 16:20:09.157670 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.157653    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"rate-test-model-9ac19f-kserve-self-signed-certs\""
Jul 07 16:20:09.157723 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.157665    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9ac19f\"/\"kube-root-ca.crt\""
Jul 07 16:20:09.164189 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.164169    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"]
Jul 07 16:20:09.190529 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.190507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-tmp-dir\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.190629 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.190542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee579274-09b9-407a-862c-5ed958e32caf-tls-certs\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.190629 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.190558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-home\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.190629 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.190572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-dshm\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.190729 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.190644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5lzd\" (UniqueName: \"kubernetes.io/projected/ee579274-09b9-407a-862c-5ed958e32caf-kube-api-access-t5lzd\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.190729 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.190672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-model-cache\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291222 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-model-cache\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291387 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-tmp-dir\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291387 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee579274-09b9-407a-862c-5ed958e32caf-tls-certs\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291387 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-home\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291518 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-dshm\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291518 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5lzd\" (UniqueName: \"kubernetes.io/projected/ee579274-09b9-407a-862c-5ed958e32caf-kube-api-access-t5lzd\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291642 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291620    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-model-cache\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291705 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-tmp-dir\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.291762 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.291737    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-home\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.293500 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.293478    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-dshm\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.293771 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.293754    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee579274-09b9-407a-862c-5ed958e32caf-tls-certs\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.303954 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.303934    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5lzd\" (UniqueName: \"kubernetes.io/projected/ee579274-09b9-407a-862c-5ed958e32caf-kube-api-access-t5lzd\") pod \"rate-test-model-9ac19f-kserve-5ff54cc88c-f425m\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") " pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.464513 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.464458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:09.594495 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.594469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"]
Jul 07 16:20:09.596791 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:20:09.596762    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee579274_09b9_407a_862c_5ed958e32caf.slice/crio-68b88e3a4b57c25176a75b480f6756412f9e0f21651a1df05a78ea70b3552a54 WatchSource:0}: Error finding container 68b88e3a4b57c25176a75b480f6756412f9e0f21651a1df05a78ea70b3552a54: Status 404 returned error can't find the container with id 68b88e3a4b57c25176a75b480f6756412f9e0f21651a1df05a78ea70b3552a54
Jul 07 16:20:09.651853 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.651830    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m" event={"ID":"ee579274-09b9-407a-862c-5ed958e32caf","Type":"ContainerStarted","Data":"ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302"}
Jul 07 16:20:09.651957 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.651867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m" event={"ID":"ee579274-09b9-407a-862c-5ed958e32caf","Type":"ContainerStarted","Data":"68b88e3a4b57c25176a75b480f6756412f9e0f21651a1df05a78ea70b3552a54"}
Jul 07 16:20:09.672852 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:09.672802    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m" podStartSLOduration=0.672782726 podStartE2EDuration="672.782726ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:20:09.670934633 +0000 UTC m=+2289.526511514" watchObservedRunningTime="2026-07-07 16:20:09.672782726 +0000 UTC m=+2289.528359605"
Jul 07 16:20:12.645499 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:12.645464    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:20:19.465543 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:19.465506    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:19.465977 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:19.465558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:19.477851 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:19.477827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:19.710950 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:19.710922    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:20:27.052605 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.052570    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"]
Jul 07 16:20:27.056123 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.056103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.058846 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.058822    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"default-dockercfg-d2rz4\""
Jul 07 16:20:27.058975 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.058850    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"openshift-service-ca.crt\""
Jul 07 16:20:27.058975 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.058854    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"kube-root-ca.crt\""
Jul 07 16:20:27.058975 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.058893    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-132358\"/\"rate-test-model-132358-kserve-self-signed-certs\""
Jul 07 16:20:27.069439 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.069416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"]
Jul 07 16:20:27.114619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.114592    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j67zb\" (UniqueName: \"kubernetes.io/projected/168307ab-ea9b-4225-bc71-0c0568f8531d-kube-api-access-j67zb\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.114773 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.114629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/168307ab-ea9b-4225-bc71-0c0568f8531d-tls-certs\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.114773 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.114652    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-dshm\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.114773 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.114679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-tmp-dir\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.114773 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.114711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-model-cache\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.114773 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.114741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-home\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.215613 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.215574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-model-cache\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.215785 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.215630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-home\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.215785 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.215674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j67zb\" (UniqueName: \"kubernetes.io/projected/168307ab-ea9b-4225-bc71-0c0568f8531d-kube-api-access-j67zb\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.215785 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.215700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/168307ab-ea9b-4225-bc71-0c0568f8531d-tls-certs\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.215785 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.215728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-dshm\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.215785 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.215757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-tmp-dir\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.216007 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.215985    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-model-cache\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.216067 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.216051    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-home\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.216124 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.216080    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-tmp-dir\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.218109 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.218076    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-dshm\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.218253 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.218240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/168307ab-ea9b-4225-bc71-0c0568f8531d-tls-certs\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.225628 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.225602    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j67zb\" (UniqueName: \"kubernetes.io/projected/168307ab-ea9b-4225-bc71-0c0568f8531d-kube-api-access-j67zb\") pod \"rate-test-model-132358-kserve-6d9577fbb7-7hff5\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") " pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.365051 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.365028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:27.495767 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.495733    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"]
Jul 07 16:20:27.497316 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:20:27.497271    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod168307ab_ea9b_4225_bc71_0c0568f8531d.slice/crio-7774acf6dec7ce21be009fb4758565c0c9a45392117e0ee118d8f1dccf2b1148 WatchSource:0}: Error finding container 7774acf6dec7ce21be009fb4758565c0c9a45392117e0ee118d8f1dccf2b1148: Status 404 returned error can't find the container with id 7774acf6dec7ce21be009fb4758565c0c9a45392117e0ee118d8f1dccf2b1148
Jul 07 16:20:27.736460 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.736380    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5" event={"ID":"168307ab-ea9b-4225-bc71-0c0568f8531d","Type":"ContainerStarted","Data":"bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f"}
Jul 07 16:20:27.736460 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.736418    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5" event={"ID":"168307ab-ea9b-4225-bc71-0c0568f8531d","Type":"ContainerStarted","Data":"7774acf6dec7ce21be009fb4758565c0c9a45392117e0ee118d8f1dccf2b1148"}
Jul 07 16:20:27.755403 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:27.755362    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5" podStartSLOduration=0.75534974 podStartE2EDuration="755.34974ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:20:27.753912313 +0000 UTC m=+2307.609489192" watchObservedRunningTime="2026-07-07 16:20:27.75534974 +0000 UTC m=+2307.610926619"
Jul 07 16:20:31.255680 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:31.255643    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:20:37.365486 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:37.365449    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:37.365864 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:37.365508    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:37.377930 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:37.377905    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:37.797319 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:37.797233    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:20:45.044017 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:20:45.043972    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:21:05.940829 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:05.940753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:21:10.263728 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:10.263692    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"]
Jul 07 16:21:11.158456 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:11.158419    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"]
Jul 07 16:21:17.337215 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:17.337182    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:21:25.283361 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.283323    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m" podUID="ee579274-09b9-407a-862c-5ed958e32caf" containerName="main" containerID="cri-o://ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302" gracePeriod=45
Jul 07 16:21:25.531214 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.531192    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:21:25.662219 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-tmp-dir\") pod \"ee579274-09b9-407a-862c-5ed958e32caf\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") "
Jul 07 16:21:25.662374 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662224    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-home\") pod \"ee579274-09b9-407a-862c-5ed958e32caf\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") "
Jul 07 16:21:25.662374 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662267    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee579274-09b9-407a-862c-5ed958e32caf-tls-certs\") pod \"ee579274-09b9-407a-862c-5ed958e32caf\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") "
Jul 07 16:21:25.662374 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-dshm\") pod \"ee579274-09b9-407a-862c-5ed958e32caf\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") "
Jul 07 16:21:25.662498 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662376    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5lzd\" (UniqueName: \"kubernetes.io/projected/ee579274-09b9-407a-862c-5ed958e32caf-kube-api-access-t5lzd\") pod \"ee579274-09b9-407a-862c-5ed958e32caf\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") "
Jul 07 16:21:25.662498 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662426    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-model-cache\") pod \"ee579274-09b9-407a-862c-5ed958e32caf\" (UID: \"ee579274-09b9-407a-862c-5ed958e32caf\") "
Jul 07 16:21:25.662498 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662462    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-home" (OuterVolumeSpecName: "home") pod "ee579274-09b9-407a-862c-5ed958e32caf" (UID: "ee579274-09b9-407a-862c-5ed958e32caf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:25.662498 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662488    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee579274-09b9-407a-862c-5ed958e32caf" (UID: "ee579274-09b9-407a-862c-5ed958e32caf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:25.662665 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662626    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:25.662704 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662672    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:25.662745 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.662708    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee579274-09b9-407a-862c-5ed958e32caf" (UID: "ee579274-09b9-407a-862c-5ed958e32caf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:25.664480 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.664455    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee579274-09b9-407a-862c-5ed958e32caf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee579274-09b9-407a-862c-5ed958e32caf" (UID: "ee579274-09b9-407a-862c-5ed958e32caf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:25.664480 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.664460    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee579274-09b9-407a-862c-5ed958e32caf-kube-api-access-t5lzd" (OuterVolumeSpecName: "kube-api-access-t5lzd") pod "ee579274-09b9-407a-862c-5ed958e32caf" (UID: "ee579274-09b9-407a-862c-5ed958e32caf"). InnerVolumeSpecName "kube-api-access-t5lzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:21:25.664480 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.664464    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-dshm" (OuterVolumeSpecName: "dshm") pod "ee579274-09b9-407a-862c-5ed958e32caf" (UID: "ee579274-09b9-407a-862c-5ed958e32caf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:25.763766 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.763724    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:25.763766 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.763762    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee579274-09b9-407a-862c-5ed958e32caf-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:25.764005 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.763776    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee579274-09b9-407a-862c-5ed958e32caf-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:25.764005 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:25.763789    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5lzd\" (UniqueName: \"kubernetes.io/projected/ee579274-09b9-407a-862c-5ed958e32caf-kube-api-access-t5lzd\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:26.024232 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.024140    2581 generic.go:356] "Generic (PLEG): container finished" podID="ee579274-09b9-407a-862c-5ed958e32caf" containerID="ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302" exitCode=0
Jul 07 16:21:26.024232 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.024182    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"
Jul 07 16:21:26.024437 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.024233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m" event={"ID":"ee579274-09b9-407a-862c-5ed958e32caf","Type":"ContainerDied","Data":"ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302"}
Jul 07 16:21:26.024437 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.024305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m" event={"ID":"ee579274-09b9-407a-862c-5ed958e32caf","Type":"ContainerDied","Data":"68b88e3a4b57c25176a75b480f6756412f9e0f21651a1df05a78ea70b3552a54"}
Jul 07 16:21:26.024437 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.024330    2581 scope.go:117] "RemoveContainer" containerID="ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302"
Jul 07 16:21:26.033470 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.033453    2581 scope.go:117] "RemoveContainer" containerID="ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302"
Jul 07 16:21:26.033699 ip-10-0-128-7 kubenswrapper[2581]: E0707 16:21:26.033682    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302\": container with ID starting with ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302 not found: ID does not exist" containerID="ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302"
Jul 07 16:21:26.033737 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.033707    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302"} err="failed to get container status \"ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302\": rpc error: code = NotFound desc = could not find container \"ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302\": container with ID starting with ac0f7bcad030b914572e06586a23c9e780abbfab94ab3da183744d637272d302 not found: ID does not exist"
Jul 07 16:21:26.048469 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.048448    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"]
Jul 07 16:21:26.056777 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.056758    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9ac19f/rate-test-model-9ac19f-kserve-5ff54cc88c-f425m"]
Jul 07 16:21:26.177753 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.177723    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5" podUID="168307ab-ea9b-4225-bc71-0c0568f8531d" containerName="main" containerID="cri-o://bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f" gracePeriod=45
Jul 07 16:21:26.417961 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.417937    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:21:26.569440 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569370    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-dshm\") pod \"168307ab-ea9b-4225-bc71-0c0568f8531d\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") "
Jul 07 16:21:26.569440 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569430    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/168307ab-ea9b-4225-bc71-0c0568f8531d-tls-certs\") pod \"168307ab-ea9b-4225-bc71-0c0568f8531d\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") "
Jul 07 16:21:26.569629 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569456    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-home\") pod \"168307ab-ea9b-4225-bc71-0c0568f8531d\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") "
Jul 07 16:21:26.569629 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569497    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-tmp-dir\") pod \"168307ab-ea9b-4225-bc71-0c0568f8531d\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") "
Jul 07 16:21:26.569629 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569565    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-model-cache\") pod \"168307ab-ea9b-4225-bc71-0c0568f8531d\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") "
Jul 07 16:21:26.569629 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569596    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j67zb\" (UniqueName: \"kubernetes.io/projected/168307ab-ea9b-4225-bc71-0c0568f8531d-kube-api-access-j67zb\") pod \"168307ab-ea9b-4225-bc71-0c0568f8531d\" (UID: \"168307ab-ea9b-4225-bc71-0c0568f8531d\") "
Jul 07 16:21:26.569816 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569746    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-home" (OuterVolumeSpecName: "home") pod "168307ab-ea9b-4225-bc71-0c0568f8531d" (UID: "168307ab-ea9b-4225-bc71-0c0568f8531d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:26.569816 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569779    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "168307ab-ea9b-4225-bc71-0c0568f8531d" (UID: "168307ab-ea9b-4225-bc71-0c0568f8531d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:26.569928 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569828    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-model-cache" (OuterVolumeSpecName: "model-cache") pod "168307ab-ea9b-4225-bc71-0c0568f8531d" (UID: "168307ab-ea9b-4225-bc71-0c0568f8531d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:26.569928 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569876    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-home\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:26.569928 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.569888    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-tmp-dir\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:26.571468 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.571436    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-dshm" (OuterVolumeSpecName: "dshm") pod "168307ab-ea9b-4225-bc71-0c0568f8531d" (UID: "168307ab-ea9b-4225-bc71-0c0568f8531d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:21:26.571596 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.571579    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/168307ab-ea9b-4225-bc71-0c0568f8531d-kube-api-access-j67zb" (OuterVolumeSpecName: "kube-api-access-j67zb") pod "168307ab-ea9b-4225-bc71-0c0568f8531d" (UID: "168307ab-ea9b-4225-bc71-0c0568f8531d"). InnerVolumeSpecName "kube-api-access-j67zb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:21:26.571639 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.571576    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/168307ab-ea9b-4225-bc71-0c0568f8531d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "168307ab-ea9b-4225-bc71-0c0568f8531d" (UID: "168307ab-ea9b-4225-bc71-0c0568f8531d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:21:26.643817 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.643789    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee579274-09b9-407a-862c-5ed958e32caf" path="/var/lib/kubelet/pods/ee579274-09b9-407a-862c-5ed958e32caf/volumes"
Jul 07 16:21:26.670330 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.670308    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-dshm\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:26.670330 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.670326    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/168307ab-ea9b-4225-bc71-0c0568f8531d-tls-certs\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:26.670448 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.670335    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/168307ab-ea9b-4225-bc71-0c0568f8531d-model-cache\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:26.670448 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:26.670344    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j67zb\" (UniqueName: \"kubernetes.io/projected/168307ab-ea9b-4225-bc71-0c0568f8531d-kube-api-access-j67zb\") on node \"ip-10-0-128-7.ec2.internal\" DevicePath \"\""
Jul 07 16:21:27.032113 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.032078    2581 generic.go:356] "Generic (PLEG): container finished" podID="168307ab-ea9b-4225-bc71-0c0568f8531d" containerID="bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f" exitCode=0
Jul 07 16:21:27.032113 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.032113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5" event={"ID":"168307ab-ea9b-4225-bc71-0c0568f8531d","Type":"ContainerDied","Data":"bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f"}
Jul 07 16:21:27.032378 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.032120    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"
Jul 07 16:21:27.032378 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.032138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5" event={"ID":"168307ab-ea9b-4225-bc71-0c0568f8531d","Type":"ContainerDied","Data":"7774acf6dec7ce21be009fb4758565c0c9a45392117e0ee118d8f1dccf2b1148"}
Jul 07 16:21:27.032378 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.032153    2581 scope.go:117] "RemoveContainer" containerID="bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f"
Jul 07 16:21:27.042837 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.042813    2581 scope.go:117] "RemoveContainer" containerID="bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f"
Jul 07 16:21:27.043077 ip-10-0-128-7 kubenswrapper[2581]: E0707 16:21:27.043060    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f\": container with ID starting with bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f not found: ID does not exist" containerID="bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f"
Jul 07 16:21:27.043128 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.043084    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f"} err="failed to get container status \"bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f\": rpc error: code = NotFound desc = could not find container \"bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f\": container with ID starting with bd2cd4a6a68213f6be28f06b8dc08e05adce59e97d0208141475aa2a94eeeb6f not found: ID does not exist"
Jul 07 16:21:27.051857 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.051836    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"]
Jul 07 16:21:27.056886 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:27.056867    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-132358/rate-test-model-132358-kserve-6d9577fbb7-7hff5"]
Jul 07 16:21:28.643994 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:21:28.643962    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="168307ab-ea9b-4225-bc71-0c0568f8531d" path="/var/lib/kubelet/pods/168307ab-ea9b-4225-bc71-0c0568f8531d/volumes"
Jul 07 16:22:00.948370 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:00.948337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-chlqz"]
Jul 07 16:22:11.316293 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:11.316253    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-865bb77d7b-vqwbm_561d3fb1-f8fd-4137-af28-f031bbc9837e/copy-manifests/0.log"
Jul 07 16:22:11.326108 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:11.326078    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-865bb77d7b-vqwbm_561d3fb1-f8fd-4137-af28-f031bbc9837e/manager/0.log"
Jul 07 16:22:12.261222 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.261194    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g_f27e3c08-8b58-47b2-993a-c5356a60c778/util/0.log"
Jul 07 16:22:12.278081 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.278056    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g_f27e3c08-8b58-47b2-993a-c5356a60c778/pull/0.log"
Jul 07 16:22:12.290172 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.290151    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g_f27e3c08-8b58-47b2-993a-c5356a60c778/extract/0.log"
Jul 07 16:22:12.411752 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.411729    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx_f523fe42-db47-4ca9-8cc3-5590854c4ca1/util/0.log"
Jul 07 16:22:12.420492 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.420473    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx_f523fe42-db47-4ca9-8cc3-5590854c4ca1/pull/0.log"
Jul 07 16:22:12.428931 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.428907    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx_f523fe42-db47-4ca9-8cc3-5590854c4ca1/extract/0.log"
Jul 07 16:22:12.551634 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.551583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw_a008af73-7dd3-4619-aeea-013f2774a619/util/0.log"
Jul 07 16:22:12.561252 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.561224    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw_a008af73-7dd3-4619-aeea-013f2774a619/pull/0.log"
Jul 07 16:22:12.570950 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.570928    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw_a008af73-7dd3-4619-aeea-013f2774a619/extract/0.log"
Jul 07 16:22:12.701031 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.701005    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx_9c59268c-d5bc-4b54-be06-d6c7ca24d7b7/util/0.log"
Jul 07 16:22:12.713412 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.713391    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx_9c59268c-d5bc-4b54-be06-d6c7ca24d7b7/pull/0.log"
Jul 07 16:22:12.723880 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:12.723865    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx_9c59268c-d5bc-4b54-be06-d6c7ca24d7b7/extract/0.log"
Jul 07 16:22:13.601482 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:13.601452    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-chlqz_00b85f02-0d38-4946-ba69-f2a46fcd9f2f/limitador/0.log"
Jul 07 16:22:13.726711 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:13.726679    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6drmg_d046ee91-9252-43b5-9915-7c217d0cf1f1/manager/0.log"
Jul 07 16:22:14.467045 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:14.467009    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f99849b54-wndbc_d39ef33a-149a-4c5e-a91e-4b5730474d46/kube-auth-proxy/0.log"
Jul 07 16:22:20.514014 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.513981    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gdvqz/must-gather-9nnc5"]
Jul 07 16:22:20.514388 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.514296    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168307ab-ea9b-4225-bc71-0c0568f8531d" containerName="main"
Jul 07 16:22:20.514388 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.514319    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="168307ab-ea9b-4225-bc71-0c0568f8531d" containerName="main"
Jul 07 16:22:20.514388 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.514331    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee579274-09b9-407a-862c-5ed958e32caf" containerName="main"
Jul 07 16:22:20.514388 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.514336    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee579274-09b9-407a-862c-5ed958e32caf" containerName="main"
Jul 07 16:22:20.514388 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.514391    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee579274-09b9-407a-862c-5ed958e32caf" containerName="main"
Jul 07 16:22:20.514388 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.514399    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="168307ab-ea9b-4225-bc71-0c0568f8531d" containerName="main"
Jul 07 16:22:20.517412 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.517391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdvqz/must-gather-9nnc5"
Jul 07 16:22:20.521158 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.521135    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdvqz\"/\"openshift-service-ca.crt\""
Jul 07 16:22:20.521431 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.521415    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gdvqz\"/\"default-dockercfg-xkzkm\""
Jul 07 16:22:20.521784 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.521767    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gdvqz\"/\"kube-root-ca.crt\""
Jul 07 16:22:20.530304 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.530261    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdvqz/must-gather-9nnc5"]
Jul 07 16:22:20.564564 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.564529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a28dd036-858d-4df3-9790-ff55adb6c87d-must-gather-output\") pod \"must-gather-9nnc5\" (UID: \"a28dd036-858d-4df3-9790-ff55adb6c87d\") " pod="openshift-must-gather-gdvqz/must-gather-9nnc5"
Jul 07 16:22:20.564677 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.564644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d6hc\" (UniqueName: \"kubernetes.io/projected/a28dd036-858d-4df3-9790-ff55adb6c87d-kube-api-access-6d6hc\") pod \"must-gather-9nnc5\" (UID: \"a28dd036-858d-4df3-9790-ff55adb6c87d\") " pod="openshift-must-gather-gdvqz/must-gather-9nnc5"
Jul 07 16:22:20.665136 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.665106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d6hc\" (UniqueName: \"kubernetes.io/projected/a28dd036-858d-4df3-9790-ff55adb6c87d-kube-api-access-6d6hc\") pod \"must-gather-9nnc5\" (UID: \"a28dd036-858d-4df3-9790-ff55adb6c87d\") " pod="openshift-must-gather-gdvqz/must-gather-9nnc5"
Jul 07 16:22:20.665236 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.665151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a28dd036-858d-4df3-9790-ff55adb6c87d-must-gather-output\") pod \"must-gather-9nnc5\" (UID: \"a28dd036-858d-4df3-9790-ff55adb6c87d\") " pod="openshift-must-gather-gdvqz/must-gather-9nnc5"
Jul 07 16:22:20.665457 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.665440    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a28dd036-858d-4df3-9790-ff55adb6c87d-must-gather-output\") pod \"must-gather-9nnc5\" (UID: \"a28dd036-858d-4df3-9790-ff55adb6c87d\") " pod="openshift-must-gather-gdvqz/must-gather-9nnc5"
Jul 07 16:22:20.676528 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.676501    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d6hc\" (UniqueName: \"kubernetes.io/projected/a28dd036-858d-4df3-9790-ff55adb6c87d-kube-api-access-6d6hc\") pod \"must-gather-9nnc5\" (UID: \"a28dd036-858d-4df3-9790-ff55adb6c87d\") " pod="openshift-must-gather-gdvqz/must-gather-9nnc5"
Jul 07 16:22:20.826435 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.826405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdvqz/must-gather-9nnc5"
Jul 07 16:22:20.960468 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.960439    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdvqz/must-gather-9nnc5"]
Jul 07 16:22:20.962884 ip-10-0-128-7 kubenswrapper[2581]: W0707 16:22:20.962857    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda28dd036_858d_4df3_9790_ff55adb6c87d.slice/crio-f4ebe4d05f9b1f9f4fbb0be8a168020de8f790392ffd0a1def171c052ed85c1a WatchSource:0}: Error finding container f4ebe4d05f9b1f9f4fbb0be8a168020de8f790392ffd0a1def171c052ed85c1a: Status 404 returned error can't find the container with id f4ebe4d05f9b1f9f4fbb0be8a168020de8f790392ffd0a1def171c052ed85c1a
Jul 07 16:22:20.964602 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:20.964581    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:22:21.295268 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:21.295190    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdvqz/must-gather-9nnc5" event={"ID":"a28dd036-858d-4df3-9790-ff55adb6c87d","Type":"ContainerStarted","Data":"f4ebe4d05f9b1f9f4fbb0be8a168020de8f790392ffd0a1def171c052ed85c1a"}
Jul 07 16:22:22.305043 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:22.305004    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdvqz/must-gather-9nnc5" event={"ID":"a28dd036-858d-4df3-9790-ff55adb6c87d","Type":"ContainerStarted","Data":"cc0bf5f1f8c0c4fad9a1bbf70dc67b8c690efa17c7d9d43426c3c94f2f219a9f"}
Jul 07 16:22:22.305438 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:22.305050    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdvqz/must-gather-9nnc5" event={"ID":"a28dd036-858d-4df3-9790-ff55adb6c87d","Type":"ContainerStarted","Data":"8adfe6dfce3e7ecca952d5e22b4e550afe6793246bf57ad50cce41bd06dc076b"}
Jul 07 16:22:22.329104 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:22.328973    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gdvqz/must-gather-9nnc5" podStartSLOduration=1.6403200070000001 podStartE2EDuration="2.328952565s" totalImagesPullingTime="688.632558ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:22:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:22:22.326148836 +0000 UTC m=+2422.181725715" watchObservedRunningTime="2026-07-07 16:22:22.328952565 +0000 UTC m=+2422.184529445"
Jul 07 16:22:23.489590 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:23.489489    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cwbvk_b65ae597-c59e-4f76-9812-ae2dc272c84d/global-pull-secret-syncer/0.log"
Jul 07 16:22:23.782000 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:23.781926    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t7frb_97263585-1530-4ff1-92ff-e6206533f14b/konnectivity-agent/0.log"
Jul 07 16:22:23.865875 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:23.865839    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-7.ec2.internal_6743fb53a9cf62de7101c6de8e19bb65/haproxy/0.log"
Jul 07 16:22:28.467662 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.467627    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g_f27e3c08-8b58-47b2-993a-c5356a60c778/extract/0.log"
Jul 07 16:22:28.501952 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.501917    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g_f27e3c08-8b58-47b2-993a-c5356a60c778/util/0.log"
Jul 07 16:22:28.537837 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.537801    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759d8c6g_f27e3c08-8b58-47b2-993a-c5356a60c778/pull/0.log"
Jul 07 16:22:28.584873 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.584840    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx_f523fe42-db47-4ca9-8cc3-5590854c4ca1/extract/0.log"
Jul 07 16:22:28.621191 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.621161    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx_f523fe42-db47-4ca9-8cc3-5590854c4ca1/util/0.log"
Jul 07 16:22:28.668619 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.668505    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e08wwvx_f523fe42-db47-4ca9-8cc3-5590854c4ca1/pull/0.log"
Jul 07 16:22:28.720140 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.720058    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw_a008af73-7dd3-4619-aeea-013f2774a619/extract/0.log"
Jul 07 16:22:28.756831 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.756805    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw_a008af73-7dd3-4619-aeea-013f2774a619/util/0.log"
Jul 07 16:22:28.797975 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.797942    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nghpw_a008af73-7dd3-4619-aeea-013f2774a619/pull/0.log"
Jul 07 16:22:28.848576 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.848541    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx_9c59268c-d5bc-4b54-be06-d6c7ca24d7b7/extract/0.log"
Jul 07 16:22:28.887641 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.887568    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx_9c59268c-d5bc-4b54-be06-d6c7ca24d7b7/util/0.log"
Jul 07 16:22:28.928611 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:28.928575    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef184fvx_9c59268c-d5bc-4b54-be06-d6c7ca24d7b7/pull/0.log"
Jul 07 16:22:29.641105 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:29.641076    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-chlqz_00b85f02-0d38-4946-ba69-f2a46fcd9f2f/limitador/0.log"
Jul 07 16:22:29.736001 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:29.735969    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6drmg_d046ee91-9252-43b5-9915-7c217d0cf1f1/manager/0.log"
Jul 07 16:22:31.666571 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:31.666538    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-2hdwx_ad512174-e3ad-44f7-a058-05848b16d427/cluster-monitoring-operator/0.log"
Jul 07 16:22:31.711875 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:31.711791    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-26q7c_fc356441-15ea-4303-bfee-383038e24a70/kube-state-metrics/0.log"
Jul 07 16:22:31.734890 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:31.734846    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-26q7c_fc356441-15ea-4303-bfee-383038e24a70/kube-rbac-proxy-main/0.log"
Jul 07 16:22:31.772308 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:31.771435    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-26q7c_fc356441-15ea-4303-bfee-383038e24a70/kube-rbac-proxy-self/0.log"
Jul 07 16:22:31.969175 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:31.969086    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxckb_a24d9075-cfef-47cb-b79b-2a525cbfb6ea/node-exporter/0.log"
Jul 07 16:22:31.995602 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:31.995559    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxckb_a24d9075-cfef-47cb-b79b-2a525cbfb6ea/kube-rbac-proxy/0.log"
Jul 07 16:22:32.029547 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:32.029518    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxckb_a24d9075-cfef-47cb-b79b-2a525cbfb6ea/init-textfile/0.log"
Jul 07 16:22:32.167622 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:32.167582    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-zbnt9_067047d9-6009-4a2c-80ad-1f3490f9eaa9/kube-rbac-proxy-main/0.log"
Jul 07 16:22:32.201642 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:32.201615    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-zbnt9_067047d9-6009-4a2c-80ad-1f3490f9eaa9/kube-rbac-proxy-self/0.log"
Jul 07 16:22:32.234329 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:32.234224    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-zbnt9_067047d9-6009-4a2c-80ad-1f3490f9eaa9/openshift-state-metrics/0.log"
Jul 07 16:22:32.557058 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:32.556976    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-7rstm_fec4f431-6e05-4dec-abb8-4e6f30729135/prometheus-operator-admission-webhook/0.log"
Jul 07 16:22:32.925612 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:32.925577    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"]
Jul 07 16:22:32.930411 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:32.930384    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:32.942932 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:32.942907    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"]
Jul 07 16:22:33.088516 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.088475    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zj78\" (UniqueName: \"kubernetes.io/projected/b010a727-50a6-4fe4-8286-7362cb6a2471-kube-api-access-8zj78\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.088719 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.088557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-sys\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.088719 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.088587    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-proc\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.088719 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.088620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-lib-modules\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.088719 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.088695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-podres\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.189955 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.189857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zj78\" (UniqueName: \"kubernetes.io/projected/b010a727-50a6-4fe4-8286-7362cb6a2471-kube-api-access-8zj78\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.190127 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.189972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-sys\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.190127 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.189998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-proc\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.190127 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.190034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-lib-modules\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.190127 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.190072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-podres\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.190127 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.190099    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-proc\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.190127 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.190100    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-sys\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.190478 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.190183    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-lib-modules\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.190478 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.190264    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b010a727-50a6-4fe4-8286-7362cb6a2471-podres\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.200661 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.200638    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zj78\" (UniqueName: \"kubernetes.io/projected/b010a727-50a6-4fe4-8286-7362cb6a2471-kube-api-access-8zj78\") pod \"perf-node-gather-daemonset-6qcvt\" (UID: \"b010a727-50a6-4fe4-8286-7362cb6a2471\") " pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.244644 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.244608    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:33.426835 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:33.426739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"]
Jul 07 16:22:34.391350 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:34.391310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt" event={"ID":"b010a727-50a6-4fe4-8286-7362cb6a2471","Type":"ContainerStarted","Data":"47cfa393286c7ebd567edf5c0a18b959b5b420c490f39b3fca75c8ec8b02f6ef"}
Jul 07 16:22:34.391804 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:34.391377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt" event={"ID":"b010a727-50a6-4fe4-8286-7362cb6a2471","Type":"ContainerStarted","Data":"7f5ff7c45f17ec90deb54ff852996a145eaa6d49c755c8fbee08483687a52ab2"}
Jul 07 16:22:34.392111 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:34.392084    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:34.411446 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:34.411388    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt" podStartSLOduration=2.411367995 podStartE2EDuration="2.411367995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:22:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:22:34.410112103 +0000 UTC m=+2434.265688983" watchObservedRunningTime="2026-07-07 16:22:34.411367995 +0000 UTC m=+2434.266944874"
Jul 07 16:22:35.212881 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:35.212843    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bdc6f467d-2zq4q_5e4f3937-4c86-4dc8-820b-08777b3dd6b1/console/0.log"
Jul 07 16:22:35.254785 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:35.254753    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-sm7rm_4b7edcb2-aab5-4b1e-9cdf-5c901dfdaea9/download-server/0.log"
Jul 07 16:22:35.888507 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:35.888477    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-xgs4q_4cfbc970-2a8e-4bc9-add2-f94b82865457/volume-data-source-validator/0.log"
Jul 07 16:22:37.061966 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:37.061922    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frpn4_d1360da7-5e9b-4c69-8086-bd51152a3eee/dns/0.log"
Jul 07 16:22:37.090056 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:37.090025    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frpn4_d1360da7-5e9b-4c69-8086-bd51152a3eee/kube-rbac-proxy/0.log"
Jul 07 16:22:37.249598 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:37.249570    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xgh8d_6d232f46-468a-41e6-8a5f-37c8f6913409/dns-node-resolver/0.log"
Jul 07 16:22:37.888846 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:37.888811    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2zjct_c00bacd2-0897-4e32-9e42-b58deaf50d60/node-ca/0.log"
Jul 07 16:22:39.163149 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:39.163113    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f99849b54-wndbc_d39ef33a-149a-4c5e-a91e-4b5730474d46/kube-auth-proxy/0.log"
Jul 07 16:22:40.165695 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:40.165667    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8wdjh_086f4c58-f6a1-4bca-9144-2f4cc9d3b465/serve-healthcheck-canary/0.log"
Jul 07 16:22:40.910980 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:40.910947    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szzvm_eb90d776-91b9-4c65-b4e3-820227ca9f1b/kube-rbac-proxy/0.log"
Jul 07 16:22:40.947426 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:40.947400    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szzvm_eb90d776-91b9-4c65-b4e3-820227ca9f1b/exporter/0.log"
Jul 07 16:22:40.988046 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:40.988013    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szzvm_eb90d776-91b9-4c65-b4e3-820227ca9f1b/extractor/0.log"
Jul 07 16:22:41.416803 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:41.416767    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gdvqz/perf-node-gather-daemonset-6qcvt"
Jul 07 16:22:43.621708 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:43.621681    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f99849b54-wndbc_d39ef33a-149a-4c5e-a91e-4b5730474d46/kube-auth-proxy/0.log"
Jul 07 16:22:44.241945 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:44.241917    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-865bb77d7b-vqwbm_561d3fb1-f8fd-4137-af28-f031bbc9837e/manager/0.log"
Jul 07 16:22:44.272051 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:44.272024    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-865bb77d7b-vqwbm_561d3fb1-f8fd-4137-af28-f031bbc9837e/copy-manifests/0.log"
Jul 07 16:22:45.146200 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:45.146170    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f99849b54-wndbc_d39ef33a-149a-4c5e-a91e-4b5730474d46/kube-auth-proxy/0.log"
Jul 07 16:22:45.732176 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:45.732147    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86b7f856ff-kxns4_f15a127f-5c91-4adc-850c-888677a102bd/manager/0.log"
Jul 07 16:22:45.768310 ip-10-0-128-7 kubenswrapper[2581]: I0707 16:22:45.768261    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-w8bjc_2ac782ad-e00a-48f6-b459-39b0947190ec/openshift-lws-operator/0.log"