Jul 07 15:29:29.226936 ip-10-0-136-174 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.658560    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665832    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665844    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665848    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665852    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665855    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665858    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665860    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:29:29.723848 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665863    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665866    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665868    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665871    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665874    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665876    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665879    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665882    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665885    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665888    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665891    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665893    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665896    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665899    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665905    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665907    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665910    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665912    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665915    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665919    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:29:29.974342 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665921    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:29:29.739538 ip-10-0-136-174 systemd[1]: Started Kubernetes Kubelet.
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665924    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665927    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665932    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665936    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665939    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665947    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665950    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665953    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665956    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665959    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665961    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665964    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665966    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665969    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665971    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665974    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665976    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665979    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:29:29.981979 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665982    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665984    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665987    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665989    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665992    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665995    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.665997    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666000    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666003    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666006    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666008    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666011    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666013    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666016    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666019    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666021    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666024    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666026    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666029    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666031    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:29:29.982953 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666034    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666036    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666038    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666042    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666044    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666047    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666050    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666052    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666055    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666057    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666060    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666062    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666064    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666067    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666070    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666072    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666074    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666077    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666079    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666083    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:29:29.983975 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666085    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666088    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666091    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666093    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666096    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666099    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666103    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666106    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666108    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666111    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666113    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666117    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.666120    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669420    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669435    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669440    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669445    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669449    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669453    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:29:29.984592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669457    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669461    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669465    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669468    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669472    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669476    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669483    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669489    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669493    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669497    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669502    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669507    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669511    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669515    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669519    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669524    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669528    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669531    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669535    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669539    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:29:29.985231 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669543    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669547    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669551    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669555    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669560    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669564    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669568    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669572    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669576    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669579    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669583    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669587    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669592    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669596    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669600    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669604    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669608    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669612    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669616    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:29:29.986108 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669637    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669642    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669646    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669650    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669654    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669666    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669671    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669675    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669679    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669683    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669687    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669690    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669695    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669699    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669703    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669706    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669710    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669714    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669718    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669722    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:29:29.986921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669726    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669730    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669734    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669737    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669741    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669745    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669748    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669752    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669756    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669760    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669766    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669769    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669773    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669779    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669783    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669788    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669792    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669796    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669802    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:29:29.987935 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669806    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669810    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669814    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669817    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669822    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669828    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669832    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669836    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669840    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669844    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669848    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669852    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669855    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669859    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.669863    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670397    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670403    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670406    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670410    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:29:29.988541 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670414    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670417    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670421    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670424    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670427    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670430    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670432    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670435    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670437    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670440    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670442    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670445    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670448    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670451    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670453    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670456    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670459    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670461    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670464    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670466    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:29:29.989160 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670469    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670471    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670474    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670476    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670479    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670482    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670485    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670488    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670491    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670494    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670497    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670501    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670504    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670507    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670510    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670513    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670516    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670518    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670522    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:29:29.989790 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670525    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670528    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670531    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670533    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670536    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670538    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670542    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670545    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670547    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670549    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670552    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670554    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670557    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670560    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670563    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670565    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670568    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670570    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670573    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670575    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:29:29.990357 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670578    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670580    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670583    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670585    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670588    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670591    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670593    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670596    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670598    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670601    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670603    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670608    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670610    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670613    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670615    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670618    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670635    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670638    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670641    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670644    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:29:29.991017 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670647    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670650    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670652    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670655    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670658    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670660    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670663    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670665    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670668    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670671    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670674    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670677    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670680    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670682    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670684    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.670687    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670776    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670786    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670794    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670801    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 15:29:29.991600 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670805    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670808    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670812    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670819    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670822    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670825    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670829    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670832    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670836    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670840    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670842    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670845    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670849    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670852    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670857    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670859    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670863    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670865    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670869    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670872    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670875    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670878    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670881    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670884    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 15:29:29.992176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670886    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670889    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670892    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670895    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670899    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670902    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670905    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670908    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670911    2580 flags.go:64] FLAG: --enable-server="true"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670914    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670918    2580 flags.go:64] FLAG: --event-burst="100"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670922    2580 flags.go:64] FLAG: --event-qps="50"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670925    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670928    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670930    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670934    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670938    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670941    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670945    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670948    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670950    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670954    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670957    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670960    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670962    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 15:29:29.992823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670965    2580 flags.go:64] FLAG: --feature-gates=""
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670968    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670972    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670974    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670978    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670980    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670983    2580 flags.go:64] FLAG: --help="false"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670986    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-136-174.ec2.internal"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670989    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670992    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670995    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.670999    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671002    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671005    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671008    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671010    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671013    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671016    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671020    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671023    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671026    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671029    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671031    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671036    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 15:29:29.993580 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671039    2580 flags.go:64] FLAG: --lock-file=""
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671041    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671044    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671047    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671052    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671059    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671062    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671065    2580 flags.go:64] FLAG: --logging-format="text"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671068    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671071    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671074    2580 flags.go:64] FLAG: --manifest-url=""
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671077    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671085    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671088    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671092    2580 flags.go:64] FLAG: --max-pods="110"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671095    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671097    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671100    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671103    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671106    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671109    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671112    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671122    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671125    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671128    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 15:29:29.994255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671131    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671135    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671140    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671143    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671146    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671149    2580 flags.go:64] FLAG: --port="10250"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671152    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671156    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b789a53201828706"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671159    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671162    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671166    2580 flags.go:64] FLAG: --register-node="true"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671168    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671172    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671175    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671178    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671181    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671185    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671188    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671191    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671194    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671197    2580 flags.go:64] FLAG: --runonce="false"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671199    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671202    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671205    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671208    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 15:29:29.994999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671211    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671214    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671217    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671220    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671222    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671225    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671228    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671231    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671235    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671238    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671240    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671246    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671249    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671252    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671257    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671260    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671263    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671266    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671268    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671271    2580 flags.go:64] FLAG: --v="2"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671275    2580 flags.go:64] FLAG: --version="false"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671279    2580 flags.go:64] FLAG: --vmodule=""
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671283    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671287    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671410    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:29:29.996028 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671414    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671417    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671420    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671423    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671426    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671428    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671431    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671433    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671436    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671438    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671441    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671444    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671446    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671449    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671452    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671456    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671458    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671461    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671463    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671466    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:29:29.996750 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671468    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671472    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671475    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671477    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671480    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671482    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671485    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671487    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671490    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671494    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671496    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671499    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671502    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671504    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671507    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671509    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671512    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671514    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671517    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671519    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:29:30.084386 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671523    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671527    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671530    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671533    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671536    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671539    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671543    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671549    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671552    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671556    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671558    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671561    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671565    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671569    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671572    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671575    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671577    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671580    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671583    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:29:30.085104 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671585    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671588    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671591    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671594    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671597    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671599    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671602    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671604    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671607    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671609    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671611    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671614    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671617    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671634    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671637    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671640    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671643    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671645    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671648    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:29:30.085648 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671651    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671655    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671658    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671661    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671663    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671665    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671668    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671672    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671674    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671677    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671679    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671682    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671685    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671687    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671690    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671692    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671695    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671698    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671700    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:29:30.086192 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.671703    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.671712    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.679032    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.679049    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.679918    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.679926    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.679990    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.679996    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680000    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680003    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680006    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680009    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680012    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680015    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680018    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:29:30.086719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680021    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680023    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680026    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680029    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680032    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680034    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680037    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680040    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680043    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680046    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680048    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680051    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680053    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680056    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680059    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680063    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680067    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680070    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680072    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680075    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:29:30.087179 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680079    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680082    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680088    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680092    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680095    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680098    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680100    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680103    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680106    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680109    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680111    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680115    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680118    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680120    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680123    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680126    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680129    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680132    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680135    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:29:30.087735 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680137    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680140    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680142    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680145    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680147    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680150    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680153    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680155    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680158    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680161    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680168    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680171    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680175    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680177    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680180    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680187    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680190    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680192    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680195    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:29:30.088272 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680197    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680200    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680203    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680205    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680208    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680210    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680213    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680215    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680218    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680220    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680223    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680225    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680228    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680231    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680234    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680238    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680240    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680243    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680245    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:29:30.088792 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680248    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680250    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680253    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680255    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680259    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680261    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680264    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680266    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680269    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680274    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680277    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680279    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680282    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.680287    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680400    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 15:29:30.089332 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680405    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680408    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680411    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680414    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680417    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680420    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680422    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680425    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680427    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680430    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680433    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680435    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680438    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680440    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680443    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680445    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680448    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680450    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680453    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680455    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 15:29:30.089762 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680458    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680461    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680464    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680466    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680470    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680474    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680477    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680481    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680484    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680487    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680490    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680492    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680495    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680498    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680500    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680503    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680505    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680508    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680510    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 15:29:30.090330 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680513    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680515    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680518    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680520    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680523    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680525    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680528    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680530    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680533    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680535    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680538    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680540    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680543    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680545    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680549    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680551    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680554    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680556    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680559    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 15:29:30.090851 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680562    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680567    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680573    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680576    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680579    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680581    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680584    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680587    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680589    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680592    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680595    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680598    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680600    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680602    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680605    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680607    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680610    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680612    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680615    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680617    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 15:29:30.091402 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680635    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680638    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680641    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680643    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680646    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680649    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680651    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680656    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680660    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680662    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680665    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680668    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680670    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680674    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680676    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680679    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680682    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680685    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680687    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 15:29:30.091983 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:29.680690    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.680695    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.680812    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.683176    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.684824    2580 server.go:1019] "Starting client certificate rotation"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.684943    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.684997    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.687723    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.689477    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.704314    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.706808    2580 log.go:25] "Validated CRI v1 image API"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.707595    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 15:29:30.092578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.710093    2580 fs.go:135] Filesystem UUIDs: map[49406d54-6d10-40e3-b74c-c4a5691729fb:/dev/nvme0n1p4 721221fb-441c-463f-9d72-9dae466d902c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 07 15:29:30.092953 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.710107    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 15:29:30.092953 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.713562    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.716015    2580 manager.go:216] Machine: {Timestamp:2026-07-07 15:29:29.714562233 +0000 UTC m=+0.374266697 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099248 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec256dc54e2cf6fd1142c3617eb6daeb SystemUUID:ec256dc5-4e2c-f6fd-1142-c3617eb6daeb BootID:b87dc3ae-e772-444d-bf73-74421e6489be Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:36:ed:2b:c4:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:36:ed:2b:c4:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:02:c4:dc:35:83 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.716125    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.716213    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.719718    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.719741    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-174.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.720525    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.720535    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.720542    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.721332    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.723114    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.726519    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.726656    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.726688    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.726701    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.726716    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.726728    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.726736    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 15:29:30.093124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.727143    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.727173    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.729796    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.732987    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.733014    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734352    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734365    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734371    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734376    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734386    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734394    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734405    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734413    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734422    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734430    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734450    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.734455    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.735276    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.735287    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.737299    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-174.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.737373    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.737375    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-174.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.738679    2580 server.go:1268] "Started kubelet"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.738748    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.738765    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.738839    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.743135    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.743227    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tlpxt"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.743907    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.744236    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.747036    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-174.ec2.internal.18c00b90fa2521e0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-174.ec2.internal,UID:ip-10-0-136-174.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-174.ec2.internal,},FirstTimestamp:2026-07-07 15:29:29.73865008 +0000 UTC m=+0.398354544,LastTimestamp:2026-07-07 15:29:29.73865008 +0000 UTC m=+0.398354544,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-174.ec2.internal,}"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.753358    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.753376    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.753428    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754098    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754117    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754208    2580 factory.go:55] Registering systemd factory
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754236    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754245    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754259    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754324    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 15:29:30.093733 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754535    2580 factory.go:153] Registering CRI-O factory
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754549    2580 factory.go:223] Registration of the crio container factory successfully
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754601    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754644    2580 factory.go:103] Registering Raw factory
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.754659    2580 manager.go:1196] Started watching for new ooms in manager
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.755032    2580 manager.go:349] Starting recovery of all containers
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.758473    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tlpxt"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.764508    2580 manager.go:354] Recovery completed
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.764672    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.767472    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-174.ec2.internal\" not found" node="ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.768824    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.770719    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.770749    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.770759    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.771270    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.771280    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.771297    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.771304    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.772858    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.772887    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.772900    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.776359    2580 policy_none.go:49] "None policy: Start"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.776374    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.776384    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.777466    2580 policy_none.go:47] "Start"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.832328    2580 manager.go:337] "Starting Device Plugin manager"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.832421    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.832436    2580 server.go:87] "Starting device plugin registration server"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.832742    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.832756    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.832841    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.832917    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.832926    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.834168    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.834220    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.861967    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.863193    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.863228    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.863247    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.863278    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.865894    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.933573    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.934656    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.934685    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.934695    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.934718    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.944613    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.095134 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.944644    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-174.ec2.internal\": node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.964250    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"]
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.964437    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.965236    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.965263    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.965272    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.966496    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.966617    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.966661    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.967195    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.967221    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.967194    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.967259    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.967230    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.967277    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:29.968079    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.969045    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.969070    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.969765    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.969791    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:29.969803    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeHasSufficientPID"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.022974    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-174.ec2.internal\" not found" node="ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.026898    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-174.ec2.internal\" not found" node="ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.068379    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.155727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c747900aad74344d67fd4af174be2b65-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"c747900aad74344d67fd4af174be2b65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.155758    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c747900aad74344d67fd4af174be2b65-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"c747900aad74344d67fd4af174be2b65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.155776    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0910101d25b67a967c4541fac7101e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"e0910101d25b67a967c4541fac7101e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.212083 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.168819    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.328051 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.256500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c747900aad74344d67fd4af174be2b65-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"c747900aad74344d67fd4af174be2b65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.328051 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.256533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0910101d25b67a967c4541fac7101e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"e0910101d25b67a967c4541fac7101e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.328051 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.256550    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c747900aad74344d67fd4af174be2b65-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"c747900aad74344d67fd4af174be2b65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.328051 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.256588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c747900aad74344d67fd4af174be2b65-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"c747900aad74344d67fd4af174be2b65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.328051 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.256638    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0910101d25b67a967c4541fac7101e5-config\") pod \"kube-apiserver-proxy-ip-10-0-136-174.ec2.internal\" (UID: \"e0910101d25b67a967c4541fac7101e5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.328051 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.256639    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c747900aad74344d67fd4af174be2b65-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal\" (UID: \"c747900aad74344d67fd4af174be2b65\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.328051 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.269587    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.328051 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.326065    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.331133 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.329870    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:30.447077 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.370663    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.591427 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.471237    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.591427 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.571726    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.723365 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.665663    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:29:30.723365 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.671908    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.723365 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.684058    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 15:29:30.723365 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.684194    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:29:30.723365 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.684231    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:29:30.723365 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.684238    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 15:29:30.839082 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.761049    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 15:24:30 +0000 UTC" deadline="2028-02-04 20:49:14.078005863 +0000 UTC"
Jul 07 15:29:30.839082 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.761075    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13853h19m43.316933334s"
Jul 07 15:29:30.839082 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.772265    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.941485 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.872340    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:30.941485 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:30.927501    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0910101d25b67a967c4541fac7101e5.slice/crio-f62007c2a9f649939a8447885d62522827cf1bc5289fcd1d27be08d92d8263d3 WatchSource:0}: Error finding container f62007c2a9f649939a8447885d62522827cf1bc5289fcd1d27be08d92d8263d3: Status 404 returned error can't find the container with id f62007c2a9f649939a8447885d62522827cf1bc5289fcd1d27be08d92d8263d3
Jul 07 15:29:30.941485 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:30.927975    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc747900aad74344d67fd4af174be2b65.slice/crio-27e94fe255451a8101a5feee06ccd6a369cf7ec1bb723a6924991ea30aa1a84b WatchSource:0}: Error finding container 27e94fe255451a8101a5feee06ccd6a369cf7ec1bb723a6924991ea30aa1a84b: Status 404 returned error can't find the container with id 27e94fe255451a8101a5feee06ccd6a369cf7ec1bb723a6924991ea30aa1a84b
Jul 07 15:29:30.941485 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:30.935684    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:29:31.066521 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:30.973447    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:31.076431 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.074214    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:31.185745 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.174417    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-174.ec2.internal\" not found"
Jul 07 15:29:31.185745 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.175339    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:29:31.323877 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.254692    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:31.323877 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.269205    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:29:31.323877 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.270370    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal"
Jul 07 15:29:31.323877 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.281893    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 15:29:31.728124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.727766    2580 apiserver.go:52] "Watching apiserver"
Jul 07 15:29:31.737460 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.737422    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 15:29:31.738502 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.738459    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-p58r7","openshift-cluster-node-tuning-operator/tuned-5grmc","openshift-dns/node-resolver-6bldp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal","openshift-multus/multus-2lfz5","openshift-multus/multus-additional-cni-plugins-8q26h","openshift-multus/network-metrics-daemon-47kps","openshift-network-operator/iptables-alerter-x5nx5","kube-system/konnectivity-agent-bxnsr","kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks","openshift-image-registry/node-ca-5cmnl","openshift-network-diagnostics/network-check-target-lfhlg","openshift-ovn-kubernetes/ovnkube-node-6pr4f"]
Jul 07 15:29:31.740475 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.740321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:31.740475 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.740434    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:31.742831 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.742393    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.743765 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.743415    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.744673 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.744642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.744796 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.744742    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:31.745930 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.745901    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 15:29:31.746812 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.746264    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 15:29:31.746812 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.746307    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.746812 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.746482    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 15:29:31.746812 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.746560    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4tgxt\""
Jul 07 15:29:31.747075 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.746889    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f92x5\""
Jul 07 15:29:31.747075 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.746997    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:29:31.747075 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.747043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.748313 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.748293    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:31.748413 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.748362    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:31.749451 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.749431    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.750681 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.750658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:31.753357 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.752514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.753657 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.753636    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 15:29:31.754081 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.754061    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.755604 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.755580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.759905 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.759882    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 15:29:31.760008 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.759931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 15:29:31.760197 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.760181    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 15:29:31.760453 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.760424    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.760609    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.760821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.760859    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761003    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761049    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761184    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761217    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.760609    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kfq27\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761407    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jgg4v\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.759888    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761592    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dlzbq\""
Jul 07 15:29:31.761743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761640    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 15:29:31.762540 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761824    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 15:29:31.762540 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.761972    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zm7f5\""
Jul 07 15:29:31.762540 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.762015    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 15:29:31.762540 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.762198    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 15:29:31.762540 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.762392    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 15:29:31.762819 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.762623    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 15:29:31.762872 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.762859    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 15:29:31.763083 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.763065    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 15:29:31.763197 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.763139    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ng8dd\""
Jul 07 15:29:31.763273 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.763197    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 15:29:31.763273 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.763234    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mrjbk\""
Jul 07 15:29:31.763405 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.763387    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5trmm\""
Jul 07 15:29:31.763491 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.763430    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.769850    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-var-lib-kubelet\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.769888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-cni-bin\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.769915    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d88t\" (UniqueName: \"kubernetes.io/projected/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-kube-api-access-5d88t\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.769940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85e106d4-1e25-4232-8423-93dffba41523-iptables-alerter-script\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.769997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8318c5d-53b4-489a-bd64-9e51fc76dc97-tmp-dir\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770041    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-kubelet\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm88g\" (UniqueName: \"kubernetes.io/projected/7331dee0-ad77-467a-886c-638710632215-kube-api-access-wm88g\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vbx7\" (UniqueName: \"kubernetes.io/projected/4656765c-9a3d-4f88-a8e6-c079f87e2d11-kube-api-access-5vbx7\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-cni-bin\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.770181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770157    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovnkube-config\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-sys-fs\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770249    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-cni-multus\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysctl-d\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770296    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-tuned\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-kubelet\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770364    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-run-netns\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770455    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-socket-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysconfig\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-hostroot\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85e106d4-1e25-4232-8423-93dffba41523-host-slash\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.770656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770610    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-cni-netd\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-device-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-kubernetes\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-var-lib-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770885    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-serviceca\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770930    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-sys\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-system-cni-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-netns\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.770996    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-conf-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4385ed5d-e9b2-4402-bf7c-09c665163bdc-konnectivity-ca\") pod \"konnectivity-agent-bxnsr\" (UID: \"4385ed5d-e9b2-4402-bf7c-09c665163bdc\") " pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8318c5d-53b4-489a-bd64-9e51fc76dc97-hosts-file\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771147    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-systemd\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-cni-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.771254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4656765c-9a3d-4f88-a8e6-c079f87e2d11-cni-binary-copy\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-system-cni-dir\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28012edb-db42-4a95-b9f8-b7b4adeee458-kubelet-config\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771340    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-run\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4385ed5d-e9b2-4402-bf7c-09c665163bdc-agent-certs\") pod \"konnectivity-agent-bxnsr\" (UID: \"4385ed5d-e9b2-4402-bf7c-09c665163bdc\") " pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771384    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-etc-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-env-overrides\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771431    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-registration-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-tmp\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771468    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771491    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysctl-conf\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-lib-modules\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771528    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-socket-dir-parent\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-daemon-config\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.771799 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-ovn\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-etc-kubernetes\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771627    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlmrb\" (UniqueName: \"kubernetes.io/projected/e8318c5d-53b4-489a-bd64-9e51fc76dc97-kube-api-access-jlmrb\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28012edb-db42-4a95-b9f8-b7b4adeee458-dbus\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x69g8\" (UniqueName: \"kubernetes.io/projected/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-kube-api-access-x69g8\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovnkube-script-lib\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-host\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-host\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cnibin\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771920    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-systemd-units\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-node-log\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovn-node-metrics-cert\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lmsz\" (UniqueName: \"kubernetes.io/projected/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-kube-api-access-8lmsz\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.771992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-os-release\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.772575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772128    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p942s\" (UniqueName: \"kubernetes.io/projected/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-kube-api-access-p942s\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-cnibin\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772198    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-os-release\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-slash\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-log-socket\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772360    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz7dm\" (UniqueName: \"kubernetes.io/projected/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-kube-api-access-rz7dm\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772385    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-modprobe-d\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772412    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-k8s-cni-cncf-io\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-multus-certs\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcq7z\" (UniqueName: \"kubernetes.io/projected/85e106d4-1e25-4232-8423-93dffba41523-kube-api-access-hcq7z\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.773382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.772493    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-systemd\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.790888 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.790664    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 15:29:31.811605 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.811574    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-djkqr"
Jul 07 15:29:31.823848 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.823823    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-djkqr"
Jul 07 15:29:31.855307 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.855269    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 15:29:31.869728 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.869626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"c747900aad74344d67fd4af174be2b65","Type":"ContainerStarted","Data":"27e94fe255451a8101a5feee06ccd6a369cf7ec1bb723a6924991ea30aa1a84b"}
Jul 07 15:29:31.871776 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.871747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" event={"ID":"e0910101d25b67a967c4541fac7101e5","Type":"ContainerStarted","Data":"f62007c2a9f649939a8447885d62522827cf1bc5289fcd1d27be08d92d8263d3"}
Jul 07 15:29:31.873093 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873067    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlmrb\" (UniqueName: \"kubernetes.io/projected/e8318c5d-53b4-489a-bd64-9e51fc76dc97-kube-api-access-jlmrb\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.873214 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873109    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28012edb-db42-4a95-b9f8-b7b4adeee458-dbus\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.873214 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873139    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x69g8\" (UniqueName: \"kubernetes.io/projected/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-kube-api-access-x69g8\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.873214 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.873214 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovnkube-script-lib\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.873214 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873211    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-host\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-host\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cnibin\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873310    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-systemd-units\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-node-log\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873355    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovn-node-metrics-cert\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873390    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmsz\" (UniqueName: \"kubernetes.io/projected/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-kube-api-access-8lmsz\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-os-release\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p942s\" (UniqueName: \"kubernetes.io/projected/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-kube-api-access-p942s\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:31.873492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873470    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-host\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873590    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-node-log\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.873669    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-cnibin\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873747    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/28012edb-db42-4a95-b9f8-b7b4adeee458-dbus\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873750    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-os-release\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.873757    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret podName:28012edb-db42-4a95-b9f8-b7b4adeee458 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:32.373730972 +0000 UTC m=+3.033435439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret") pod "global-pull-secret-syncer-p58r7" (UID: "28012edb-db42-4a95-b9f8-b7b4adeee458") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873774    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-cnibin\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873813    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873847    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873670    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-systemd-units\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873911    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cnibin\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873950    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.873961    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-host\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874006    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-os-release\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.874045 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-slash\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874096    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-os-release\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-log-socket\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874141    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-slash\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz7dm\" (UniqueName: \"kubernetes.io/projected/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-kube-api-access-rz7dm\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874183    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-log-socket\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-modprobe-d\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-k8s-cni-cncf-io\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-multus-certs\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874250    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874288    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-modprobe-d\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcq7z\" (UniqueName: \"kubernetes.io/projected/85e106d4-1e25-4232-8423-93dffba41523-kube-api-access-hcq7z\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874331    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-systemd\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874345    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-k8s-cni-cncf-io\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-var-lib-kubelet\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874398    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-cni-bin\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874385    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-multus-certs\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.874895 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d88t\" (UniqueName: \"kubernetes.io/projected/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-kube-api-access-5d88t\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874463    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-var-lib-kubelet\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85e106d4-1e25-4232-8423-93dffba41523-iptables-alerter-script\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8318c5d-53b4-489a-bd64-9e51fc76dc97-tmp-dir\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874534    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-systemd\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-kubelet\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874580    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-cni-bin\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm88g\" (UniqueName: \"kubernetes.io/projected/7331dee0-ad77-467a-886c-638710632215-kube-api-access-wm88g\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874626    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vbx7\" (UniqueName: \"kubernetes.io/projected/4656765c-9a3d-4f88-a8e6-c079f87e2d11-kube-api-access-5vbx7\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874634    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-cni-bin\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874682    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-kubelet\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874702    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874640    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovnkube-script-lib\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874763    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovnkube-config\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874781    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-sys-fs\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.875857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-cni-multus\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874831    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-cni-bin\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874849    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysctl-d\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-tuned\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-kubelet\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-run-netns\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-socket-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysconfig\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874969    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8318c5d-53b4-489a-bd64-9e51fc76dc97-tmp-dir\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.874986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-hostroot\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85e106d4-1e25-4232-8423-93dffba41523-host-slash\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875013    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysctl-d\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-cni-netd\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875051    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-kubelet\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875060    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysconfig\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875067    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-sys-fs\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875104    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-cni-netd\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875108    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/85e106d4-1e25-4232-8423-93dffba41523-host-slash\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.876793 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-device-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875125    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-device-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875116    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/85e106d4-1e25-4232-8423-93dffba41523-iptables-alerter-script\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875139    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-run-netns\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875161    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-var-lib-cni-multus\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-kubernetes\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875189    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-hostroot\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875237    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875269    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-socket-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-var-lib-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875277    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovnkube-config\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875304    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-var-lib-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875321    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-kubernetes\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875367    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-serviceca\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-sys\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.877795 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-system-cni-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-netns\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-conf-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875572    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-system-cni-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4385ed5d-e9b2-4402-bf7c-09c665163bdc-konnectivity-ca\") pod \"konnectivity-agent-bxnsr\" (UID: \"4385ed5d-e9b2-4402-bf7c-09c665163bdc\") " pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875612    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-host-run-netns\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8318c5d-53b4-489a-bd64-9e51fc76dc97-hosts-file\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875712    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8318c5d-53b4-489a-bd64-9e51fc76dc97-hosts-file\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-systemd\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875769    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-sys\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-cni-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875828    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4656765c-9a3d-4f88-a8e6-c079f87e2d11-cni-binary-copy\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875830    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-system-cni-dir\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875864    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-systemd\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875830    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-serviceca\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875900    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-conf-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.878644 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875908    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-system-cni-dir\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.875966    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-cni-dir\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876015    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28012edb-db42-4a95-b9f8-b7b4adeee458-kubelet-config\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-run\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4385ed5d-e9b2-4402-bf7c-09c665163bdc-agent-certs\") pod \"konnectivity-agent-bxnsr\" (UID: \"4385ed5d-e9b2-4402-bf7c-09c665163bdc\") " pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-etc-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876215    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-run\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876222    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-env-overrides\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876251    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-registration-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876260    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4385ed5d-e9b2-4402-bf7c-09c665163bdc-konnectivity-ca\") pod \"konnectivity-agent-bxnsr\" (UID: \"4385ed5d-e9b2-4402-bf7c-09c665163bdc\") " pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876278    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-tmp\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876337    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-etc-openvswitch\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.876403    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.876478    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs podName:b121c849-7d0f-4ebc-ae16-ee73d3fb0f22 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:32.376457394 +0000 UTC m=+3.036161848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs") pod "network-metrics-daemon-47kps" (UID: "b121c849-7d0f-4ebc-ae16-ee73d3fb0f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876478    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7331dee0-ad77-467a-886c-638710632215-registration-dir\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.879602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876534    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876596    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876624    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysctl-conf\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-lib-modules\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876699    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-socket-dir-parent\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-daemon-config\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876772    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-ovn\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-etc-kubernetes\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876858    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-env-overrides\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876922    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-run-ovn\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.876922    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-host-run-ovn-kubernetes\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.877014    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-lib-modules\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.877036    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4656765c-9a3d-4f88-a8e6-c079f87e2d11-cni-binary-copy\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.877077    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-etc-kubernetes\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.877082    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/28012edb-db42-4a95-b9f8-b7b4adeee458-kubelet-config\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.877037    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-sysctl-conf\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.877132    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-socket-dir-parent\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.877539    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4656765c-9a3d-4f88-a8e6-c079f87e2d11-multus-daemon-config\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.880480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.878620    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-ovn-node-metrics-cert\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.881463 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.879639    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-tmp\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.881463 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.879841    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4385ed5d-e9b2-4402-bf7c-09c665163bdc-agent-certs\") pod \"konnectivity-agent-bxnsr\" (UID: \"4385ed5d-e9b2-4402-bf7c-09c665163bdc\") " pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:31.881463 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.879920    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-etc-tuned\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.887322 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.886848    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:29:31.887322 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.886857    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p942s\" (UniqueName: \"kubernetes.io/projected/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-kube-api-access-p942s\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:31.887322 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.886872    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:29:31.887322 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.886888    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9l475 for pod openshift-network-diagnostics/network-check-target-lfhlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:31.887322 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:31.886951    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475 podName:51fb269e-0f41-4b66-a594-e55e1f50165f nodeName:}" failed. No retries permitted until 2026-07-07 15:29:32.386932093 +0000 UTC m=+3.046636565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9l475" (UniqueName: "kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475") pod "network-check-target-lfhlg" (UID: "51fb269e-0f41-4b66-a594-e55e1f50165f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:31.888968 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.888874    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d88t\" (UniqueName: \"kubernetes.io/projected/acb1a0d2-d48c-42cc-a538-28374ac7d3a1-kube-api-access-5d88t\") pod \"multus-additional-cni-plugins-8q26h\" (UID: \"acb1a0d2-d48c-42cc-a538-28374ac7d3a1\") " pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:31.890902 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.890671    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlmrb\" (UniqueName: \"kubernetes.io/projected/e8318c5d-53b4-489a-bd64-9e51fc76dc97-kube-api-access-jlmrb\") pod \"node-resolver-6bldp\" (UID: \"e8318c5d-53b4-489a-bd64-9e51fc76dc97\") " pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:31.891657 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.891631    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcq7z\" (UniqueName: \"kubernetes.io/projected/85e106d4-1e25-4232-8423-93dffba41523-kube-api-access-hcq7z\") pod \"iptables-alerter-x5nx5\" (UID: \"85e106d4-1e25-4232-8423-93dffba41523\") " pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:31.892021 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.891963    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm88g\" (UniqueName: \"kubernetes.io/projected/7331dee0-ad77-467a-886c-638710632215-kube-api-access-wm88g\") pod \"aws-ebs-csi-driver-node-hfzks\" (UID: \"7331dee0-ad77-467a-886c-638710632215\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:31.892444 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.892423    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lmsz\" (UniqueName: \"kubernetes.io/projected/8aa8cab2-ad9a-409e-9cf5-c3649fd592a1-kube-api-access-8lmsz\") pod \"tuned-5grmc\" (UID: \"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1\") " pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:31.892521 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.892474    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vbx7\" (UniqueName: \"kubernetes.io/projected/4656765c-9a3d-4f88-a8e6-c079f87e2d11-kube-api-access-5vbx7\") pod \"multus-2lfz5\" (UID: \"4656765c-9a3d-4f88-a8e6-c079f87e2d11\") " pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:31.893049 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.892960    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz7dm\" (UniqueName: \"kubernetes.io/projected/e3087e75-a0cb-4cab-9e40-d2a2140bb8e1-kube-api-access-rz7dm\") pod \"node-ca-5cmnl\" (UID: \"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1\") " pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:31.894380 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.893698    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x69g8\" (UniqueName: \"kubernetes.io/projected/be8d6d9a-6cdc-44ad-9140-3cfa5859a29b-kube-api-access-x69g8\") pod \"ovnkube-node-6pr4f\" (UID: \"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b\") " pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:31.983481 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:31.983402    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:29:32.057797 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.057757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5grmc"
Jul 07 15:29:32.064605 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.064574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6bldp"
Jul 07 15:29:32.075918 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.075887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2lfz5"
Jul 07 15:29:32.081717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.081692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8q26h"
Jul 07 15:29:32.091535 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.091507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5nx5"
Jul 07 15:29:32.107766 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.107742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:32.116699 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.116679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:32.125457 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.125432    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks"
Jul 07 15:29:32.133257 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.133237    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5cmnl"
Jul 07 15:29:32.147306 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.147286    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:29:32.381392 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.381293    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:32.381392 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.381360    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:32.381621 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.381473    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:32.381621 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.381557    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs podName:b121c849-7d0f-4ebc-ae16-ee73d3fb0f22 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:33.381535554 +0000 UTC m=+4.041240024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs") pod "network-metrics-daemon-47kps" (UID: "b121c849-7d0f-4ebc-ae16-ee73d3fb0f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:32.381621 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.381474    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:32.381815 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.381648    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret podName:28012edb-db42-4a95-b9f8-b7b4adeee458 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:33.381623164 +0000 UTC m=+4.041327617 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret") pod "global-pull-secret-syncer-p58r7" (UID: "28012edb-db42-4a95-b9f8-b7b4adeee458") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:32.483044 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.483004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:32.483206 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.483187    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:29:32.483264 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.483214    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:29:32.483264 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.483225    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9l475 for pod openshift-network-diagnostics/network-check-target-lfhlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:32.483332 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.483285    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475 podName:51fb269e-0f41-4b66-a594-e55e1f50165f nodeName:}" failed. No retries permitted until 2026-07-07 15:29:33.483270041 +0000 UTC m=+4.142974498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l475" (UniqueName: "kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475") pod "network-check-target-lfhlg" (UID: "51fb269e-0f41-4b66-a594-e55e1f50165f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:32.614323 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.614295    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 15:29:32.826556 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.826442    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:24:32 +0000 UTC" deadline="2027-11-30 17:23:09.205724222 +0000 UTC"
Jul 07 15:29:32.826556 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.826501    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12265h53m36.379229009s"
Jul 07 15:29:32.864126 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:32.864089    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:32.864770 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:32.864215    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:33.021121 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:33.021084    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4656765c_9a3d_4f88_a8e6_c079f87e2d11.slice/crio-ebb0a54a7a1c4e81858e7a7740e5f763f75e7829dc92116e7b9430060c368821 WatchSource:0}: Error finding container ebb0a54a7a1c4e81858e7a7740e5f763f75e7829dc92116e7b9430060c368821: Status 404 returned error can't find the container with id ebb0a54a7a1c4e81858e7a7740e5f763f75e7829dc92116e7b9430060c368821
Jul 07 15:29:33.022963 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:33.022938    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb1a0d2_d48c_42cc_a538_28374ac7d3a1.slice/crio-bc397e40fd32c488d69e31d06a2b8ad25e101fa731e42b68e0a02d129ba93fc5 WatchSource:0}: Error finding container bc397e40fd32c488d69e31d06a2b8ad25e101fa731e42b68e0a02d129ba93fc5: Status 404 returned error can't find the container with id bc397e40fd32c488d69e31d06a2b8ad25e101fa731e42b68e0a02d129ba93fc5
Jul 07 15:29:33.024578 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:33.024535    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7331dee0_ad77_467a_886c_638710632215.slice/crio-6915d47bde3adc70b90f254a23821c9ad035d941b7444f424b79a60b410ebd1f WatchSource:0}: Error finding container 6915d47bde3adc70b90f254a23821c9ad035d941b7444f424b79a60b410ebd1f: Status 404 returned error can't find the container with id 6915d47bde3adc70b90f254a23821c9ad035d941b7444f424b79a60b410ebd1f
Jul 07 15:29:33.028424 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:33.028400    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85e106d4_1e25_4232_8423_93dffba41523.slice/crio-35fe581eb93bef46c3134bf215b0d3fc335a0a56f64a1f964698ffc5011a45cb WatchSource:0}: Error finding container 35fe581eb93bef46c3134bf215b0d3fc335a0a56f64a1f964698ffc5011a45cb: Status 404 returned error can't find the container with id 35fe581eb93bef46c3134bf215b0d3fc335a0a56f64a1f964698ffc5011a45cb
Jul 07 15:29:33.030520 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:29:33.030351    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8d6d9a_6cdc_44ad_9140_3cfa5859a29b.slice/crio-1399014d777f574863eb0aca82febf830dbabfa1fd311ba8daff39ff0f104451 WatchSource:0}: Error finding container 1399014d777f574863eb0aca82febf830dbabfa1fd311ba8daff39ff0f104451: Status 404 returned error can't find the container with id 1399014d777f574863eb0aca82febf830dbabfa1fd311ba8daff39ff0f104451
Jul 07 15:29:33.391688 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.391485    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:33.391855 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.391745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:33.391855 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.391669    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:33.391855 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.391831    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:33.391855 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.391837    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret podName:28012edb-db42-4a95-b9f8-b7b4adeee458 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:35.391811488 +0000 UTC m=+6.051515944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret") pod "global-pull-secret-syncer-p58r7" (UID: "28012edb-db42-4a95-b9f8-b7b4adeee458") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:33.392008 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.391874    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs podName:b121c849-7d0f-4ebc-ae16-ee73d3fb0f22 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:35.391861594 +0000 UTC m=+6.051566046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs") pod "network-metrics-daemon-47kps" (UID: "b121c849-7d0f-4ebc-ae16-ee73d3fb0f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:33.492556 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.492515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:33.492781 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.492699    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:29:33.492781 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.492730    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:29:33.492781 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.492758    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9l475 for pod openshift-network-diagnostics/network-check-target-lfhlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:33.492981 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.492826    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475 podName:51fb269e-0f41-4b66-a594-e55e1f50165f nodeName:}" failed. No retries permitted until 2026-07-07 15:29:35.492804105 +0000 UTC m=+6.152508556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l475" (UniqueName: "kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475") pod "network-check-target-lfhlg" (UID: "51fb269e-0f41-4b66-a594-e55e1f50165f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:33.827657 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.827534    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 15:24:32 +0000 UTC" deadline="2028-02-11 19:18:38.092071555 +0000 UTC"
Jul 07 15:29:33.827657 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.827605    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14019h49m4.264470827s"
Jul 07 15:29:33.867901 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.867869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:33.868485 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.868037    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:33.870904 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.870879    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:33.871029 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:33.870993    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:33.910735 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.910479    2580 generic.go:356] "Generic (PLEG): container finished" podID="c747900aad74344d67fd4af174be2b65" containerID="31fdf9341ef82493a299eee67a8945e3b460f4d6f1a4b69ab8791d99a94f800c" exitCode=0
Jul 07 15:29:33.912404 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.911825    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"c747900aad74344d67fd4af174be2b65","Type":"ContainerDied","Data":"31fdf9341ef82493a299eee67a8945e3b460f4d6f1a4b69ab8791d99a94f800c"}
Jul 07 15:29:33.920288 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.920201    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5grmc" event={"ID":"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1","Type":"ContainerStarted","Data":"e53160e152c750bce745cf51282bb5172f540e9657edf2d87b6886d61fa7e203"}
Jul 07 15:29:33.954046 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.953952    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bxnsr" event={"ID":"4385ed5d-e9b2-4402-bf7c-09c665163bdc","Type":"ContainerStarted","Data":"f64c75cd612408bbe4fefdfffaf77fded7053ae121ccaebc5be840d3ac88cfb6"}
Jul 07 15:29:33.956735 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.956485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"1399014d777f574863eb0aca82febf830dbabfa1fd311ba8daff39ff0f104451"}
Jul 07 15:29:33.972857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.972778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5nx5" event={"ID":"85e106d4-1e25-4232-8423-93dffba41523","Type":"ContainerStarted","Data":"35fe581eb93bef46c3134bf215b0d3fc335a0a56f64a1f964698ffc5011a45cb"}
Jul 07 15:29:33.978837 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.978759    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks" event={"ID":"7331dee0-ad77-467a-886c-638710632215","Type":"ContainerStarted","Data":"6915d47bde3adc70b90f254a23821c9ad035d941b7444f424b79a60b410ebd1f"}
Jul 07 15:29:33.996481 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:33.996056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lfz5" event={"ID":"4656765c-9a3d-4f88-a8e6-c079f87e2d11","Type":"ContainerStarted","Data":"ebb0a54a7a1c4e81858e7a7740e5f763f75e7829dc92116e7b9430060c368821"}
Jul 07 15:29:34.026771 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:34.025957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" event={"ID":"e0910101d25b67a967c4541fac7101e5","Type":"ContainerStarted","Data":"f1210088ccd41e2da712f9940beb73660f94ad54b2d1f0cd47b8bfaa7d77b4d0"}
Jul 07 15:29:34.040570 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:34.040473    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bldp" event={"ID":"e8318c5d-53b4-489a-bd64-9e51fc76dc97","Type":"ContainerStarted","Data":"2b9516f37c13d45987729cb6e5c9ff11f022084dbf93b1d9d437f4d496d128a4"}
Jul 07 15:29:34.055067 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:34.054945    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5cmnl" event={"ID":"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1","Type":"ContainerStarted","Data":"773be966470ad561e82ee36b946784733e0399153d2383376406da08e28e743d"}
Jul 07 15:29:34.063863 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:34.063795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8q26h" event={"ID":"acb1a0d2-d48c-42cc-a538-28374ac7d3a1","Type":"ContainerStarted","Data":"bc397e40fd32c488d69e31d06a2b8ad25e101fa731e42b68e0a02d129ba93fc5"}
Jul 07 15:29:34.863990 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:34.863955    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:34.864176 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:34.864109    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:35.084204 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:35.084097    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" event={"ID":"c747900aad74344d67fd4af174be2b65","Type":"ContainerStarted","Data":"005e9a1255f659bb845b1d420863adbbe77209cdf0451c9986115756b68c4f98"}
Jul 07 15:29:35.109888 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:35.109770    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-174.ec2.internal" podStartSLOduration=4.109747257 podStartE2EDuration="4.109747257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:35.109097548 +0000 UTC m=+5.768802025" watchObservedRunningTime="2026-07-07 15:29:35.109747257 +0000 UTC m=+5.769451735"
Jul 07 15:29:35.110288 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:35.110261    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-174.ec2.internal" podStartSLOduration=4.110254073 podStartE2EDuration="4.110254073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:34.047502016 +0000 UTC m=+4.707206493" watchObservedRunningTime="2026-07-07 15:29:35.110254073 +0000 UTC m=+5.769958552"
Jul 07 15:29:35.409398 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:35.409308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:35.409398 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:35.409373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:35.409621 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.409519    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:35.409621 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.409597    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret podName:28012edb-db42-4a95-b9f8-b7b4adeee458 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:39.409575502 +0000 UTC m=+10.069279961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret") pod "global-pull-secret-syncer-p58r7" (UID: "28012edb-db42-4a95-b9f8-b7b4adeee458") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:35.410250 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.410227    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:35.410367 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.410297    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs podName:b121c849-7d0f-4ebc-ae16-ee73d3fb0f22 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:39.410272525 +0000 UTC m=+10.069977008 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs") pod "network-metrics-daemon-47kps" (UID: "b121c849-7d0f-4ebc-ae16-ee73d3fb0f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:35.510618 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:35.510577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:35.511327 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.510823    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:29:35.511327 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.510848    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:29:35.511327 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.510861    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9l475 for pod openshift-network-diagnostics/network-check-target-lfhlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:35.511327 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.510952    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475 podName:51fb269e-0f41-4b66-a594-e55e1f50165f nodeName:}" failed. No retries permitted until 2026-07-07 15:29:39.510933619 +0000 UTC m=+10.170638075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l475" (UniqueName: "kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475") pod "network-check-target-lfhlg" (UID: "51fb269e-0f41-4b66-a594-e55e1f50165f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:35.864598 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:35.863839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:35.864598 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.864026    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:35.864598 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:35.864072    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:35.864598 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:35.864145    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:36.864245 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:36.863855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:36.864245 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:36.864021    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:37.867922 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:37.867894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:37.868373 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:37.868020    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:37.868433 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:37.868391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:37.868509 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:37.868482    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:38.863486 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:38.863412    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:38.863668 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:38.863553    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:39.448314 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:39.448275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:39.448783 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:39.448335    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:39.448783 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.448455    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:39.448783 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.448472    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:39.448783 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.448532    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret podName:28012edb-db42-4a95-b9f8-b7b4adeee458 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:47.448514002 +0000 UTC m=+18.108218468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret") pod "global-pull-secret-syncer-p58r7" (UID: "28012edb-db42-4a95-b9f8-b7b4adeee458") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:39.448783 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.448551    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs podName:b121c849-7d0f-4ebc-ae16-ee73d3fb0f22 nodeName:}" failed. No retries permitted until 2026-07-07 15:29:47.448541457 +0000 UTC m=+18.108245918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs") pod "network-metrics-daemon-47kps" (UID: "b121c849-7d0f-4ebc-ae16-ee73d3fb0f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:39.549111 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:39.549069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:39.549283 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.549251    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:29:39.549283 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.549272    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:29:39.549356 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.549287    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9l475 for pod openshift-network-diagnostics/network-check-target-lfhlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:39.549394 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.549356    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475 podName:51fb269e-0f41-4b66-a594-e55e1f50165f nodeName:}" failed. No retries permitted until 2026-07-07 15:29:47.549336686 +0000 UTC m=+18.209041144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l475" (UniqueName: "kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475") pod "network-check-target-lfhlg" (UID: "51fb269e-0f41-4b66-a594-e55e1f50165f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:39.866581 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:39.866516    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:39.866735 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.866598    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:39.866941 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:39.866922    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:39.867040 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:39.867018    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:40.864328 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:40.864286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:40.864798 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:40.864439    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:41.864421 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:41.864341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:41.864908 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:41.864471    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:41.864908 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:41.864881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:41.865016 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:41.864977    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:42.863980 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:42.863944    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:42.864159 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:42.864073    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:43.866838 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:43.866806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:43.867264 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:43.866904    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:43.867264 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:43.866959    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:43.867264 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:43.867072    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:44.864493 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:44.864453    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:44.864732 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:44.864590    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:45.866681 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:45.866651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:45.867085 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:45.866651    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:45.867085 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:45.866755    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:45.867085 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:45.866818    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:46.864250 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:46.864209    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:46.864454 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:46.864350    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:47.509134 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:47.509098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:47.509659 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:47.509153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:47.509659 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.509228    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:47.509659 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.509294    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:47.509659 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.509298    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs podName:b121c849-7d0f-4ebc-ae16-ee73d3fb0f22 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:03.509282495 +0000 UTC m=+34.168986959 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs") pod "network-metrics-daemon-47kps" (UID: "b121c849-7d0f-4ebc-ae16-ee73d3fb0f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:29:47.509659 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.509357    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret podName:28012edb-db42-4a95-b9f8-b7b4adeee458 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:03.509341744 +0000 UTC m=+34.169046194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret") pod "global-pull-secret-syncer-p58r7" (UID: "28012edb-db42-4a95-b9f8-b7b4adeee458") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:29:47.609800 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:47.609769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:47.609956 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.609921    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:29:47.609956 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.609942    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:29:47.609956 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.609953    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9l475 for pod openshift-network-diagnostics/network-check-target-lfhlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:47.610089 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.610017    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475 podName:51fb269e-0f41-4b66-a594-e55e1f50165f nodeName:}" failed. No retries permitted until 2026-07-07 15:30:03.60999715 +0000 UTC m=+34.269701607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l475" (UniqueName: "kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475") pod "network-check-target-lfhlg" (UID: "51fb269e-0f41-4b66-a594-e55e1f50165f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:29:47.864486 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:47.864406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:47.864486 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:47.864430    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:47.864715 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.864518    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:47.864715 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:47.864640    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:48.864307 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:48.864273    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:48.864814 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:48.864404    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:49.866190 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:49.866164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:49.866617 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:49.866268    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:49.866617 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:49.866321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:49.866617 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:49.866436    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:50.863741 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:50.863714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:50.863897 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:50.863823    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:51.864324 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:51.864290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:51.864890 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:51.864290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:51.864890 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:51.864421    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:51.864890 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:51.864514    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:52.864052 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:52.863749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:52.864162 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:52.864123    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:53.121805 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.121775    2580 generic.go:356] "Generic (PLEG): container finished" podID="acb1a0d2-d48c-42cc-a538-28374ac7d3a1" containerID="c0c8196c8636a80683a177c74d6e732580fa521939f43d561105394870884cdc" exitCode=0
Jul 07 15:29:53.122681 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.121865    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8q26h" event={"ID":"acb1a0d2-d48c-42cc-a538-28374ac7d3a1","Type":"ContainerDied","Data":"c0c8196c8636a80683a177c74d6e732580fa521939f43d561105394870884cdc"}
Jul 07 15:29:53.123330 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.123307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5grmc" event={"ID":"8aa8cab2-ad9a-409e-9cf5-c3649fd592a1","Type":"ContainerStarted","Data":"5b830adeceb74fa2225be6258c4783be030089de008bf87258e1fa156258d1af"}
Jul 07 15:29:53.124959 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.124937    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bxnsr" event={"ID":"4385ed5d-e9b2-4402-bf7c-09c665163bdc","Type":"ContainerStarted","Data":"77d71ed525e52c88e2abc2f44767ed7cedd0d36df966a956c9115751a911ffb3"}
Jul 07 15:29:53.127964 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.127938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"4383a05a89b72d6554f687c103bb0116a2a8683954127025178043a0600e38cd"}
Jul 07 15:29:53.128052 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.128000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"053f94760fa71b1052fabc76eee7415b2c76222147351fb40ffbd69723d60b2f"}
Jul 07 15:29:53.128052 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.128044    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"47481d5a5aec6e26248c0ad4ae6d407a9adc64884d4f79e976d8dcb28ab6a104"}
Jul 07 15:29:53.128135 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.128080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"6645c901cef53728af72060146b578f1cb4b1a663e9b5c81b2a9c042b51da78a"}
Jul 07 15:29:53.128135 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.128110    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"99cd0a0973d8f0d2f2f77d6c7c8a6662fb94089a78a4bbf8c29aad0267c5cbae"}
Jul 07 15:29:53.128240 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.128153    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"da35f73f577571d535cd3f87fa7fb5c30f80d6ad3be26d1c400048321430400f"}
Jul 07 15:29:53.129467 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.129444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks" event={"ID":"7331dee0-ad77-467a-886c-638710632215","Type":"ContainerStarted","Data":"fdc73c2be22d9a786cb7a4a01bb1c6e1535bc7ea2dd1e81c407cde61951e2e74"}
Jul 07 15:29:53.130906 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.130882    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2lfz5" event={"ID":"4656765c-9a3d-4f88-a8e6-c079f87e2d11","Type":"ContainerStarted","Data":"3ab4c12795325766820a15036dfc9c8c6ea89dd1c441fcd1dcfb01937bcbf7f0"}
Jul 07 15:29:53.132307 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.132287    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6bldp" event={"ID":"e8318c5d-53b4-489a-bd64-9e51fc76dc97","Type":"ContainerStarted","Data":"bce4c53c2b51cddca8e792b2105082f60492683f64122a65304a564839c1125a"}
Jul 07 15:29:53.133697 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.133676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5cmnl" event={"ID":"e3087e75-a0cb-4cab-9e40-d2a2140bb8e1","Type":"ContainerStarted","Data":"070bd8e1644b26a6fb5bdc4c534474a8b601e6b16cfb8c61e7a0f813ee98ba7a"}
Jul 07 15:29:53.181454 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.181378    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2lfz5" podStartSLOduration=3.894974931 podStartE2EDuration="23.181363114s" totalImagesPullingTime="19.286388183s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:53.180534359 +0000 UTC m=+23.840238832" watchObservedRunningTime="2026-07-07 15:29:53.181363114 +0000 UTC m=+23.841067587"
Jul 07 15:29:53.200267 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.200221    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bxnsr" podStartSLOduration=8.621000491 podStartE2EDuration="23.200203999s" totalImagesPullingTime="14.579203508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:53.199835277 +0000 UTC m=+23.859539750" watchObservedRunningTime="2026-07-07 15:29:53.200203999 +0000 UTC m=+23.859908472"
Jul 07 15:29:53.242440 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.242396    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5cmnl" podStartSLOduration=4.027844571 podStartE2EDuration="23.24237897s" totalImagesPullingTime="19.214534399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:53.220332258 +0000 UTC m=+23.880036729" watchObservedRunningTime="2026-07-07 15:29:53.24237897 +0000 UTC m=+23.902083425"
Jul 07 15:29:53.264488 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.264441    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5grmc" podStartSLOduration=4.027914409 podStartE2EDuration="23.264425641s" totalImagesPullingTime="19.236511232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:53.243231748 +0000 UTC m=+23.902936220" watchObservedRunningTime="2026-07-07 15:29:53.264425641 +0000 UTC m=+23.924130096"
Jul 07 15:29:53.864147 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.864067    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:53.864390 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:53.864240    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:53.864390 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:53.864286    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:53.864390 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:53.864365    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:54.138480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:54.138371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5nx5" event={"ID":"85e106d4-1e25-4232-8423-93dffba41523","Type":"ContainerStarted","Data":"31482c485fcdbe4713e725be122746873dac4ee6660c8fe0011ea452eebc0b23"}
Jul 07 15:29:54.156318 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:54.156271    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6bldp" podStartSLOduration=4.946150017 podStartE2EDuration="24.156254517s" totalImagesPullingTime="19.2101045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:53.264726005 +0000 UTC m=+23.924430477" watchObservedRunningTime="2026-07-07 15:29:54.156254517 +0000 UTC m=+24.815959035"
Jul 07 15:29:54.499866 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:54.499841    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 15:29:54.844859 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:54.844739    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:29:54.499858856Z","UUID":"bd76f1a6-653c-4624-b959-57aeaf949f49","Handler":null,"Name":"","Endpoint":""}
Jul 07 15:29:54.846379 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:54.846354    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 15:29:54.846500 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:54.846404    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 15:29:54.863916 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:54.863889    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:54.864037 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:54.864021    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:55.144030 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:55.143956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks" event={"ID":"7331dee0-ad77-467a-886c-638710632215","Type":"ContainerStarted","Data":"4ee2de4bccf3eb5a3d9275baee48443843840bd5d6bd63d0d82225e9c9a98409"}
Jul 07 15:29:55.419809 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:55.419729    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:55.420402 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:55.420375    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:55.438884 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:55.438834    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x5nx5" podStartSLOduration=6.219111253 podStartE2EDuration="25.438819869s" totalImagesPullingTime="19.219708616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:54.155986586 +0000 UTC m=+24.815691059" watchObservedRunningTime="2026-07-07 15:29:55.438819869 +0000 UTC m=+26.098524341"
Jul 07 15:29:55.866672 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:55.866647    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:55.866824 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:55.866742    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:55.866869 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:55.866828    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:55.866925 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:55.866909    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:56.149947 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:56.149876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"5d8dab4e4a9c519d0b1e99768757e924e71b6c0e5c7a041fd66492988b80f974"}
Jul 07 15:29:56.150305 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:56.150155    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:56.150757 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:56.150732    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bxnsr"
Jul 07 15:29:56.863638 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:56.863429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:56.863829 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:56.863730    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:57.867210 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:57.867023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:57.867838 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:57.867089    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:57.867838 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:57.867288    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:57.867838 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:57.867360    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:29:58.157953 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.157866    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" event={"ID":"be8d6d9a-6cdc-44ad-9140-3cfa5859a29b","Type":"ContainerStarted","Data":"8ba9b3da25e3308ca449aa8005d2d1af4ab0e3e0bd6bc5b1364486c09f057107"}
Jul 07 15:29:58.158110 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.158095    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:58.160020 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.159985    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks" event={"ID":"7331dee0-ad77-467a-886c-638710632215","Type":"ContainerStarted","Data":"4ec21a762eb0643ab983df12b6bcc0a672fa6fe92c8f97ebe8958c66590d1d77"}
Jul 07 15:29:58.161669 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.161643    2580 generic.go:356] "Generic (PLEG): container finished" podID="acb1a0d2-d48c-42cc-a538-28374ac7d3a1" containerID="80283d4befdba995066394f9eadddb06a28a807267b32feedc61da6a005370dd" exitCode=0
Jul 07 15:29:58.161773 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.161722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8q26h" event={"ID":"acb1a0d2-d48c-42cc-a538-28374ac7d3a1","Type":"ContainerDied","Data":"80283d4befdba995066394f9eadddb06a28a807267b32feedc61da6a005370dd"}
Jul 07 15:29:58.173748 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.173727    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:58.189400 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.189362    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f" podStartSLOduration=8.861787812 podStartE2EDuration="28.189348699s" totalImagesPullingTime="19.327560887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:58.188544313 +0000 UTC m=+28.848248785" watchObservedRunningTime="2026-07-07 15:29:58.189348699 +0000 UTC m=+28.849053172"
Jul 07 15:29:58.261675 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.261606    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfzks" podStartSLOduration=4.207012197 podStartE2EDuration="28.261591558s" totalImagesPullingTime="24.054579361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:29:58.261381235 +0000 UTC m=+28.921085707" watchObservedRunningTime="2026-07-07 15:29:58.261591558 +0000 UTC m=+28.921296030"
Jul 07 15:29:58.863544 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:58.863465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:58.863786 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:58.863599    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:59.164610 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.164544    2580 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 15:29:59.165162 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.165144    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:59.180931 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.180909    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:59.264205 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.264166    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:29:59.744395 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.744322    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-47kps"]
Jul 07 15:29:59.744530 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.744429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:29:59.744565 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:59.744525    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:29:59.746639 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.746593    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lfhlg"]
Jul 07 15:29:59.746774 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.746759    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:29:59.746879 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:59.746856    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:29:59.747171 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.747145    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p58r7"]
Jul 07 15:29:59.747274 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:29:59.747231    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:29:59.747351 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:29:59.747317    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:30:00.168428 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:00.168333    2580 generic.go:356] "Generic (PLEG): container finished" podID="acb1a0d2-d48c-42cc-a538-28374ac7d3a1" containerID="05c2edb5b6741f1819e7034fa13789d166377e7a853d369a61e148fef0a89888" exitCode=0
Jul 07 15:30:00.168865 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:00.168424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8q26h" event={"ID":"acb1a0d2-d48c-42cc-a538-28374ac7d3a1","Type":"ContainerDied","Data":"05c2edb5b6741f1819e7034fa13789d166377e7a853d369a61e148fef0a89888"}
Jul 07 15:30:01.863764 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:01.863570    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:30:01.864254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:01.863648    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:30:01.864254 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:01.863849    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:30:01.864254 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:01.863695    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:30:01.864254 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:01.863908    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:30:01.864254 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:01.864020    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:30:02.174939 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:02.174860    2580 generic.go:356] "Generic (PLEG): container finished" podID="acb1a0d2-d48c-42cc-a538-28374ac7d3a1" containerID="e5bd9d1dff7237294fc1543c7727710152ddcdc0e306a1caac1c1ebce6fbd1db" exitCode=0
Jul 07 15:30:02.174939 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:02.174902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8q26h" event={"ID":"acb1a0d2-d48c-42cc-a538-28374ac7d3a1","Type":"ContainerDied","Data":"e5bd9d1dff7237294fc1543c7727710152ddcdc0e306a1caac1c1ebce6fbd1db"}
Jul 07 15:30:03.530477 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:03.530436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:30:03.531047 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:03.530510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:30:03.531047 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.530601    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:03.531047 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.530663    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:03.531047 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.530692    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs podName:b121c849-7d0f-4ebc-ae16-ee73d3fb0f22 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:35.530675729 +0000 UTC m=+66.190380184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs") pod "network-metrics-daemon-47kps" (UID: "b121c849-7d0f-4ebc-ae16-ee73d3fb0f22") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 15:30:03.531047 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.530717    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret podName:28012edb-db42-4a95-b9f8-b7b4adeee458 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:35.530699416 +0000 UTC m=+66.190403881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret") pod "global-pull-secret-syncer-p58r7" (UID: "28012edb-db42-4a95-b9f8-b7b4adeee458") : object "kube-system"/"original-pull-secret" not registered
Jul 07 15:30:03.631363 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:03.631323    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:30:03.631543 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.631526    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 15:30:03.631637 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.631554    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 15:30:03.631637 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.631569    2580 projected.go:196] Error preparing data for projected volume kube-api-access-9l475 for pod openshift-network-diagnostics/network-check-target-lfhlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:03.631746 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.631665    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475 podName:51fb269e-0f41-4b66-a594-e55e1f50165f nodeName:}" failed. No retries permitted until 2026-07-07 15:30:35.631645022 +0000 UTC m=+66.291349496 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9l475" (UniqueName: "kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475") pod "network-check-target-lfhlg" (UID: "51fb269e-0f41-4b66-a594-e55e1f50165f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 15:30:03.863760 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:03.863675    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:30:03.863967 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:03.863675    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:30:03.863967 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:03.863797    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:30:03.863967 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.863795    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfhlg" podUID="51fb269e-0f41-4b66-a594-e55e1f50165f"
Jul 07 15:30:03.863967 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.863883    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58r7" podUID="28012edb-db42-4a95-b9f8-b7b4adeee458"
Jul 07 15:30:03.864200 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:03.863978    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-47kps" podUID="b121c849-7d0f-4ebc-ae16-ee73d3fb0f22"
Jul 07 15:30:05.163635 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.163532    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-174.ec2.internal" event="NodeReady"
Jul 07 15:30:05.164018 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.163716    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 15:30:05.370927 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.370894    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bpmc4"]
Jul 07 15:30:05.374227 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.374213    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bpmc4"
Jul 07 15:30:05.377723 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.377688    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 15:30:05.377844 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.377782    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 15:30:05.377910 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.377871    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 15:30:05.378939 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.378919    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wwv62"]
Jul 07 15:30:05.378939 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.378938    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bsljb\""
Jul 07 15:30:05.382438 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.382423    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.386203 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.386186    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 15:30:05.386304 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.386210    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 15:30:05.386304 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.386260    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5x8h\""
Jul 07 15:30:05.390564 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.390546    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bpmc4"]
Jul 07 15:30:05.396388 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.396366    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wwv62"]
Jul 07 15:30:05.547841 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.547811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnhgx\" (UniqueName: \"kubernetes.io/projected/f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd-kube-api-access-cnhgx\") pod \"ingress-canary-bpmc4\" (UID: \"f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd\") " pod="openshift-ingress-canary/ingress-canary-bpmc4"
Jul 07 15:30:05.547841 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.547845    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c280db-27d4-4006-9955-6aab96ec62b0-tmp-dir\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.548042 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.547928    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6qp6\" (UniqueName: \"kubernetes.io/projected/41c280db-27d4-4006-9955-6aab96ec62b0-kube-api-access-v6qp6\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.548042 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.547971    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd-cert\") pod \"ingress-canary-bpmc4\" (UID: \"f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd\") " pod="openshift-ingress-canary/ingress-canary-bpmc4"
Jul 07 15:30:05.548042 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.547988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c280db-27d4-4006-9955-6aab96ec62b0-config-volume\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.548042 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.548002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.649213 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.649179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6qp6\" (UniqueName: \"kubernetes.io/projected/41c280db-27d4-4006-9955-6aab96ec62b0-kube-api-access-v6qp6\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.649414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.649255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd-cert\") pod \"ingress-canary-bpmc4\" (UID: \"f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd\") " pod="openshift-ingress-canary/ingress-canary-bpmc4"
Jul 07 15:30:05.649414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.649286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c280db-27d4-4006-9955-6aab96ec62b0-config-volume\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.649414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.649311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.649414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.649338    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnhgx\" (UniqueName: \"kubernetes.io/projected/f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd-kube-api-access-cnhgx\") pod \"ingress-canary-bpmc4\" (UID: \"f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd\") " pod="openshift-ingress-canary/ingress-canary-bpmc4"
Jul 07 15:30:05.649414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.649362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c280db-27d4-4006-9955-6aab96ec62b0-tmp-dir\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.649693 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:05.649661    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:05.649786 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:05.649739    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls podName:41c280db-27d4-4006-9955-6aab96ec62b0 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:06.149719461 +0000 UTC m=+36.809423932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls") pod "dns-default-wwv62" (UID: "41c280db-27d4-4006-9955-6aab96ec62b0") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:05.649853 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.649787    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41c280db-27d4-4006-9955-6aab96ec62b0-tmp-dir\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.650115 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.650084    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/41c280db-27d4-4006-9955-6aab96ec62b0-config-volume\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.653881 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.653862    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd-cert\") pod \"ingress-canary-bpmc4\" (UID: \"f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd\") " pod="openshift-ingress-canary/ingress-canary-bpmc4"
Jul 07 15:30:05.658822 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.658805    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6qp6\" (UniqueName: \"kubernetes.io/projected/41c280db-27d4-4006-9955-6aab96ec62b0-kube-api-access-v6qp6\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:05.660568 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.660546    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnhgx\" (UniqueName: \"kubernetes.io/projected/f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd-kube-api-access-cnhgx\") pod \"ingress-canary-bpmc4\" (UID: \"f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd\") " pod="openshift-ingress-canary/ingress-canary-bpmc4"
Jul 07 15:30:05.683898 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.683872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bpmc4"
Jul 07 15:30:05.832253 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.832146    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bpmc4"]
Jul 07 15:30:05.835403 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:30:05.835378    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0dd55d9_5dcf_4d65_9d23_a3a6bc25ebfd.slice/crio-4d2e742755e6d0316b5fa5c91ec721762fd28ad9ad67d0708f763e9aae32be99 WatchSource:0}: Error finding container 4d2e742755e6d0316b5fa5c91ec721762fd28ad9ad67d0708f763e9aae32be99: Status 404 returned error can't find the container with id 4d2e742755e6d0316b5fa5c91ec721762fd28ad9ad67d0708f763e9aae32be99
Jul 07 15:30:05.866886 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.866862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:30:05.867029 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.866862    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:30:05.867029 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.866867    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:30:05.873910 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.873892    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:30:05.874039 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.873983    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:30:05.874263 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.874244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gdm6d\""
Jul 07 15:30:05.874383 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.874270    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:30:05.874953 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.874936    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:30:05.875164 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:05.875142    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pzwr\""
Jul 07 15:30:06.153488 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:06.153404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:06.153694 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:06.153550    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:06.153694 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:06.153634    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls podName:41c280db-27d4-4006-9955-6aab96ec62b0 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:07.153598796 +0000 UTC m=+37.813303268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls") pod "dns-default-wwv62" (UID: "41c280db-27d4-4006-9955-6aab96ec62b0") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:06.185012 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:06.184976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bpmc4" event={"ID":"f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd","Type":"ContainerStarted","Data":"4d2e742755e6d0316b5fa5c91ec721762fd28ad9ad67d0708f763e9aae32be99"}
Jul 07 15:30:07.160833 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:07.160793    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:07.161024 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:07.160943    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:07.161024 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:07.161012    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls podName:41c280db-27d4-4006-9955-6aab96ec62b0 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:09.160992311 +0000 UTC m=+39.820696774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls") pod "dns-default-wwv62" (UID: "41c280db-27d4-4006-9955-6aab96ec62b0") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:09.179448 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:09.179415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:09.179894 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:09.179528    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:09.179894 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:09.179586    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls podName:41c280db-27d4-4006-9955-6aab96ec62b0 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:13.179569471 +0000 UTC m=+43.839273940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls") pod "dns-default-wwv62" (UID: "41c280db-27d4-4006-9955-6aab96ec62b0") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:10.195688 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:10.195648    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bpmc4" event={"ID":"f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd","Type":"ContainerStarted","Data":"663ac03924ad6404826b16f86bbdca860f49e3f16db6c522152457f808e9d74f"}
Jul 07 15:30:10.198112 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:10.198088    2580 generic.go:356] "Generic (PLEG): container finished" podID="acb1a0d2-d48c-42cc-a538-28374ac7d3a1" containerID="1450f1a76d36e0648d8f23661120d3dffa931865e2994589f92521530cb27e90" exitCode=0
Jul 07 15:30:10.198214 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:10.198121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8q26h" event={"ID":"acb1a0d2-d48c-42cc-a538-28374ac7d3a1","Type":"ContainerDied","Data":"1450f1a76d36e0648d8f23661120d3dffa931865e2994589f92521530cb27e90"}
Jul 07 15:30:10.217717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:10.217674    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bpmc4" podStartSLOduration=1.7923333339999998 podStartE2EDuration="5.217660217s" totalImagesPullingTime="3.425326883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:10.217530406 +0000 UTC m=+40.877234878" watchObservedRunningTime="2026-07-07 15:30:10.217660217 +0000 UTC m=+40.877364692"
Jul 07 15:30:11.203204 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:11.203158    2580 generic.go:356] "Generic (PLEG): container finished" podID="acb1a0d2-d48c-42cc-a538-28374ac7d3a1" containerID="0633817ae0054a19ea20cbfedf7597174f396bc2d4614d1d29efd352bb6e565c" exitCode=0
Jul 07 15:30:11.203606 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:11.203255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8q26h" event={"ID":"acb1a0d2-d48c-42cc-a538-28374ac7d3a1","Type":"ContainerDied","Data":"0633817ae0054a19ea20cbfedf7597174f396bc2d4614d1d29efd352bb6e565c"}
Jul 07 15:30:12.208642 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:12.208596    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8q26h" event={"ID":"acb1a0d2-d48c-42cc-a538-28374ac7d3a1","Type":"ContainerStarted","Data":"7211976f0d23f1a039dc65a9dc73691e6d9abd157e8af068aed83b42535ec4d5"}
Jul 07 15:30:12.238531 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:12.238478    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8q26h" podStartSLOduration=9.126547339 podStartE2EDuration="42.238461688s" totalImagesPullingTime="33.111914349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:12.236068668 +0000 UTC m=+42.895773164" watchObservedRunningTime="2026-07-07 15:30:12.238461688 +0000 UTC m=+42.898166160"
Jul 07 15:30:13.206956 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:13.206917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:13.207133 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:13.207049    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:13.207133 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:13.207113    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls podName:41c280db-27d4-4006-9955-6aab96ec62b0 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:21.20709858 +0000 UTC m=+51.866803031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls") pod "dns-default-wwv62" (UID: "41c280db-27d4-4006-9955-6aab96ec62b0") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:21.259815 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:21.259783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:21.260284 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:21.259941    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:21.260284 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:21.260002    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls podName:41c280db-27d4-4006-9955-6aab96ec62b0 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:37.259987937 +0000 UTC m=+67.919692387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls") pod "dns-default-wwv62" (UID: "41c280db-27d4-4006-9955-6aab96ec62b0") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:31.186077 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:31.186045    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6pr4f"
Jul 07 15:30:35.561149 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.561108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:30:35.561557 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.561162    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:30:35.566493 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.566472    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 15:30:35.566599 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.566583    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 15:30:35.571406 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:35.571391    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 15:30:35.571469 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:35.571458    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs podName:b121c849-7d0f-4ebc-ae16-ee73d3fb0f22 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:39.571435933 +0000 UTC m=+130.231140388 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs") pod "network-metrics-daemon-47kps" (UID: "b121c849-7d0f-4ebc-ae16-ee73d3fb0f22") : secret "metrics-daemon-secret" not found
Jul 07 15:30:35.574535 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.574515    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/28012edb-db42-4a95-b9f8-b7b4adeee458-original-pull-secret\") pod \"global-pull-secret-syncer-p58r7\" (UID: \"28012edb-db42-4a95-b9f8-b7b4adeee458\") " pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:30:35.587838 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.587802    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58r7"
Jul 07 15:30:35.661830 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.661795    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:30:35.666673 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.666642    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 15:30:35.674727 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.674703    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 15:30:35.685819 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.685792    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l475\" (UniqueName: \"kubernetes.io/projected/51fb269e-0f41-4b66-a594-e55e1f50165f-kube-api-access-9l475\") pod \"network-check-target-lfhlg\" (UID: \"51fb269e-0f41-4b66-a594-e55e1f50165f\") " pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:30:35.706472 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.706446    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p58r7"]
Jul 07 15:30:35.710151 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:30:35.710124    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28012edb_db42_4a95_b9f8_b7b4adeee458.slice/crio-806eae08c2ee6f240fb35977d411bfa1893a340f0c11318678ba817a077be404 WatchSource:0}: Error finding container 806eae08c2ee6f240fb35977d411bfa1893a340f0c11318678ba817a077be404: Status 404 returned error can't find the container with id 806eae08c2ee6f240fb35977d411bfa1893a340f0c11318678ba817a077be404
Jul 07 15:30:35.885851 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.885775    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gdm6d\""
Jul 07 15:30:35.894009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:35.893975    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:30:36.018263 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:36.018232    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lfhlg"]
Jul 07 15:30:36.021706 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:30:36.021680    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fb269e_0f41_4b66_a594_e55e1f50165f.slice/crio-2d4042dcfd856b27897b63053abe850586415948ed156775d2a374abd19ea2fa WatchSource:0}: Error finding container 2d4042dcfd856b27897b63053abe850586415948ed156775d2a374abd19ea2fa: Status 404 returned error can't find the container with id 2d4042dcfd856b27897b63053abe850586415948ed156775d2a374abd19ea2fa
Jul 07 15:30:36.262844 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:36.262805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lfhlg" event={"ID":"51fb269e-0f41-4b66-a594-e55e1f50165f","Type":"ContainerStarted","Data":"2d4042dcfd856b27897b63053abe850586415948ed156775d2a374abd19ea2fa"}
Jul 07 15:30:36.264010 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:36.263979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p58r7" event={"ID":"28012edb-db42-4a95-b9f8-b7b4adeee458","Type":"ContainerStarted","Data":"806eae08c2ee6f240fb35977d411bfa1893a340f0c11318678ba817a077be404"}
Jul 07 15:30:37.273746 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:37.273708    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:30:37.274193 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:37.273875    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 15:30:37.274193 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:37.273943    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls podName:41c280db-27d4-4006-9955-6aab96ec62b0 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:09.273920237 +0000 UTC m=+99.933624688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls") pod "dns-default-wwv62" (UID: "41c280db-27d4-4006-9955-6aab96ec62b0") : secret "dns-default-metrics-tls" not found
Jul 07 15:30:41.279132 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:41.279099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lfhlg" event={"ID":"51fb269e-0f41-4b66-a594-e55e1f50165f","Type":"ContainerStarted","Data":"3d09d42a93fe6b52c01a036bc8cccc8fcdf6503499aa5ed31ac4f3ff50f55bf6"}
Jul 07 15:30:41.279595 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:41.279177    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:30:41.280514 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:41.280491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p58r7" event={"ID":"28012edb-db42-4a95-b9f8-b7b4adeee458","Type":"ContainerStarted","Data":"c814142e8f444401f571b46252f05a8dae97a9c824514e2dc18a52259cba1264"}
Jul 07 15:30:41.296812 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:41.296765    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lfhlg" podStartSLOduration=66.673494565 podStartE2EDuration="1m11.296748233s" totalImagesPullingTime="4.623253668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:41.296269882 +0000 UTC m=+71.955974356" watchObservedRunningTime="2026-07-07 15:30:41.296748233 +0000 UTC m=+71.956452707"
Jul 07 15:30:41.316362 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:41.316315    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p58r7" podStartSLOduration=66.378246485 podStartE2EDuration="1m11.316299869s" totalImagesPullingTime="4.938053384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:41.3161324 +0000 UTC m=+71.975836873" watchObservedRunningTime="2026-07-07 15:30:41.316299869 +0000 UTC m=+71.976004342"
Jul 07 15:30:44.428026 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.427992    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq"]
Jul 07 15:30:44.429773 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.429758    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq"
Jul 07 15:30:44.432688 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.432667    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:30:44.433056 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.433039    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 07 15:30:44.433510 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.433494    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vn98r\""
Jul 07 15:30:44.446650 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.446609    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq"]
Jul 07 15:30:44.525679 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.525617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8ltx\" (UniqueName: \"kubernetes.io/projected/e9f85275-b570-4e72-bdb7-ec498d2a8a8c-kube-api-access-n8ltx\") pod \"volume-data-source-validator-5d456fdbcd-z9njq\" (UID: \"e9f85275-b570-4e72-bdb7-ec498d2a8a8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq"
Jul 07 15:30:44.585815 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.585776    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"]
Jul 07 15:30:44.587758 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.587742    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d58c4c7f5-2kjt4"]
Jul 07 15:30:44.587899 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.587881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.589438 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.589419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.593765 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.593740    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 07 15:30:44.593898 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.593780    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 07 15:30:44.593898 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.593889    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 07 15:30:44.594153 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.594104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 07 15:30:44.594300 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.594282    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 15:30:44.594381 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.594309    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 15:30:44.594447 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.594435    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pgb7s\""
Jul 07 15:30:44.594560 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.594545    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wwv9f\""
Jul 07 15:30:44.595440 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.595422    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 15:30:44.601967 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.601950    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 15:30:44.605248 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.605229    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"]
Jul 07 15:30:44.612451 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.612427    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d58c4c7f5-2kjt4"]
Jul 07 15:30:44.626349 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626329    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.626455 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-994d4\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-kube-api-access-994d4\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.626455 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fda9cf6e-4c79-4819-afb5-4ef963451ef2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.626455 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626401    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-certificates\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.626455 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626449    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbd7c\" (UniqueName: \"kubernetes.io/projected/fda9cf6e-4c79-4819-afb5-4ef963451ef2-kube-api-access-fbd7c\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.626596 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fda9cf6e-4c79-4819-afb5-4ef963451ef2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.626596 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-image-registry-private-configuration\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.626596 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5111a0d-ae73-46b5-a757-553c0459f5f6-ca-trust-extracted\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.626596 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-installation-pull-secrets\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.626754 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8ltx\" (UniqueName: \"kubernetes.io/projected/e9f85275-b570-4e72-bdb7-ec498d2a8a8c-kube-api-access-n8ltx\") pod \"volume-data-source-validator-5d456fdbcd-z9njq\" (UID: \"e9f85275-b570-4e72-bdb7-ec498d2a8a8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq"
Jul 07 15:30:44.626754 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-bound-sa-token\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.626754 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.626680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-trusted-ca\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.640010 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.639990    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8ltx\" (UniqueName: \"kubernetes.io/projected/e9f85275-b570-4e72-bdb7-ec498d2a8a8c-kube-api-access-n8ltx\") pod \"volume-data-source-validator-5d456fdbcd-z9njq\" (UID: \"e9f85275-b570-4e72-bdb7-ec498d2a8a8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq"
Jul 07 15:30:44.727776 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.727740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fda9cf6e-4c79-4819-afb5-4ef963451ef2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.727951 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.727791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-certificates\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.727951 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.727814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbd7c\" (UniqueName: \"kubernetes.io/projected/fda9cf6e-4c79-4819-afb5-4ef963451ef2-kube-api-access-fbd7c\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.727951 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.727855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fda9cf6e-4c79-4819-afb5-4ef963451ef2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.727951 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.727873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-image-registry-private-configuration\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.727951 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.727888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5111a0d-ae73-46b5-a757-553c0459f5f6-ca-trust-extracted\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.727951 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.727908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-installation-pull-secrets\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.727951 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.727943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-bound-sa-token\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.728317 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.728231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-trusted-ca\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.728317 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.728275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.728317 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.728303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-994d4\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-kube-api-access-994d4\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.728464 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.728352    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5111a0d-ae73-46b5-a757-553c0459f5f6-ca-trust-extracted\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.728522 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.728478    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fda9cf6e-4c79-4819-afb5-4ef963451ef2-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.728641 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:44.728604    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:30:44.728641 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.728614    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-certificates\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.728795 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:44.728643    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d58c4c7f5-2kjt4: secret "image-registry-tls" not found
Jul 07 15:30:44.728795 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:44.728772    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls podName:d5111a0d-ae73-46b5-a757-553c0459f5f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:45.228738925 +0000 UTC m=+75.888443378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls") pod "image-registry-d58c4c7f5-2kjt4" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6") : secret "image-registry-tls" not found
Jul 07 15:30:44.729480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.729460    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-trusted-ca\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.730338 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.730313    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fda9cf6e-4c79-4819-afb5-4ef963451ef2-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.730790 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.730771    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-image-registry-private-configuration\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.730869 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.730815    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-installation-pull-secrets\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.738771 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.738751    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq"
Jul 07 15:30:44.742319 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.742298    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbd7c\" (UniqueName: \"kubernetes.io/projected/fda9cf6e-4c79-4819-afb5-4ef963451ef2-kube-api-access-fbd7c\") pod \"kube-storage-version-migrator-operator-846bf668f7-6lt9s\" (UID: \"fda9cf6e-4c79-4819-afb5-4ef963451ef2\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.742814 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.742795    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-994d4\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-kube-api-access-994d4\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.745184 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.745167    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-bound-sa-token\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:44.748806 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.748615    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-75ff8cd87-5nrxd"]
Jul 07 15:30:44.755778 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.755752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.758404 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.758380    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 15:30:44.758675 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.758655    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 15:30:44.758802 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.758719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vmmdc\""
Jul 07 15:30:44.759014 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.758930    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 15:30:44.759014 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.758969    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 15:30:44.759014 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.758993    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 15:30:44.759261 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.759245    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 15:30:44.766422 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.766398    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75ff8cd87-5nrxd"]
Jul 07 15:30:44.829109 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.829077    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.829260 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.829115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxvd4\" (UniqueName: \"kubernetes.io/projected/e205b4d7-91a7-442e-b6af-1bad9c0736d4-kube-api-access-xxvd4\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.829260 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.829149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-default-certificate\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.829260 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.829170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.829260 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.829191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-stats-auth\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.864758 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.864595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq"]
Jul 07 15:30:44.867126 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:30:44.867103    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f85275_b570_4e72_bdb7_ec498d2a8a8c.slice/crio-acc91e2942accfd38a2b77688482b4e31dace22617f503c9a5c70690149829fb WatchSource:0}: Error finding container acc91e2942accfd38a2b77688482b4e31dace22617f503c9a5c70690149829fb: Status 404 returned error can't find the container with id acc91e2942accfd38a2b77688482b4e31dace22617f503c9a5c70690149829fb
Jul 07 15:30:44.897517 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.897492    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"
Jul 07 15:30:44.929877 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.929845    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.930043 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.929890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxvd4\" (UniqueName: \"kubernetes.io/projected/e205b4d7-91a7-442e-b6af-1bad9c0736d4-kube-api-access-xxvd4\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.930043 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:44.929985    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 15:30:44.930153 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.930052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-default-certificate\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.930153 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:44.930069    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:45.430046548 +0000 UTC m=+76.089751015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : secret "router-metrics-certs-default" not found
Jul 07 15:30:44.930153 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.930107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.930153 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.930137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-stats-auth\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.930328 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:44.930242    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:45.430221272 +0000 UTC m=+76.089925729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : configmap references non-existent config key: service-ca.crt
Jul 07 15:30:44.932403 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.932383    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-default-certificate\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.932639 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.932595    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-stats-auth\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:44.939395 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:44.939369    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxvd4\" (UniqueName: \"kubernetes.io/projected/e205b4d7-91a7-442e-b6af-1bad9c0736d4-kube-api-access-xxvd4\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:45.021870 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:45.021794    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s"]
Jul 07 15:30:45.024858 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:30:45.024831    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda9cf6e_4c79_4819_afb5_4ef963451ef2.slice/crio-9927855c78609412e70afbee350a28ea3b695810a736e376c62768655335ca62 WatchSource:0}: Error finding container 9927855c78609412e70afbee350a28ea3b695810a736e376c62768655335ca62: Status 404 returned error can't find the container with id 9927855c78609412e70afbee350a28ea3b695810a736e376c62768655335ca62
Jul 07 15:30:45.233404 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:45.233369    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:45.233573 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:45.233526    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:30:45.233573 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:45.233547    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d58c4c7f5-2kjt4: secret "image-registry-tls" not found
Jul 07 15:30:45.233667 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:45.233604    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls podName:d5111a0d-ae73-46b5-a757-553c0459f5f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:46.233585678 +0000 UTC m=+76.893290128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls") pod "image-registry-d58c4c7f5-2kjt4" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6") : secret "image-registry-tls" not found
Jul 07 15:30:45.292578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:45.292484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s" event={"ID":"fda9cf6e-4c79-4819-afb5-4ef963451ef2","Type":"ContainerStarted","Data":"9927855c78609412e70afbee350a28ea3b695810a736e376c62768655335ca62"}
Jul 07 15:30:45.293459 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:45.293438    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq" event={"ID":"e9f85275-b570-4e72-bdb7-ec498d2a8a8c","Type":"ContainerStarted","Data":"acc91e2942accfd38a2b77688482b4e31dace22617f503c9a5c70690149829fb"}
Jul 07 15:30:45.434711 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:45.434678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:45.435117 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:45.434731    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:45.435117 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:45.434832    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 15:30:45.435117 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:45.434852    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:46.434838078 +0000 UTC m=+77.094542529 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : configmap references non-existent config key: service-ca.crt
Jul 07 15:30:45.435117 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:45.434886    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:46.434873076 +0000 UTC m=+77.094577526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : secret "router-metrics-certs-default" not found
Jul 07 15:30:46.241363 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:46.241326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:46.241561 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:46.241473    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:30:46.241561 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:46.241488    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d58c4c7f5-2kjt4: secret "image-registry-tls" not found
Jul 07 15:30:46.241561 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:46.241544    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls podName:d5111a0d-ae73-46b5-a757-553c0459f5f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:48.241525991 +0000 UTC m=+78.901230442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls") pod "image-registry-d58c4c7f5-2kjt4" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6") : secret "image-registry-tls" not found
Jul 07 15:30:46.443219 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:46.443176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:46.443606 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:46.443291    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:46.443606 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:46.443366    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:48.443343107 +0000 UTC m=+79.103047571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : configmap references non-existent config key: service-ca.crt
Jul 07 15:30:46.443606 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:46.443415    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 15:30:46.443606 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:46.443477    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:48.443460636 +0000 UTC m=+79.103165099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : secret "router-metrics-certs-default" not found
Jul 07 15:30:47.301181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:47.301139    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq" event={"ID":"e9f85275-b570-4e72-bdb7-ec498d2a8a8c","Type":"ContainerStarted","Data":"94f8b2789ebc70682adc573a4efc633b9d5c5db1dd18e313f9a55a719632f933"}
Jul 07 15:30:47.335064 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:47.335016    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-z9njq" podStartSLOduration=1.535279616 podStartE2EDuration="3.334997035s" totalImagesPullingTime="1.799717419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:47.33439544 +0000 UTC m=+77.994099915" watchObservedRunningTime="2026-07-07 15:30:47.334997035 +0000 UTC m=+77.994701508"
Jul 07 15:30:48.259317 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:48.259280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:48.259735 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:48.259410    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:30:48.259735 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:48.259423    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d58c4c7f5-2kjt4: secret "image-registry-tls" not found
Jul 07 15:30:48.259735 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:48.259474    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls podName:d5111a0d-ae73-46b5-a757-553c0459f5f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:52.259457199 +0000 UTC m=+82.919161651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls") pod "image-registry-d58c4c7f5-2kjt4" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6") : secret "image-registry-tls" not found
Jul 07 15:30:48.305305 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:48.305272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s" event={"ID":"fda9cf6e-4c79-4819-afb5-4ef963451ef2","Type":"ContainerStarted","Data":"71537deead9a2bb1894ed8ed1a580ed45acfb658c1d8860c96f68ec0b155deb5"}
Jul 07 15:30:48.323243 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:48.323186    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s" podStartSLOduration=1.836115903 podStartE2EDuration="4.323165027s" totalImagesPullingTime="2.487049124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:48.322271735 +0000 UTC m=+78.981976211" watchObservedRunningTime="2026-07-07 15:30:48.323165027 +0000 UTC m=+78.982869502"
Jul 07 15:30:48.461509 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:48.461474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:48.461684 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:48.461564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:48.461849 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:48.461667    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:52.461646085 +0000 UTC m=+83.121350555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : configmap references non-existent config key: service-ca.crt
Jul 07 15:30:48.465141 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:48.462063    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 15:30:48.465141 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:48.462139    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:30:52.462122441 +0000 UTC m=+83.121826913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : secret "router-metrics-certs-default" not found
Jul 07 15:30:49.542063 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.542029    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hq8kc"]
Jul 07 15:30:49.543941 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.543926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.546635 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.546600    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 15:30:49.547058 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.547039    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 15:30:49.547716 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.547691    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r642f\""
Jul 07 15:30:49.548059 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.548038    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 15:30:49.548300 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.548281    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 15:30:49.568672 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.568615    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hq8kc"]
Jul 07 15:30:49.671923 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.671886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnx4h\" (UniqueName: \"kubernetes.io/projected/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-api-access-gnx4h\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.672146 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.671941    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68fef6e3-1771-4d75-b2f1-2b904a415c1c-data-volume\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.672146 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.672007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.672146 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.672053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68fef6e3-1771-4d75-b2f1-2b904a415c1c-crio-socket\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.672146 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.672081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.772838 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.772806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnx4h\" (UniqueName: \"kubernetes.io/projected/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-api-access-gnx4h\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.773042 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.772879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68fef6e3-1771-4d75-b2f1-2b904a415c1c-data-volume\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.773042 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.773034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.773168 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.773084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68fef6e3-1771-4d75-b2f1-2b904a415c1c-crio-socket\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.773168 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.773112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.773168 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:49.773143    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:49.773321 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.773198    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68fef6e3-1771-4d75-b2f1-2b904a415c1c-crio-socket\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.773321 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:49.773215    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:30:50.273194409 +0000 UTC m=+80.932898869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:49.773321 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.773215    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68fef6e3-1771-4d75-b2f1-2b904a415c1c-data-volume\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:49.773321 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:49.773222    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:49.773321 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:49.773296    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:30:50.273278 +0000 UTC m=+80.932982466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:49.783801 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:49.783778    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnx4h\" (UniqueName: \"kubernetes.io/projected/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-api-access-gnx4h\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:50.277120 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:50.277083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:50.277300 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:50.277142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:50.277300 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:50.277199    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:50.277300 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:50.277228    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:50.277300 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:50.277268    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:30:51.277250572 +0000 UTC m=+81.936955022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:50.277300 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:50.277282    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:30:51.277276112 +0000 UTC m=+81.936980563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:51.285248 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:51.285199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:51.285763 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:51.285330    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:51.285763 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:51.285371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:51.285763 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:51.285400    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:30:53.285381681 +0000 UTC m=+83.945086132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:51.285763 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:51.285478    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:51.285763 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:51.285524    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:30:53.285512956 +0000 UTC m=+83.945217412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:51.352603 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:51.352577    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bldp_e8318c5d-53b4-489a-bd64-9e51fc76dc97/dns-node-resolver/0.log"
Jul 07 15:30:52.292613 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:52.292484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:30:52.293001 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:52.292678    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:30:52.293001 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:52.292697    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d58c4c7f5-2kjt4: secret "image-registry-tls" not found
Jul 07 15:30:52.293001 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:52.292754    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls podName:d5111a0d-ae73-46b5-a757-553c0459f5f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:00.292738906 +0000 UTC m=+90.952443358 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls") pod "image-registry-d58c4c7f5-2kjt4" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6") : secret "image-registry-tls" not found
Jul 07 15:30:52.352572 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:52.352545    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5cmnl_e3087e75-a0cb-4cab-9e40-d2a2140bb8e1/node-ca/0.log"
Jul 07 15:30:52.494573 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:52.494540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:52.494775 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:52.494599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:30:52.494775 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:52.494666    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 15:30:52.494775 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:52.494748    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:00.494726223 +0000 UTC m=+91.154430674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : secret "router-metrics-certs-default" not found
Jul 07 15:30:52.494775 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:52.494765    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:00.494758204 +0000 UTC m=+91.154462695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : configmap references non-existent config key: service-ca.crt
Jul 07 15:30:53.160004 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:53.159978    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bpmc4_f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd/serve-healthcheck-canary/0.log"
Jul 07 15:30:53.300809 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:53.300758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:53.301194 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:53.300855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:53.301194 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:53.300917    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:53.301194 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:53.300981    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:30:57.300965245 +0000 UTC m=+87.960669696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:53.301194 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:53.300921    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:53.301194 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:53.301050    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:30:57.301035899 +0000 UTC m=+87.960740368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:54.761499 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.761464    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7vmjg"]
Jul 07 15:30:54.765766 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.765750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.768064 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.768041    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 15:30:54.768195 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.768134    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qk2sq\""
Jul 07 15:30:54.768195 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.768145    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 15:30:54.768944 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.768918    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 15:30:54.769042 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.769000    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 15:30:54.775232 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.775205    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7vmjg"]
Jul 07 15:30:54.813927 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.813899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a0dfa21d-5ade-48cc-8448-4bb8c8669496-signing-key\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.813927 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.813935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a0dfa21d-5ade-48cc-8448-4bb8c8669496-signing-cabundle\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.814116 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.813970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lgvp\" (UniqueName: \"kubernetes.io/projected/a0dfa21d-5ade-48cc-8448-4bb8c8669496-kube-api-access-2lgvp\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.915220 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.915189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a0dfa21d-5ade-48cc-8448-4bb8c8669496-signing-key\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.915220 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.915225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a0dfa21d-5ade-48cc-8448-4bb8c8669496-signing-cabundle\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.915461 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.915247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lgvp\" (UniqueName: \"kubernetes.io/projected/a0dfa21d-5ade-48cc-8448-4bb8c8669496-kube-api-access-2lgvp\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.915986 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.915959    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a0dfa21d-5ade-48cc-8448-4bb8c8669496-signing-cabundle\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.917508 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.917491    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a0dfa21d-5ade-48cc-8448-4bb8c8669496-signing-key\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:54.924456 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:54.924427    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lgvp\" (UniqueName: \"kubernetes.io/projected/a0dfa21d-5ade-48cc-8448-4bb8c8669496-kube-api-access-2lgvp\") pod \"service-ca-758f599c5-7vmjg\" (UID: \"a0dfa21d-5ade-48cc-8448-4bb8c8669496\") " pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:55.074515 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:55.074415    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-7vmjg"
Jul 07 15:30:55.200036 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:55.200000    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-7vmjg"]
Jul 07 15:30:55.202861 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:30:55.202833    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0dfa21d_5ade_48cc_8448_4bb8c8669496.slice/crio-1edff47ef8b74acc8e21bdcfd8231f5136eee540e82cea39444b8357ed0afa5a WatchSource:0}: Error finding container 1edff47ef8b74acc8e21bdcfd8231f5136eee540e82cea39444b8357ed0afa5a: Status 404 returned error can't find the container with id 1edff47ef8b74acc8e21bdcfd8231f5136eee540e82cea39444b8357ed0afa5a
Jul 07 15:30:55.323590 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:55.323556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7vmjg" event={"ID":"a0dfa21d-5ade-48cc-8448-4bb8c8669496","Type":"ContainerStarted","Data":"1edff47ef8b74acc8e21bdcfd8231f5136eee540e82cea39444b8357ed0afa5a"}
Jul 07 15:30:57.338210 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:57.338180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:57.338647 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:57.338236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:30:57.338647 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:57.338333    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 15:30:57.338647 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:57.338360    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:57.338647 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:57.338406    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:31:05.338389797 +0000 UTC m=+95.998094265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:30:57.338647 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:30:57.338446    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:31:05.338414373 +0000 UTC m=+95.998118827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : configmap "kube-rbac-proxy" not found
Jul 07 15:30:58.333772 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:58.333679    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-7vmjg" event={"ID":"a0dfa21d-5ade-48cc-8448-4bb8c8669496","Type":"ContainerStarted","Data":"3821b8f97b6078799110f03cbd8ba6bad63b8b9e62966124b680e6ffa3ea11f8"}
Jul 07 15:30:58.352144 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:30:58.352095    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-7vmjg" podStartSLOduration=1.615761394 podStartE2EDuration="4.352081182s" totalImagesPullingTime="2.736319788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:30:58.350989579 +0000 UTC m=+89.010694053" watchObservedRunningTime="2026-07-07 15:30:58.352081182 +0000 UTC m=+89.011785705"
Jul 07 15:31:00.361573 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:00.361540    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:31:00.361981 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:00.361718    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 15:31:00.361981 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:00.361739    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d58c4c7f5-2kjt4: secret "image-registry-tls" not found
Jul 07 15:31:00.361981 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:00.361794    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls podName:d5111a0d-ae73-46b5-a757-553c0459f5f6 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:16.361779608 +0000 UTC m=+107.021484059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls") pod "image-registry-d58c4c7f5-2kjt4" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6") : secret "image-registry-tls" not found
Jul 07 15:31:00.562744 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:00.562691    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:00.562934 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:00.562823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:00.562934 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:00.562878    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:16.562853534 +0000 UTC m=+107.222557984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : configmap references non-existent config key: service-ca.crt
Jul 07 15:31:00.562934 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:00.562927    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 15:31:00.563045 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:00.562976    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs podName:e205b4d7-91a7-442e-b6af-1bad9c0736d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:31:16.562964918 +0000 UTC m=+107.222669383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs") pod "router-default-75ff8cd87-5nrxd" (UID: "e205b4d7-91a7-442e-b6af-1bad9c0736d4") : secret "router-metrics-certs-default" not found
Jul 07 15:31:05.402493 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:05.402452    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:31:05.403033 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:05.402517    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:31:05.403033 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:05.402619    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 15:31:05.403033 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:05.402695    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls podName:68fef6e3-1771-4d75-b2f1-2b904a415c1c nodeName:}" failed. No retries permitted until 2026-07-07 15:31:21.402678594 +0000 UTC m=+112.062383047 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hq8kc" (UID: "68fef6e3-1771-4d75-b2f1-2b904a415c1c") : secret "insights-runtime-extractor-tls" not found
Jul 07 15:31:05.403205 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:05.403146    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68fef6e3-1771-4d75-b2f1-2b904a415c1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:31:09.334751 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:09.334707    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:31:09.337035 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:09.337011    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/41c280db-27d4-4006-9955-6aab96ec62b0-metrics-tls\") pod \"dns-default-wwv62\" (UID: \"41c280db-27d4-4006-9955-6aab96ec62b0\") " pod="openshift-dns/dns-default-wwv62"
Jul 07 15:31:09.596998 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:09.596964    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j5x8h\""
Jul 07 15:31:09.601316 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:09.601300    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wwv62"
Jul 07 15:31:09.733640 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:09.733594    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wwv62"]
Jul 07 15:31:09.737499 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:09.737471    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c280db_27d4_4006_9955_6aab96ec62b0.slice/crio-e556934d8f896a3a3d829f18a1bc9b35344afb28af569d43c0a21f1fcd8563f0 WatchSource:0}: Error finding container e556934d8f896a3a3d829f18a1bc9b35344afb28af569d43c0a21f1fcd8563f0: Status 404 returned error can't find the container with id e556934d8f896a3a3d829f18a1bc9b35344afb28af569d43c0a21f1fcd8563f0
Jul 07 15:31:10.372241 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:10.372195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wwv62" event={"ID":"41c280db-27d4-4006-9955-6aab96ec62b0","Type":"ContainerStarted","Data":"e556934d8f896a3a3d829f18a1bc9b35344afb28af569d43c0a21f1fcd8563f0"}
Jul 07 15:31:12.286821 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:12.286791    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lfhlg"
Jul 07 15:31:12.379639 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:12.379601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wwv62" event={"ID":"41c280db-27d4-4006-9955-6aab96ec62b0","Type":"ContainerStarted","Data":"8237c74cfa82d1663539a965f3532f7e13340d5057724dfc9d43919dbdff98bf"}
Jul 07 15:31:12.379816 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:12.379666    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wwv62" event={"ID":"41c280db-27d4-4006-9955-6aab96ec62b0","Type":"ContainerStarted","Data":"b2d49c707c20af289a17fbcf4fe6689bdf6a54009d6f80a0d25f45c485151ee3"}
Jul 07 15:31:12.379892 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:12.379873    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wwv62"
Jul 07 15:31:12.398927 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:12.398884    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wwv62" podStartSLOduration=65.637515239 podStartE2EDuration="1m7.398868564s" totalImagesPullingTime="1.761353325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:12.398487242 +0000 UTC m=+103.058191714" watchObservedRunningTime="2026-07-07 15:31:12.398868564 +0000 UTC m=+103.058573036"
Jul 07 15:31:16.371178 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.371147    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d58c4c7f5-2kjt4"]
Jul 07 15:31:16.371540 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:16.371366    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4" podUID="d5111a0d-ae73-46b5-a757-553c0459f5f6"
Jul 07 15:31:16.371872 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.371853    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-ztkbk"]
Jul 07 15:31:16.374493 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.374478    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-ztkbk"
Jul 07 15:31:16.376942 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.376919    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zkqvq\""
Jul 07 15:31:16.377152 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.377134    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 15:31:16.377410 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.377395    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 15:31:16.389761 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.389734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:31:16.390836 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.390767    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-ztkbk"]
Jul 07 15:31:16.392573 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.392545    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"image-registry-d58c4c7f5-2kjt4\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") " pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:31:16.392682 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.392618    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:31:16.401679 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.401661    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:31:16.466967 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.466935    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f46669b9c-9wfkh"]
Jul 07 15:31:16.468969 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.468953    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.481684 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.481655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f46669b9c-9wfkh"]
Jul 07 15:31:16.490418 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490391    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") pod \"d5111a0d-ae73-46b5-a757-553c0459f5f6\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") "
Jul 07 15:31:16.490546 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490450    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-certificates\") pod \"d5111a0d-ae73-46b5-a757-553c0459f5f6\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") "
Jul 07 15:31:16.490546 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490482    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-trusted-ca\") pod \"d5111a0d-ae73-46b5-a757-553c0459f5f6\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") "
Jul 07 15:31:16.490685 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490665    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-installation-pull-secrets\") pod \"d5111a0d-ae73-46b5-a757-553c0459f5f6\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") "
Jul 07 15:31:16.490726 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490707    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-994d4\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-kube-api-access-994d4\") pod \"d5111a0d-ae73-46b5-a757-553c0459f5f6\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") "
Jul 07 15:31:16.490759 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490733    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-image-registry-private-configuration\") pod \"d5111a0d-ae73-46b5-a757-553c0459f5f6\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") "
Jul 07 15:31:16.490759 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490753    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5111a0d-ae73-46b5-a757-553c0459f5f6-ca-trust-extracted\") pod \"d5111a0d-ae73-46b5-a757-553c0459f5f6\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") "
Jul 07 15:31:16.490820 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490803    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-bound-sa-token\") pod \"d5111a0d-ae73-46b5-a757-553c0459f5f6\" (UID: \"d5111a0d-ae73-46b5-a757-553c0459f5f6\") "
Jul 07 15:31:16.490908 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.490895    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjmcb\" (UniqueName: \"kubernetes.io/projected/59f503f1-32fe-49a0-942b-4d12350aab73-kube-api-access-cjmcb\") pod \"downloads-685bfb5f64-ztkbk\" (UID: \"59f503f1-32fe-49a0-942b-4d12350aab73\") " pod="openshift-console/downloads-685bfb5f64-ztkbk"
Jul 07 15:31:16.492974 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.492941    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5111a0d-ae73-46b5-a757-553c0459f5f6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d5111a0d-ae73-46b5-a757-553c0459f5f6" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:31:16.493079 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.492978    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d5111a0d-ae73-46b5-a757-553c0459f5f6" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:31:16.493079 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.492993    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d5111a0d-ae73-46b5-a757-553c0459f5f6" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:31:16.494725 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.494691    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d5111a0d-ae73-46b5-a757-553c0459f5f6" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:31:16.495085 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.495054    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d5111a0d-ae73-46b5-a757-553c0459f5f6" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:31:16.495085 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.495069    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d5111a0d-ae73-46b5-a757-553c0459f5f6" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:31:16.495233 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.495173    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-kube-api-access-994d4" (OuterVolumeSpecName: "kube-api-access-994d4") pod "d5111a0d-ae73-46b5-a757-553c0459f5f6" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6"). InnerVolumeSpecName "kube-api-access-994d4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:31:16.495233 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.495195    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d5111a0d-ae73-46b5-a757-553c0459f5f6" (UID: "d5111a0d-ae73-46b5-a757-553c0459f5f6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:31:16.591608 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxh4p\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-kube-api-access-vxh4p\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.591608 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591608    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-registry-tls\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.591847 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjmcb\" (UniqueName: \"kubernetes.io/projected/59f503f1-32fe-49a0-942b-4d12350aab73-kube-api-access-cjmcb\") pod \"downloads-685bfb5f64-ztkbk\" (UID: \"59f503f1-32fe-49a0-942b-4d12350aab73\") " pod="openshift-console/downloads-685bfb5f64-ztkbk"
Jul 07 15:31:16.591847 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27268000-74bd-4300-a746-8560bba1b8ad-installation-pull-secrets\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.591847 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591722    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:16.591847 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27268000-74bd-4300-a746-8560bba1b8ad-registry-certificates\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.591847 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27268000-74bd-4300-a746-8560bba1b8ad-image-registry-private-configuration\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.591847 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:16.591847 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27268000-74bd-4300-a746-8560bba1b8ad-trusted-ca\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27268000-74bd-4300-a746-8560bba1b8ad-ca-trust-extracted\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-bound-sa-token\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591941    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-installation-pull-secrets\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591977    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-994d4\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-kube-api-access-994d4\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591988    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5111a0d-ae73-46b5-a757-553c0459f5f6-image-registry-private-configuration\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.591997    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5111a0d-ae73-46b5-a757-553c0459f5f6-ca-trust-extracted\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.592010    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-bound-sa-token\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.592023    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-tls\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.592033    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-registry-certificates\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:31:16.592098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.592042    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5111a0d-ae73-46b5-a757-553c0459f5f6-trusted-ca\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:31:16.592423 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.592402    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e205b4d7-91a7-442e-b6af-1bad9c0736d4-service-ca-bundle\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:16.594178 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.594153    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e205b4d7-91a7-442e-b6af-1bad9c0736d4-metrics-certs\") pod \"router-default-75ff8cd87-5nrxd\" (UID: \"e205b4d7-91a7-442e-b6af-1bad9c0736d4\") " pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:16.609026 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.608994    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjmcb\" (UniqueName: \"kubernetes.io/projected/59f503f1-32fe-49a0-942b-4d12350aab73-kube-api-access-cjmcb\") pod \"downloads-685bfb5f64-ztkbk\" (UID: \"59f503f1-32fe-49a0-942b-4d12350aab73\") " pod="openshift-console/downloads-685bfb5f64-ztkbk"
Jul 07 15:31:16.683052 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.682961    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-ztkbk"
Jul 07 15:31:16.692796 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.692687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27268000-74bd-4300-a746-8560bba1b8ad-trusted-ca\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.692796 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.692738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27268000-74bd-4300-a746-8560bba1b8ad-ca-trust-extracted\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.692796 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.692765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-bound-sa-token\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.693009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.692797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxh4p\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-kube-api-access-vxh4p\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.693009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.692835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-registry-tls\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.693009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.692884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27268000-74bd-4300-a746-8560bba1b8ad-installation-pull-secrets\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.693009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.692950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27268000-74bd-4300-a746-8560bba1b8ad-registry-certificates\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.693009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.692987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27268000-74bd-4300-a746-8560bba1b8ad-image-registry-private-configuration\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.693277 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.693152    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/27268000-74bd-4300-a746-8560bba1b8ad-ca-trust-extracted\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.693702 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.693678    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/27268000-74bd-4300-a746-8560bba1b8ad-registry-certificates\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.693863 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.693835    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/27268000-74bd-4300-a746-8560bba1b8ad-trusted-ca\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.695933 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.695900    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-registry-tls\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.696035 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.695985    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/27268000-74bd-4300-a746-8560bba1b8ad-image-registry-private-configuration\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.696035 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.696004    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/27268000-74bd-4300-a746-8560bba1b8ad-installation-pull-secrets\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.705015 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.704996    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-bound-sa-token\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.712021 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.711989    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxh4p\" (UniqueName: \"kubernetes.io/projected/27268000-74bd-4300-a746-8560bba1b8ad-kube-api-access-vxh4p\") pod \"image-registry-7f46669b9c-9wfkh\" (UID: \"27268000-74bd-4300-a746-8560bba1b8ad\") " pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.781062 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.781005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:16.832100 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.832012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-ztkbk"]
Jul 07 15:31:16.860811 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:16.860772    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f503f1_32fe_49a0_942b_4d12350aab73.slice/crio-c5c9af1200c40063200e572a9fef43036396d264a9244f3d93c8030620289788 WatchSource:0}: Error finding container c5c9af1200c40063200e572a9fef43036396d264a9244f3d93c8030620289788: Status 404 returned error can't find the container with id c5c9af1200c40063200e572a9fef43036396d264a9244f3d93c8030620289788
Jul 07 15:31:16.866110 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.866086    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:16.931776 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:16.931746    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f46669b9c-9wfkh"]
Jul 07 15:31:16.934566 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:16.934537    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27268000_74bd_4300_a746_8560bba1b8ad.slice/crio-98d392bd361d931adb9601608a0c47365347e9cf30b62ea51dd2a2f92ac21917 WatchSource:0}: Error finding container 98d392bd361d931adb9601608a0c47365347e9cf30b62ea51dd2a2f92ac21917: Status 404 returned error can't find the container with id 98d392bd361d931adb9601608a0c47365347e9cf30b62ea51dd2a2f92ac21917
Jul 07 15:31:17.026119 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.026097    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-75ff8cd87-5nrxd"]
Jul 07 15:31:17.029592 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:17.029566    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode205b4d7_91a7_442e_b6af_1bad9c0736d4.slice/crio-5828aaf592a938d9c677966c097883b7f98239db48897fb6f96d2d16d148a6d9 WatchSource:0}: Error finding container 5828aaf592a938d9c677966c097883b7f98239db48897fb6f96d2d16d148a6d9: Status 404 returned error can't find the container with id 5828aaf592a938d9c677966c097883b7f98239db48897fb6f96d2d16d148a6d9
Jul 07 15:31:17.397604 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.397504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh" event={"ID":"27268000-74bd-4300-a746-8560bba1b8ad","Type":"ContainerStarted","Data":"9b07dd9abc0f20d70830d5920a07ebc994d3222531b241d956bdb6e2acc51064"}
Jul 07 15:31:17.397604 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.397571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh" event={"ID":"27268000-74bd-4300-a746-8560bba1b8ad","Type":"ContainerStarted","Data":"98d392bd361d931adb9601608a0c47365347e9cf30b62ea51dd2a2f92ac21917"}
Jul 07 15:31:17.397604 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.397597    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:17.399116 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.399086    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75ff8cd87-5nrxd" event={"ID":"e205b4d7-91a7-442e-b6af-1bad9c0736d4","Type":"ContainerStarted","Data":"108dca07293422002b849565d6ce0fc7b2d04bcfb70801ac22c2eae21109699c"}
Jul 07 15:31:17.399239 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.399130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-75ff8cd87-5nrxd" event={"ID":"e205b4d7-91a7-442e-b6af-1bad9c0736d4","Type":"ContainerStarted","Data":"5828aaf592a938d9c677966c097883b7f98239db48897fb6f96d2d16d148a6d9"}
Jul 07 15:31:17.400332 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.400312    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d58c4c7f5-2kjt4"
Jul 07 15:31:17.400436 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.400335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-ztkbk" event={"ID":"59f503f1-32fe-49a0-942b-4d12350aab73","Type":"ContainerStarted","Data":"c5c9af1200c40063200e572a9fef43036396d264a9244f3d93c8030620289788"}
Jul 07 15:31:17.423024 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.422984    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh" podStartSLOduration=1.422969116 podStartE2EDuration="1.422969116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:17.422719142 +0000 UTC m=+108.082423616" watchObservedRunningTime="2026-07-07 15:31:17.422969116 +0000 UTC m=+108.082673589"
Jul 07 15:31:17.457929 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.457901    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d58c4c7f5-2kjt4"]
Jul 07 15:31:17.462878 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.462852    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d58c4c7f5-2kjt4"]
Jul 07 15:31:17.494167 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.494116    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-75ff8cd87-5nrxd" podStartSLOduration=33.494102085 podStartE2EDuration="33.494102085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:17.493486813 +0000 UTC m=+108.153191288" watchObservedRunningTime="2026-07-07 15:31:17.494102085 +0000 UTC m=+108.153806536"
Jul 07 15:31:17.867472 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.867438    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5111a0d-ae73-46b5-a757-553c0459f5f6" path="/var/lib/kubelet/pods/d5111a0d-ae73-46b5-a757-553c0459f5f6/volumes"
Jul 07 15:31:17.867648 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.867592    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:17.868909 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:17.868886    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:18.403419 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.403385    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:18.404668 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.404648    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-75ff8cd87-5nrxd"
Jul 07 15:31:18.594711 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.594674    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f6bf88d-whfbc"]
Jul 07 15:31:18.596729 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.596710    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.599009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.598986    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 15:31:18.599138 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.599047    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 15:31:18.599138 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.599055    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 15:31:18.599372 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.599348    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4k9pt\""
Jul 07 15:31:18.599489 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.599402    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 15:31:18.599489 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.599454    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 15:31:18.609632 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.609510    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f6bf88d-whfbc"]
Jul 07 15:31:18.710741 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.710703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-oauth-serving-cert\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.710741 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.710748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-serving-cert\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.710993 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.710836    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-config\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.710993 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.710880    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-service-ca\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.711095 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.710999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slxx9\" (UniqueName: \"kubernetes.io/projected/5e75eda5-866b-490d-ad3c-44dec079ac3f-kube-api-access-slxx9\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.711095 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.711044    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-oauth-config\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.812261 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.812221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-oauth-serving-cert\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.812261 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.812264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-serving-cert\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.812500 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.812294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-config\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.812500 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.812348    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-service-ca\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.812500 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.812412    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slxx9\" (UniqueName: \"kubernetes.io/projected/5e75eda5-866b-490d-ad3c-44dec079ac3f-kube-api-access-slxx9\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.812500 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.812435    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-oauth-config\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.813079 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.813049    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-service-ca\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.813079 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.813064    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-oauth-serving-cert\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.813230 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.813065    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-config\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.815032 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.815011    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-serving-cert\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.815032 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.815027    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-oauth-config\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.821692 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.821673    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slxx9\" (UniqueName: \"kubernetes.io/projected/5e75eda5-866b-490d-ad3c-44dec079ac3f-kube-api-access-slxx9\") pod \"console-54f6bf88d-whfbc\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") " pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:18.907055 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:18.907015    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:19.036540 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:19.036508    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f6bf88d-whfbc"]
Jul 07 15:31:19.039761 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:19.039727    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e75eda5_866b_490d_ad3c_44dec079ac3f.slice/crio-71a3c72323825e3f42a103bbece05b8135255fd1021133bd9a834e0a15d2fcf5 WatchSource:0}: Error finding container 71a3c72323825e3f42a103bbece05b8135255fd1021133bd9a834e0a15d2fcf5: Status 404 returned error can't find the container with id 71a3c72323825e3f42a103bbece05b8135255fd1021133bd9a834e0a15d2fcf5
Jul 07 15:31:19.408355 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:19.408262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f6bf88d-whfbc" event={"ID":"5e75eda5-866b-490d-ad3c-44dec079ac3f","Type":"ContainerStarted","Data":"71a3c72323825e3f42a103bbece05b8135255fd1021133bd9a834e0a15d2fcf5"}
Jul 07 15:31:19.903079 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:19.903050    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"]
Jul 07 15:31:19.905280 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:19.905254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"
Jul 07 15:31:19.907828 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:19.907570    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 15:31:19.907937 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:19.907848    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jm4fb\""
Jul 07 15:31:19.917329 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:19.917307    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"]
Jul 07 15:31:20.022707 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:20.022665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/94a095ee-6fd6-432a-ad04-30e8ec90765d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fnkzk\" (UID: \"94a095ee-6fd6-432a-ad04-30e8ec90765d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"
Jul 07 15:31:20.123515 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:20.123483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/94a095ee-6fd6-432a-ad04-30e8ec90765d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fnkzk\" (UID: \"94a095ee-6fd6-432a-ad04-30e8ec90765d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"
Jul 07 15:31:20.126275 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:20.126250    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/94a095ee-6fd6-432a-ad04-30e8ec90765d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fnkzk\" (UID: \"94a095ee-6fd6-432a-ad04-30e8ec90765d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"
Jul 07 15:31:20.218557 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:20.218510    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"
Jul 07 15:31:20.401244 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:20.401213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"]
Jul 07 15:31:20.404454 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:20.404429    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a095ee_6fd6_432a_ad04_30e8ec90765d.slice/crio-107e65eaa0e0bbed3266a191e861313015d81c1f4765aef3eb1cad6744fa3a2e WatchSource:0}: Error finding container 107e65eaa0e0bbed3266a191e861313015d81c1f4765aef3eb1cad6744fa3a2e: Status 404 returned error can't find the container with id 107e65eaa0e0bbed3266a191e861313015d81c1f4765aef3eb1cad6744fa3a2e
Jul 07 15:31:20.413496 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:20.413465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk" event={"ID":"94a095ee-6fd6-432a-ad04-30e8ec90765d","Type":"ContainerStarted","Data":"107e65eaa0e0bbed3266a191e861313015d81c1f4765aef3eb1cad6744fa3a2e"}
Jul 07 15:31:21.433299 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:21.433264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:31:21.435902 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:21.435871    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68fef6e3-1771-4d75-b2f1-2b904a415c1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hq8kc\" (UID: \"68fef6e3-1771-4d75-b2f1-2b904a415c1c\") " pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:31:21.653060 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:21.653027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hq8kc"
Jul 07 15:31:22.385173 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:22.385145    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wwv62"
Jul 07 15:31:22.856196 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:22.856164    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hq8kc"]
Jul 07 15:31:23.429707 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:23.429154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk" event={"ID":"94a095ee-6fd6-432a-ad04-30e8ec90765d","Type":"ContainerStarted","Data":"7e4eb9616b9a639dd95be96039f4449fac8772cf6fd109a10e22103b15a88dd8"}
Jul 07 15:31:23.430010 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:23.429946    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"
Jul 07 15:31:23.433933 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:23.433420    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f6bf88d-whfbc" event={"ID":"5e75eda5-866b-490d-ad3c-44dec079ac3f","Type":"ContainerStarted","Data":"2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac"}
Jul 07 15:31:23.436643 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:23.436306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hq8kc" event={"ID":"68fef6e3-1771-4d75-b2f1-2b904a415c1c","Type":"ContainerStarted","Data":"b0b014b02cee9e927e13137848cadf51287d6e8dcc444b6cad7df11515224f56"}
Jul 07 15:31:23.436643 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:23.436554    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk"
Jul 07 15:31:23.449148 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:23.449000    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnkzk" podStartSLOduration=2.164101105 podStartE2EDuration="4.448980663s" totalImagesPullingTime="2.284879558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:23.447937543 +0000 UTC m=+114.107642016" watchObservedRunningTime="2026-07-07 15:31:23.448980663 +0000 UTC m=+114.108685117"
Jul 07 15:31:23.473324 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:23.473049    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f6bf88d-whfbc" podStartSLOduration=1.8234239749999999 podStartE2EDuration="5.473029434s" totalImagesPullingTime="3.649605459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:23.472205215 +0000 UTC m=+114.131909690" watchObservedRunningTime="2026-07-07 15:31:23.473029434 +0000 UTC m=+114.132733909"
Jul 07 15:31:24.023642 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.023595    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"]
Jul 07 15:31:24.026953 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.026904    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.031214 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.031011    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 15:31:24.031965 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.031942    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 15:31:24.032185 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.032167    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 15:31:24.032308 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.032258    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-gswkg\""
Jul 07 15:31:24.033073 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.032867    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 15:31:24.033073 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.032869    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 15:31:24.042460 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.042438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"]
Jul 07 15:31:24.161079 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.161032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.161246 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.161086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.161246 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.161194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.161367 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.161243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt8p6\" (UniqueName: \"kubernetes.io/projected/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-kube-api-access-vt8p6\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.261876 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.261831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.262071 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.261889    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.262071 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.261939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.262071 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.261985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt8p6\" (UniqueName: \"kubernetes.io/projected/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-kube-api-access-vt8p6\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.262422 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:24.262401    2580 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 07 15:31:24.262482 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:31:24.262468    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-tls podName:da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a nodeName:}" failed. No retries permitted until 2026-07-07 15:31:24.762449448 +0000 UTC m=+115.422153905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-d9brj" (UID: "da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a") : secret "prometheus-operator-tls" not found
Jul 07 15:31:24.262818 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.262771    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.266034 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.266008    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.274276 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.274198    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt8p6\" (UniqueName: \"kubernetes.io/projected/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-kube-api-access-vt8p6\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.766163 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.766120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.768996 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.768967    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-d9brj\" (UID: \"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:24.940016 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:24.939978    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"
Jul 07 15:31:26.911181 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:26.911155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj"]
Jul 07 15:31:26.915235 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:26.915197    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4f57c5_27fc_4937_b8d9_a0cbfa3cee4a.slice/crio-d13fa16d8ee5866ead468bb2af1d3ef74a4967dfb5c2929c1f15a967e1ccdce5 WatchSource:0}: Error finding container d13fa16d8ee5866ead468bb2af1d3ef74a4967dfb5c2929c1f15a967e1ccdce5: Status 404 returned error can't find the container with id d13fa16d8ee5866ead468bb2af1d3ef74a4967dfb5c2929c1f15a967e1ccdce5
Jul 07 15:31:27.193786 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.193754    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84b9cc8878-f4vcm"]
Jul 07 15:31:27.197082 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.197062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.206111 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.206072    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 15:31:27.217847 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.217824    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b9cc8878-f4vcm"]
Jul 07 15:31:27.285258 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.285216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-oauth-serving-cert\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.285444 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.285267    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-service-ca\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.285444 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.285356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-serving-cert\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.285551 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.285443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qktjg\" (UniqueName: \"kubernetes.io/projected/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-kube-api-access-qktjg\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.285551 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.285495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-oauth-config\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.285682 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.285578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-config\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.285682 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.285607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-trusted-ca-bundle\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.386715 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.386680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-config\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.386715 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.386718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-trusted-ca-bundle\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.386956 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.386754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-oauth-serving-cert\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.386956 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.386796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-service-ca\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.386956 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.386817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-serving-cert\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.386956 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.386857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qktjg\" (UniqueName: \"kubernetes.io/projected/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-kube-api-access-qktjg\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.386956 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.386899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-oauth-config\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.387613 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.387585    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-config\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.387613 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.387606    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-service-ca\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.387805 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.387707    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-oauth-serving-cert\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.387805 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.387777    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-trusted-ca-bundle\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.389369 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.389342    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-oauth-config\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.389465 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.389400    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-serving-cert\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.398761 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.398735    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qktjg\" (UniqueName: \"kubernetes.io/projected/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-kube-api-access-qktjg\") pod \"console-84b9cc8878-f4vcm\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") " pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.454125 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.454020    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hq8kc" event={"ID":"68fef6e3-1771-4d75-b2f1-2b904a415c1c","Type":"ContainerStarted","Data":"6b77cfd5bda378ce6c47d0b977fb055103973e36b51d0bb5f0c9eae5b9c660e6"}
Jul 07 15:31:27.455116 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.455092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj" event={"ID":"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a","Type":"ContainerStarted","Data":"d13fa16d8ee5866ead468bb2af1d3ef74a4967dfb5c2929c1f15a967e1ccdce5"}
Jul 07 15:31:27.507838 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.507800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:27.688830 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:27.688760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84b9cc8878-f4vcm"]
Jul 07 15:31:27.744312 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:27.744220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a59c6a6_b468_4d36_9f11_97e407dd8a4e.slice/crio-6a8fdfdf76a72f1bd3e903f94b62973bcd5e3a735ca069e5977e11a2d1a90d5d WatchSource:0}: Error finding container 6a8fdfdf76a72f1bd3e903f94b62973bcd5e3a735ca069e5977e11a2d1a90d5d: Status 404 returned error can't find the container with id 6a8fdfdf76a72f1bd3e903f94b62973bcd5e3a735ca069e5977e11a2d1a90d5d
Jul 07 15:31:28.462251 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:28.462219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hq8kc" event={"ID":"68fef6e3-1771-4d75-b2f1-2b904a415c1c","Type":"ContainerStarted","Data":"67dcda1db477fd710028e2704258c400f21f002fc4bb5bb48f590f37fbfb34fa"}
Jul 07 15:31:28.464087 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:28.464055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b9cc8878-f4vcm" event={"ID":"0a59c6a6-b468-4d36-9f11-97e407dd8a4e","Type":"ContainerStarted","Data":"9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd"}
Jul 07 15:31:28.464210 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:28.464109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b9cc8878-f4vcm" event={"ID":"0a59c6a6-b468-4d36-9f11-97e407dd8a4e","Type":"ContainerStarted","Data":"6a8fdfdf76a72f1bd3e903f94b62973bcd5e3a735ca069e5977e11a2d1a90d5d"}
Jul 07 15:31:28.486858 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:28.486808    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84b9cc8878-f4vcm" podStartSLOduration=1.486787044 podStartE2EDuration="1.486787044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:28.484482121 +0000 UTC m=+119.144186594" watchObservedRunningTime="2026-07-07 15:31:28.486787044 +0000 UTC m=+119.146491495"
Jul 07 15:31:28.907767 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:28.907724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:28.907966 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:28.907805    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:28.913995 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:28.913967    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:29.469558 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:29.469519    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj" event={"ID":"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a","Type":"ContainerStarted","Data":"a59f61dc5073e8353402a8ca4e26ffce714d622c0bbcf2bb0b95fc343e2021da"}
Jul 07 15:31:29.470019 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:29.469616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj" event={"ID":"da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a","Type":"ContainerStarted","Data":"7b753a2f7bd1082d3e884fec040db3490c41dc81b65fb348dcf178e8b2369780"}
Jul 07 15:31:29.473489 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:29.473470    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:31:29.494224 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:29.494163    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-d9brj" podStartSLOduration=3.976432007 podStartE2EDuration="5.494007567s" totalImagesPullingTime="1.51757556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:29.493915555 +0000 UTC m=+120.153620031" watchObservedRunningTime="2026-07-07 15:31:29.494007567 +0000 UTC m=+120.153712040"
Jul 07 15:31:31.482882 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.482839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hq8kc" event={"ID":"68fef6e3-1771-4d75-b2f1-2b904a415c1c","Type":"ContainerStarted","Data":"8c939d97a97a6bd84297286b2dfaf52788d45683d5dff1c2c1238c6d22a446c6"}
Jul 07 15:31:31.520724 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.520661    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hq8kc" podStartSLOduration=34.869992352 podStartE2EDuration="42.52063923s" totalImagesPullingTime="7.650646878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:30:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:31.518111479 +0000 UTC m=+122.177815955" watchObservedRunningTime="2026-07-07 15:31:31.52063923 +0000 UTC m=+122.180343695"
Jul 07 15:31:31.536058 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.536023    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"]
Jul 07 15:31:31.539613 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.539576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.540294 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.540268    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dlf8t"]
Jul 07 15:31:31.543156 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.543134    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7qh44\""
Jul 07 15:31:31.543427 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.543408    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 07 15:31:31.544073 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.543739    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.544073 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.543871    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 07 15:31:31.544073 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.543886    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 07 15:31:31.547142 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.546995    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 15:31:31.547142 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.547008    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 15:31:31.547142 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.547074    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-k8qcf\""
Jul 07 15:31:31.553347 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.553327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 15:31:31.564049 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.564024    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"]
Jul 07 15:31:31.624536 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.624753 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbr8q\" (UniqueName: \"kubernetes.io/projected/5e851d72-b01c-4905-90fa-a8701998e57b-kube-api-access-bbr8q\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.624753 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc74221f-165b-4c98-9ca9-a877492a6358-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.624753 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc74221f-165b-4c98-9ca9-a877492a6358-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.624753 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sf2d\" (UniqueName: \"kubernetes.io/projected/bc74221f-165b-4c98-9ca9-a877492a6358-kube-api-access-9sf2d\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.624753 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e851d72-b01c-4905-90fa-a8701998e57b-metrics-client-ca\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.624753 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624702    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.625038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-tls\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.625038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624831    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-textfile\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.625038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-wtmp\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.625038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-sys\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.625038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-root\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.625038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.625038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.624997    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.625038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.625035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.726428 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-sys\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.726428 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-root\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726451    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726503    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726516    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-root\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726516    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-sys\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbr8q\" (UniqueName: \"kubernetes.io/projected/5e851d72-b01c-4905-90fa-a8701998e57b-kube-api-access-bbr8q\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc74221f-165b-4c98-9ca9-a877492a6358-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc74221f-165b-4c98-9ca9-a877492a6358-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sf2d\" (UniqueName: \"kubernetes.io/projected/bc74221f-165b-4c98-9ca9-a877492a6358-kube-api-access-9sf2d\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.726717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e851d72-b01c-4905-90fa-a8701998e57b-metrics-client-ca\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.727414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.727414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-tls\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.727414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-textfile\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.727414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.726902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-wtmp\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.727414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.727088    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-wtmp\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.727414 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.727332    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bc74221f-165b-4c98-9ca9-a877492a6358-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.727741 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.727670    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.728652 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.727922    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e851d72-b01c-4905-90fa-a8701998e57b-metrics-client-ca\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.728652 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.727957    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-textfile\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.728652 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.728556    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc74221f-165b-4c98-9ca9-a877492a6358-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.729283 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.729241    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.729490 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.729470    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.729568 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.729515    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.729736 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.729714    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bc74221f-165b-4c98-9ca9-a877492a6358-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.730382 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.730363    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5e851d72-b01c-4905-90fa-a8701998e57b-node-exporter-tls\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.737665 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.737562    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbr8q\" (UniqueName: \"kubernetes.io/projected/5e851d72-b01c-4905-90fa-a8701998e57b-kube-api-access-bbr8q\") pod \"node-exporter-dlf8t\" (UID: \"5e851d72-b01c-4905-90fa-a8701998e57b\") " pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.737836 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.737816    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sf2d\" (UniqueName: \"kubernetes.io/projected/bc74221f-165b-4c98-9ca9-a877492a6358-kube-api-access-9sf2d\") pod \"kube-state-metrics-7c9dbb8b7d-7mv7g\" (UID: \"bc74221f-165b-4c98-9ca9-a877492a6358\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.852121 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.852084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"
Jul 07 15:31:31.859331 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:31.859303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlf8t"
Jul 07 15:31:31.880796 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:31.880753    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e851d72_b01c_4905_90fa_a8701998e57b.slice/crio-ce0ea0da3d6adcdf4aad39b6237f366bb918fc859268a644177c2dd16340f9a1 WatchSource:0}: Error finding container ce0ea0da3d6adcdf4aad39b6237f366bb918fc859268a644177c2dd16340f9a1: Status 404 returned error can't find the container with id ce0ea0da3d6adcdf4aad39b6237f366bb918fc859268a644177c2dd16340f9a1
Jul 07 15:31:32.074713 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:32.074657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g"]
Jul 07 15:31:32.077161 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:32.077129    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc74221f_165b_4c98_9ca9_a877492a6358.slice/crio-0084cfd5e6d6a07bfd5f00ab830733eac81552f9dffc572908bd202e4e281b84 WatchSource:0}: Error finding container 0084cfd5e6d6a07bfd5f00ab830733eac81552f9dffc572908bd202e4e281b84: Status 404 returned error can't find the container with id 0084cfd5e6d6a07bfd5f00ab830733eac81552f9dffc572908bd202e4e281b84
Jul 07 15:31:32.489104 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:32.489063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g" event={"ID":"bc74221f-165b-4c98-9ca9-a877492a6358","Type":"ContainerStarted","Data":"0084cfd5e6d6a07bfd5f00ab830733eac81552f9dffc572908bd202e4e281b84"}
Jul 07 15:31:32.490568 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:32.490539    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlf8t" event={"ID":"5e851d72-b01c-4905-90fa-a8701998e57b","Type":"ContainerStarted","Data":"ce0ea0da3d6adcdf4aad39b6237f366bb918fc859268a644177c2dd16340f9a1"}
Jul 07 15:31:33.497936 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.497853    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlf8t" event={"ID":"5e851d72-b01c-4905-90fa-a8701998e57b","Type":"ContainerStarted","Data":"702fc561ca708f3a8551c01c2f64d03a80a41c6fd52717ee0ae954d952990327"}
Jul 07 15:31:33.742534 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.742500    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"]
Jul 07 15:31:33.748451 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.748391    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.753926 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.753765    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 07 15:31:33.753926 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.753779    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 07 15:31:33.753926 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.753885    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-250b3aagsj11f\""
Jul 07 15:31:33.754204 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.754188    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cv5tt\""
Jul 07 15:31:33.754797 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.754713    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 07 15:31:33.754797 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.754735    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 07 15:31:33.755517 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.755482    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 07 15:31:33.779035 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.778985    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"]
Jul 07 15:31:33.847952 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.847919    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-tls\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.847952 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.847953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-grpc-tls\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.848184 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.848002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.848184 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.848030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962513c6-ffa3-4de8-bfff-a8f550b8fc32-metrics-client-ca\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.848184 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.848059    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.848184 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.848089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.848184 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.848163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.848184 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.848180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngwg9\" (UniqueName: \"kubernetes.io/projected/962513c6-ffa3-4de8-bfff-a8f550b8fc32-kube-api-access-ngwg9\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.948865 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.948825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-tls\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.949280 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.948864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-grpc-tls\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.949280 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.948924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.949280 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.948954    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962513c6-ffa3-4de8-bfff-a8f550b8fc32-metrics-client-ca\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.949280 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.948991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.949280 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.949028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.949280 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.949102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.949280 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.949130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngwg9\" (UniqueName: \"kubernetes.io/projected/962513c6-ffa3-4de8-bfff-a8f550b8fc32-kube-api-access-ngwg9\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.950403 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.950346    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/962513c6-ffa3-4de8-bfff-a8f550b8fc32-metrics-client-ca\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.952884 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.952836    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.953453 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.953425    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.953592 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.953546    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-grpc-tls\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.954064 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.954043    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.954155 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.954088    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-tls\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.955961 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.955925    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/962513c6-ffa3-4de8-bfff-a8f550b8fc32-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:33.965829 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:33.965790    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngwg9\" (UniqueName: \"kubernetes.io/projected/962513c6-ffa3-4de8-bfff-a8f550b8fc32-kube-api-access-ngwg9\") pod \"thanos-querier-5c8f4cd699-5f25g\" (UID: \"962513c6-ffa3-4de8-bfff-a8f550b8fc32\") " pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:34.060910 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.060815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:34.228156 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.228124    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"]
Jul 07 15:31:34.231053 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:34.231029    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod962513c6_ffa3_4de8_bfff_a8f550b8fc32.slice/crio-f59b5669a7566ddc4c022305668444a11d676add7756b9c0e9a39c7ee709e11b WatchSource:0}: Error finding container f59b5669a7566ddc4c022305668444a11d676add7756b9c0e9a39c7ee709e11b: Status 404 returned error can't find the container with id f59b5669a7566ddc4c022305668444a11d676add7756b9c0e9a39c7ee709e11b
Jul 07 15:31:34.503801 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.503754    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g" event={"ID":"962513c6-ffa3-4de8-bfff-a8f550b8fc32","Type":"ContainerStarted","Data":"f59b5669a7566ddc4c022305668444a11d676add7756b9c0e9a39c7ee709e11b"}
Jul 07 15:31:34.505526 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.505493    2580 generic.go:356] "Generic (PLEG): container finished" podID="5e851d72-b01c-4905-90fa-a8701998e57b" containerID="702fc561ca708f3a8551c01c2f64d03a80a41c6fd52717ee0ae954d952990327" exitCode=0
Jul 07 15:31:34.505680 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.505581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlf8t" event={"ID":"5e851d72-b01c-4905-90fa-a8701998e57b","Type":"ContainerDied","Data":"702fc561ca708f3a8551c01c2f64d03a80a41c6fd52717ee0ae954d952990327"}
Jul 07 15:31:34.508490 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.508471    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g" event={"ID":"bc74221f-165b-4c98-9ca9-a877492a6358","Type":"ContainerStarted","Data":"5c82c61a20c043f5b251aa783b8211e649dc19753225711a812e18ea4dc75d81"}
Jul 07 15:31:34.508596 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.508523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g" event={"ID":"bc74221f-165b-4c98-9ca9-a877492a6358","Type":"ContainerStarted","Data":"5b5fd18f3472f5a27881c5e8e55d7a4700899abc7764747d282c7a66abe9f4c7"}
Jul 07 15:31:34.508596 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.508554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g" event={"ID":"bc74221f-165b-4c98-9ca9-a877492a6358","Type":"ContainerStarted","Data":"130a4b8076f19ad057adb92174bd7f1de746592057c1548d838f44f95a6f3d43"}
Jul 07 15:31:34.552087 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:34.552033    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-7mv7g" podStartSLOduration=2.014037264 podStartE2EDuration="3.552011368s" totalImagesPullingTime="1.537974104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:34.551469879 +0000 UTC m=+125.211174352" watchObservedRunningTime="2026-07-07 15:31:34.552011368 +0000 UTC m=+125.211715842"
Jul 07 15:31:35.517039 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:35.516995    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlf8t" event={"ID":"5e851d72-b01c-4905-90fa-a8701998e57b","Type":"ContainerStarted","Data":"109fdbf66ca7a2e32f38800a9e54a71cf5377f95e6df4787792fdcca7de7320f"}
Jul 07 15:31:35.517519 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:35.517073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlf8t" event={"ID":"5e851d72-b01c-4905-90fa-a8701998e57b","Type":"ContainerStarted","Data":"e019b0509a1dc31c9b4ae2ba69afc51035e14cec6a0ffa53748d0e8f9ce2ec3d"}
Jul 07 15:31:35.543294 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:35.543234    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dlf8t" podStartSLOduration=3.247039029 podStartE2EDuration="4.54321195s" totalImagesPullingTime="1.22172856s" totalInitContainerRuntime="74.444361ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:31:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:35.541204509 +0000 UTC m=+126.200908982" watchObservedRunningTime="2026-07-07 15:31:35.54321195 +0000 UTC m=+126.202916425"
Jul 07 15:31:37.211031 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.210992    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b9cc8878-f4vcm"]
Jul 07 15:31:37.252228 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.252193    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8f87c688-d4lp5"]
Jul 07 15:31:37.255870 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.255850    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.268118 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.268094    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8f87c688-d4lp5"]
Jul 07 15:31:37.382976 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.382940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-oauth-serving-cert\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.383169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.382988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-serving-cert\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.383169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.383030    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwnd8\" (UniqueName: \"kubernetes.io/projected/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-kube-api-access-wwnd8\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.383169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.383060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-trusted-ca-bundle\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.383169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.383112    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-config\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.383169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.383138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-service-ca\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.383423 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.383183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-oauth-config\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.484395 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.484306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-oauth-serving-cert\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.484395 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.484362    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-serving-cert\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.484659 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.484400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwnd8\" (UniqueName: \"kubernetes.io/projected/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-kube-api-access-wwnd8\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.484659 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.484426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-trusted-ca-bundle\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.484659 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.484523    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-config\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.484659 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.484576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-service-ca\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.484659 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.484603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-oauth-config\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.485219 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.485195    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-oauth-serving-cert\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.485430 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.485392    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-config\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.485430 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.485401    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-service-ca\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.485558 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.485508    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-trusted-ca-bundle\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.487394 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.487371    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-serving-cert\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.487493 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.487397    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-oauth-config\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.500530 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.500500    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwnd8\" (UniqueName: \"kubernetes.io/projected/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-kube-api-access-wwnd8\") pod \"console-b8f87c688-d4lp5\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") " pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:37.508094 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.508065    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:31:37.566886 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:37.566849    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:38.408890 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:38.408856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7f46669b9c-9wfkh"
Jul 07 15:31:39.605853 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:39.605814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:31:39.608586 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:39.608556    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b121c849-7d0f-4ebc-ae16-ee73d3fb0f22-metrics-certs\") pod \"network-metrics-daemon-47kps\" (UID: \"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22\") " pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:31:39.779846 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:39.779808    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6pzwr\""
Jul 07 15:31:39.787930 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:39.787900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-47kps"
Jul 07 15:31:40.838319 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.838245    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8f87c688-d4lp5"]
Jul 07 15:31:40.873268 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.872794    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cd85c7c87-w7src"]
Jul 07 15:31:40.876679 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.876654    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:40.890202 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.890166    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd85c7c87-w7src"]
Jul 07 15:31:40.917406 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.917362    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-config\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:40.917593 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.917496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-oauth-serving-cert\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:40.917593 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.917530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-serving-cert\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:40.917593 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.917563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66wpj\" (UniqueName: \"kubernetes.io/projected/aaf1580b-7093-4068-9e14-1c9f8b2ff544-kube-api-access-66wpj\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:40.917773 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.917599    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-oauth-config\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:40.917773 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.917650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-service-ca\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:40.917773 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:40.917720    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-trusted-ca-bundle\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.018798 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.018748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-config\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.018990 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.018858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-oauth-serving-cert\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.018990 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.018884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-serving-cert\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.018990 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.018911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66wpj\" (UniqueName: \"kubernetes.io/projected/aaf1580b-7093-4068-9e14-1c9f8b2ff544-kube-api-access-66wpj\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.018990 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.018943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-oauth-config\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.018990 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.018970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-service-ca\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.019422 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.019011    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-trusted-ca-bundle\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.019610 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.019584    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-config\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.019923 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.019899    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-oauth-serving-cert\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.020253 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.020230    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-service-ca\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.020357 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.020301    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-trusted-ca-bundle\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.022924 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.022104    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-oauth-config\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.023142 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.023114    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-serving-cert\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.032187 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.032159    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66wpj\" (UniqueName: \"kubernetes.io/projected/aaf1580b-7093-4068-9e14-1c9f8b2ff544-kube-api-access-66wpj\") pod \"console-cd85c7c87-w7src\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") " pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:41.188640 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:41.188589    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:43.798839 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:43.798808    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cd85c7c87-w7src"]
Jul 07 15:31:43.803663 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:43.803591    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf1580b_7093_4068_9e14_1c9f8b2ff544.slice/crio-dd4c698ec773cde731b3fb52f16f9a4f0934f794d398b4b2bf0b8b76f508ef30 WatchSource:0}: Error finding container dd4c698ec773cde731b3fb52f16f9a4f0934f794d398b4b2bf0b8b76f508ef30: Status 404 returned error can't find the container with id dd4c698ec773cde731b3fb52f16f9a4f0934f794d398b4b2bf0b8b76f508ef30
Jul 07 15:31:44.023191 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.023038    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8f87c688-d4lp5"]
Jul 07 15:31:44.027923 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.026060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-47kps"]
Jul 07 15:31:44.027923 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:31:44.026662    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc522f5e3_19ca_4cc7_ad27_b32a9ae4c483.slice/crio-7628de75580510d7cee455184f9540182525cd2e9dd28b74123dda24ac34869e WatchSource:0}: Error finding container 7628de75580510d7cee455184f9540182525cd2e9dd28b74123dda24ac34869e: Status 404 returned error can't find the container with id 7628de75580510d7cee455184f9540182525cd2e9dd28b74123dda24ac34869e
Jul 07 15:31:44.558993 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.558938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-ztkbk" event={"ID":"59f503f1-32fe-49a0-942b-4d12350aab73","Type":"ContainerStarted","Data":"2517441cbfe1620731385c6cc550a44cbb06f775b4727fa15110c396f1046313"}
Jul 07 15:31:44.559183 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.559016    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-ztkbk"
Jul 07 15:31:44.561466 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.561429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8f87c688-d4lp5" event={"ID":"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483","Type":"ContainerStarted","Data":"fa71df1890b7253fc148e2166bdc909d7e8eb43e820efc9c1854518a6928224c"}
Jul 07 15:31:44.561586 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.561481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8f87c688-d4lp5" event={"ID":"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483","Type":"ContainerStarted","Data":"7628de75580510d7cee455184f9540182525cd2e9dd28b74123dda24ac34869e"}
Jul 07 15:31:44.564237 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.564212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g" event={"ID":"962513c6-ffa3-4de8-bfff-a8f550b8fc32","Type":"ContainerStarted","Data":"47d1184d45b9d021991338a9048143fb72631fbc5326cedc6adb9fbc58660db0"}
Jul 07 15:31:44.564353 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.564286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g" event={"ID":"962513c6-ffa3-4de8-bfff-a8f550b8fc32","Type":"ContainerStarted","Data":"ce49c2911716a257c8108558ac272d626d047b43ff8e8bcbe76948c103fadda7"}
Jul 07 15:31:44.564353 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.564331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g" event={"ID":"962513c6-ffa3-4de8-bfff-a8f550b8fc32","Type":"ContainerStarted","Data":"50b86615448343b8e7077611de3f1a5b2d2aa493644a7bbc9abe0286709676ea"}
Jul 07 15:31:44.565657 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.565610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47kps" event={"ID":"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22","Type":"ContainerStarted","Data":"8e6b95b4db05aacdbc7024052f637b6befb506701c7076391734147ef6847229"}
Jul 07 15:31:44.567431 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.567401    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd85c7c87-w7src" event={"ID":"aaf1580b-7093-4068-9e14-1c9f8b2ff544","Type":"ContainerStarted","Data":"0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a"}
Jul 07 15:31:44.567539 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.567446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd85c7c87-w7src" event={"ID":"aaf1580b-7093-4068-9e14-1c9f8b2ff544","Type":"ContainerStarted","Data":"dd4c698ec773cde731b3fb52f16f9a4f0934f794d398b4b2bf0b8b76f508ef30"}
Jul 07 15:31:44.575143 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.575043    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-ztkbk"
Jul 07 15:31:44.579223 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.579177    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-ztkbk" podStartSLOduration=1.7841771629999998 podStartE2EDuration="28.579159383s" totalImagesPullingTime="26.79498222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:44.578246559 +0000 UTC m=+135.237951035" watchObservedRunningTime="2026-07-07 15:31:44.579159383 +0000 UTC m=+135.238863857"
Jul 07 15:31:44.621527 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.619917    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cd85c7c87-w7src" podStartSLOduration=4.619892679 podStartE2EDuration="4.619892679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:44.618757311 +0000 UTC m=+135.278461788" watchObservedRunningTime="2026-07-07 15:31:44.619892679 +0000 UTC m=+135.279597154"
Jul 07 15:31:44.647695 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:44.647616    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b8f87c688-d4lp5" podStartSLOduration=7.647590913 podStartE2EDuration="7.647590913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:44.645714247 +0000 UTC m=+135.305418722" watchObservedRunningTime="2026-07-07 15:31:44.647590913 +0000 UTC m=+135.307295388"
Jul 07 15:31:46.592565 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:46.592524    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g" event={"ID":"962513c6-ffa3-4de8-bfff-a8f550b8fc32","Type":"ContainerStarted","Data":"2c2aef638c8f8847561139846afa28a2a1a5e205442ceadf05d5237ea2f4cef7"}
Jul 07 15:31:46.593060 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:46.592612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g" event={"ID":"962513c6-ffa3-4de8-bfff-a8f550b8fc32","Type":"ContainerStarted","Data":"11959981785de2d58f3b359586c6eea61a002dc3692a4779727383c75523e85a"}
Jul 07 15:31:46.593060 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:46.592898    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:46.593060 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:46.592963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g" event={"ID":"962513c6-ffa3-4de8-bfff-a8f550b8fc32","Type":"ContainerStarted","Data":"1ccbc9804b0815ef603d8eb7745ed2b088d04ecc1d60276a6e87794970b208fe"}
Jul 07 15:31:46.595514 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:46.595480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47kps" event={"ID":"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22","Type":"ContainerStarted","Data":"4fa6b3e9f4c005c6e6663ebc95f714dbef8cd3f8a85785be9b2ada6e656e6211"}
Jul 07 15:31:46.595660 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:46.595544    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-47kps" event={"ID":"b121c849-7d0f-4ebc-ae16-ee73d3fb0f22","Type":"ContainerStarted","Data":"b3c160888cf5199a081cd706cf32cb1c3fba92c362a71b5dc6fc58e90893478e"}
Jul 07 15:31:46.620588 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:46.620530    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g" podStartSLOduration=2.374867806 podStartE2EDuration="13.620511763s" totalImagesPullingTime="11.245643957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:31:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:46.619602794 +0000 UTC m=+137.279307288" watchObservedRunningTime="2026-07-07 15:31:46.620511763 +0000 UTC m=+137.280216235"
Jul 07 15:31:46.641772 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:46.641715    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-47kps" podStartSLOduration=134.497654473 podStartE2EDuration="2m16.641696636s" totalImagesPullingTime="2.144042163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:31:46.640887135 +0000 UTC m=+137.300591619" watchObservedRunningTime="2026-07-07 15:31:46.641696636 +0000 UTC m=+137.301401103"
Jul 07 15:31:47.567543 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:47.567505    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:31:51.189667 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:51.189605    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:51.190119 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:51.189726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:51.194891 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:51.194862    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:51.627396 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:51.627323    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:31:51.691402 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:51.691372    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f6bf88d-whfbc"]
Jul 07 15:31:52.611908 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:52.611881    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c8f4cd699-5f25g"
Jul 07 15:31:58.651873 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:58.651789    2580 generic.go:356] "Generic (PLEG): container finished" podID="fda9cf6e-4c79-4819-afb5-4ef963451ef2" containerID="71537deead9a2bb1894ed8ed1a580ed45acfb658c1d8860c96f68ec0b155deb5" exitCode=0
Jul 07 15:31:58.652248 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:58.651867    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s" event={"ID":"fda9cf6e-4c79-4819-afb5-4ef963451ef2","Type":"ContainerDied","Data":"71537deead9a2bb1894ed8ed1a580ed45acfb658c1d8860c96f68ec0b155deb5"}
Jul 07 15:31:58.652248 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:58.652220    2580 scope.go:117] "RemoveContainer" containerID="71537deead9a2bb1894ed8ed1a580ed45acfb658c1d8860c96f68ec0b155deb5"
Jul 07 15:31:59.657831 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:31:59.657795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-6lt9s" event={"ID":"fda9cf6e-4c79-4819-afb5-4ef963451ef2","Type":"ContainerStarted","Data":"70a410c027cb66d2e2179b6b4af8ac8dbdce2fe04b1239122909a8c2a72dd5d6"}
Jul 07 15:32:02.233859 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.233815    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-84b9cc8878-f4vcm" podUID="0a59c6a6-b468-4d36-9f11-97e407dd8a4e" containerName="console" containerID="cri-o://9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd" gracePeriod=15
Jul 07 15:32:02.517248 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.517211    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:32:02.523753 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.523731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qktjg\" (UniqueName: \"kubernetes.io/projected/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-kube-api-access-qktjg\") pod \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") "
Jul 07 15:32:02.523885 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.523771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-serving-cert\") pod \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") "
Jul 07 15:32:02.523885 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.523810    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-trusted-ca-bundle\") pod \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") "
Jul 07 15:32:02.523885 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.523843    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-config\") pod \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") "
Jul 07 15:32:02.523885 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.523861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-oauth-serving-cert\") pod \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") "
Jul 07 15:32:02.523885 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.523882    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-oauth-config\") pod \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") "
Jul 07 15:32:02.524136 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.523900    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-service-ca\") pod \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\" (UID: \"0a59c6a6-b468-4d36-9f11-97e407dd8a4e\") "
Jul 07 15:32:02.524339 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.524314    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-config" (OuterVolumeSpecName: "console-config") pod "0a59c6a6-b468-4d36-9f11-97e407dd8a4e" (UID: "0a59c6a6-b468-4d36-9f11-97e407dd8a4e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:02.524410 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.524352    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0a59c6a6-b468-4d36-9f11-97e407dd8a4e" (UID: "0a59c6a6-b468-4d36-9f11-97e407dd8a4e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:02.524410 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.524370    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0a59c6a6-b468-4d36-9f11-97e407dd8a4e" (UID: "0a59c6a6-b468-4d36-9f11-97e407dd8a4e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:02.524501 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.524478    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-service-ca" (OuterVolumeSpecName: "service-ca") pod "0a59c6a6-b468-4d36-9f11-97e407dd8a4e" (UID: "0a59c6a6-b468-4d36-9f11-97e407dd8a4e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:02.526038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.526013    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-kube-api-access-qktjg" (OuterVolumeSpecName: "kube-api-access-qktjg") pod "0a59c6a6-b468-4d36-9f11-97e407dd8a4e" (UID: "0a59c6a6-b468-4d36-9f11-97e407dd8a4e"). InnerVolumeSpecName "kube-api-access-qktjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:32:02.526038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.526024    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0a59c6a6-b468-4d36-9f11-97e407dd8a4e" (UID: "0a59c6a6-b468-4d36-9f11-97e407dd8a4e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:32:02.526038 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.526030    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0a59c6a6-b468-4d36-9f11-97e407dd8a4e" (UID: "0a59c6a6-b468-4d36-9f11-97e407dd8a4e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:32:02.624616 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.624580    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:02.624616 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.624611    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-oauth-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:02.624616 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.624639    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-oauth-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:02.624861 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.624649    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-service-ca\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:02.624861 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.624658    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qktjg\" (UniqueName: \"kubernetes.io/projected/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-kube-api-access-qktjg\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:02.624861 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.624666    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-console-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:02.624861 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.624674    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0a59c6a6-b468-4d36-9f11-97e407dd8a4e-trusted-ca-bundle\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:02.672599 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.672567    2580 generic.go:356] "Generic (PLEG): container finished" podID="0a59c6a6-b468-4d36-9f11-97e407dd8a4e" containerID="9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd" exitCode=0
Jul 07 15:32:02.672776 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.672613    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84b9cc8878-f4vcm"
Jul 07 15:32:02.672776 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.672653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b9cc8878-f4vcm" event={"ID":"0a59c6a6-b468-4d36-9f11-97e407dd8a4e","Type":"ContainerDied","Data":"9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd"}
Jul 07 15:32:02.672776 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.672707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84b9cc8878-f4vcm" event={"ID":"0a59c6a6-b468-4d36-9f11-97e407dd8a4e","Type":"ContainerDied","Data":"6a8fdfdf76a72f1bd3e903f94b62973bcd5e3a735ca069e5977e11a2d1a90d5d"}
Jul 07 15:32:02.672776 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.672727    2580 scope.go:117] "RemoveContainer" containerID="9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd"
Jul 07 15:32:02.681195 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.681177    2580 scope.go:117] "RemoveContainer" containerID="9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd"
Jul 07 15:32:02.681479 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:32:02.681453    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd\": container with ID starting with 9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd not found: ID does not exist" containerID="9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd"
Jul 07 15:32:02.681524 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.681492    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd"} err="failed to get container status \"9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd\": rpc error: code = NotFound desc = could not find container \"9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd\": container with ID starting with 9c5d8f6a4621c60a8b711d3056491ae9648cd27f11a4a5267ccbdbfad1911ebd not found: ID does not exist"
Jul 07 15:32:02.696264 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.696243    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84b9cc8878-f4vcm"]
Jul 07 15:32:02.701769 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:02.701747    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84b9cc8878-f4vcm"]
Jul 07 15:32:03.869407 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:03.869358    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a59c6a6-b468-4d36-9f11-97e407dd8a4e" path="/var/lib/kubelet/pods/0a59c6a6-b468-4d36-9f11-97e407dd8a4e/volumes"
Jul 07 15:32:09.586341 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.586302    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b8f87c688-d4lp5" podUID="c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" containerName="console" containerID="cri-o://fa71df1890b7253fc148e2166bdc909d7e8eb43e820efc9c1854518a6928224c" gracePeriod=15
Jul 07 15:32:09.701250 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.701213    2580 generic.go:356] "Generic (PLEG): container finished" podID="c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" containerID="fa71df1890b7253fc148e2166bdc909d7e8eb43e820efc9c1854518a6928224c" exitCode=0
Jul 07 15:32:09.701397 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.701289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8f87c688-d4lp5" event={"ID":"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483","Type":"ContainerDied","Data":"fa71df1890b7253fc148e2166bdc909d7e8eb43e820efc9c1854518a6928224c"}
Jul 07 15:32:09.865958 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.865873    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:32:09.883701 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.883673    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-serving-cert\") pod \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") "
Jul 07 15:32:09.883701 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.883702    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-service-ca\") pod \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") "
Jul 07 15:32:09.883936 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.883735    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-trusted-ca-bundle\") pod \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") "
Jul 07 15:32:09.883936 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.883756    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-oauth-config\") pod \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") "
Jul 07 15:32:09.883936 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.883803    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwnd8\" (UniqueName: \"kubernetes.io/projected/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-kube-api-access-wwnd8\") pod \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") "
Jul 07 15:32:09.883936 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.883826    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-config\") pod \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") "
Jul 07 15:32:09.883936 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.883861    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-oauth-serving-cert\") pod \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\" (UID: \"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483\") "
Jul 07 15:32:09.884246 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.884220    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" (UID: "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:09.884310 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.884227    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-service-ca" (OuterVolumeSpecName: "service-ca") pod "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" (UID: "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:09.884310 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.884285    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" (UID: "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:09.884386 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.884348    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-config" (OuterVolumeSpecName: "console-config") pod "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" (UID: "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:09.885982 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.885961    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" (UID: "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:32:09.886241 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.886215    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-kube-api-access-wwnd8" (OuterVolumeSpecName: "kube-api-access-wwnd8") pod "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" (UID: "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483"). InnerVolumeSpecName "kube-api-access-wwnd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:32:09.886302 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.886255    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" (UID: "c522f5e3-19ca-4cc7-ad27-b32a9ae4c483"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:32:09.985292 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.985253    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:09.985292 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.985285    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-service-ca\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:09.985292 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.985294    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-trusted-ca-bundle\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:09.985292 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.985302    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-oauth-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:09.985569 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.985312    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwnd8\" (UniqueName: \"kubernetes.io/projected/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-kube-api-access-wwnd8\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:09.985569 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.985321    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-console-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:09.985569 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:09.985329    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483-oauth-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:10.706921 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:10.706874    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8f87c688-d4lp5"
Jul 07 15:32:10.706921 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:10.706892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8f87c688-d4lp5" event={"ID":"c522f5e3-19ca-4cc7-ad27-b32a9ae4c483","Type":"ContainerDied","Data":"7628de75580510d7cee455184f9540182525cd2e9dd28b74123dda24ac34869e"}
Jul 07 15:32:10.707375 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:10.706948    2580 scope.go:117] "RemoveContainer" containerID="fa71df1890b7253fc148e2166bdc909d7e8eb43e820efc9c1854518a6928224c"
Jul 07 15:32:10.729421 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:10.729394    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b8f87c688-d4lp5"]
Jul 07 15:32:10.734185 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:10.734163    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b8f87c688-d4lp5"]
Jul 07 15:32:11.869343 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:11.869312    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" path="/var/lib/kubelet/pods/c522f5e3-19ca-4cc7-ad27-b32a9ae4c483/volumes"
Jul 07 15:32:16.718855 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:16.718789    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54f6bf88d-whfbc" podUID="5e75eda5-866b-490d-ad3c-44dec079ac3f" containerName="console" containerID="cri-o://2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac" gracePeriod=15
Jul 07 15:32:16.994813 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:16.994747    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:32:17.045764 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.045732    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-service-ca\") pod \"5e75eda5-866b-490d-ad3c-44dec079ac3f\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") "
Jul 07 15:32:17.045913 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.045827    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-serving-cert\") pod \"5e75eda5-866b-490d-ad3c-44dec079ac3f\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") "
Jul 07 15:32:17.045913 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.045864    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slxx9\" (UniqueName: \"kubernetes.io/projected/5e75eda5-866b-490d-ad3c-44dec079ac3f-kube-api-access-slxx9\") pod \"5e75eda5-866b-490d-ad3c-44dec079ac3f\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") "
Jul 07 15:32:17.045913 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.045904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-oauth-serving-cert\") pod \"5e75eda5-866b-490d-ad3c-44dec079ac3f\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") "
Jul 07 15:32:17.046065 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.046043    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-config\") pod \"5e75eda5-866b-490d-ad3c-44dec079ac3f\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") "
Jul 07 15:32:17.046132 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.046100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-oauth-config\") pod \"5e75eda5-866b-490d-ad3c-44dec079ac3f\" (UID: \"5e75eda5-866b-490d-ad3c-44dec079ac3f\") "
Jul 07 15:32:17.046190 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.046163    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e75eda5-866b-490d-ad3c-44dec079ac3f" (UID: "5e75eda5-866b-490d-ad3c-44dec079ac3f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:17.046340 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.046310    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e75eda5-866b-490d-ad3c-44dec079ac3f" (UID: "5e75eda5-866b-490d-ad3c-44dec079ac3f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:17.046469 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.046379    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-oauth-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:17.046469 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.046396    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-service-ca\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:17.046469 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.046435    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-config" (OuterVolumeSpecName: "console-config") pod "5e75eda5-866b-490d-ad3c-44dec079ac3f" (UID: "5e75eda5-866b-490d-ad3c-44dec079ac3f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:32:17.048027 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.047999    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e75eda5-866b-490d-ad3c-44dec079ac3f" (UID: "5e75eda5-866b-490d-ad3c-44dec079ac3f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:32:17.048117 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.048045    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e75eda5-866b-490d-ad3c-44dec079ac3f" (UID: "5e75eda5-866b-490d-ad3c-44dec079ac3f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:32:17.048117 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.048081    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e75eda5-866b-490d-ad3c-44dec079ac3f-kube-api-access-slxx9" (OuterVolumeSpecName: "kube-api-access-slxx9") pod "5e75eda5-866b-490d-ad3c-44dec079ac3f" (UID: "5e75eda5-866b-490d-ad3c-44dec079ac3f"). InnerVolumeSpecName "kube-api-access-slxx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:32:17.147882 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.147843    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:17.147882 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.147876    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-oauth-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:17.147882 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.147886    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e75eda5-866b-490d-ad3c-44dec079ac3f-console-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:17.147882 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.147895    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slxx9\" (UniqueName: \"kubernetes.io/projected/5e75eda5-866b-490d-ad3c-44dec079ac3f-kube-api-access-slxx9\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:32:17.735572 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.735533    2580 generic.go:356] "Generic (PLEG): container finished" podID="5e75eda5-866b-490d-ad3c-44dec079ac3f" containerID="2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac" exitCode=0
Jul 07 15:32:17.736001 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.735583    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f6bf88d-whfbc"
Jul 07 15:32:17.736001 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.735613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f6bf88d-whfbc" event={"ID":"5e75eda5-866b-490d-ad3c-44dec079ac3f","Type":"ContainerDied","Data":"2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac"}
Jul 07 15:32:17.736001 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.735682    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f6bf88d-whfbc" event={"ID":"5e75eda5-866b-490d-ad3c-44dec079ac3f","Type":"ContainerDied","Data":"71a3c72323825e3f42a103bbece05b8135255fd1021133bd9a834e0a15d2fcf5"}
Jul 07 15:32:17.736001 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.735702    2580 scope.go:117] "RemoveContainer" containerID="2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac"
Jul 07 15:32:17.745368 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.745277    2580 scope.go:117] "RemoveContainer" containerID="2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac"
Jul 07 15:32:17.745746 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:32:17.745676    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac\": container with ID starting with 2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac not found: ID does not exist" containerID="2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac"
Jul 07 15:32:17.745746 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.745713    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac"} err="failed to get container status \"2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac\": rpc error: code = NotFound desc = could not find container \"2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac\": container with ID starting with 2fc05d880992baab40591c8cf85d3596564c8b1b243fee89cb0052d61ebcf1ac not found: ID does not exist"
Jul 07 15:32:17.760107 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.760084    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f6bf88d-whfbc"]
Jul 07 15:32:17.764705 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.764684    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f6bf88d-whfbc"]
Jul 07 15:32:17.869176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:17.869139    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e75eda5-866b-490d-ad3c-44dec079ac3f" path="/var/lib/kubelet/pods/5e75eda5-866b-490d-ad3c-44dec079ac3f/volumes"
Jul 07 15:32:53.641115 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641078    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56f7dfc5-4wgjc"]
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641387    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a59c6a6-b468-4d36-9f11-97e407dd8a4e" containerName="console"
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641401    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a59c6a6-b468-4d36-9f11-97e407dd8a4e" containerName="console"
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641411    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e75eda5-866b-490d-ad3c-44dec079ac3f" containerName="console"
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641416    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e75eda5-866b-490d-ad3c-44dec079ac3f" containerName="console"
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641437    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" containerName="console"
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641446    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" containerName="console"
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641498    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e75eda5-866b-490d-ad3c-44dec079ac3f" containerName="console"
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641506    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a59c6a6-b468-4d36-9f11-97e407dd8a4e" containerName="console"
Jul 07 15:32:53.641577 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.641514    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c522f5e3-19ca-4cc7-ad27-b32a9ae4c483" containerName="console"
Jul 07 15:32:53.646652 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.644344    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.650315 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.650290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-serving-cert\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.650481 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.650336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-trusted-ca-bundle\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.650481 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.650372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46xsh\" (UniqueName: \"kubernetes.io/projected/b8fec117-e8bf-45fa-893c-0dfde20a91e9-kube-api-access-46xsh\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.650481 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.650452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-oauth-serving-cert\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.650667 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.650504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-config\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.650667 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.650554    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-oauth-config\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.650667 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.650613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-service-ca\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.662171 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.662146    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f7dfc5-4wgjc"]
Jul 07 15:32:53.751482 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.751449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-oauth-config\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.751704 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.751496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-service-ca\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.751704 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.751544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-serving-cert\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.751704 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.751580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-trusted-ca-bundle\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.751704 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.751615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46xsh\" (UniqueName: \"kubernetes.io/projected/b8fec117-e8bf-45fa-893c-0dfde20a91e9-kube-api-access-46xsh\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.751704 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.751680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-oauth-serving-cert\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.751967 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.751728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-config\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.752421 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.752390    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-service-ca\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.752549 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.752438    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-config\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.752611 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.752566    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-oauth-serving-cert\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.752784 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.752763    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-trusted-ca-bundle\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.754107 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.754078    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-serving-cert\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.754107 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.754098    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-oauth-config\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.760911 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.760888    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46xsh\" (UniqueName: \"kubernetes.io/projected/b8fec117-e8bf-45fa-893c-0dfde20a91e9-kube-api-access-46xsh\") pod \"console-56f7dfc5-4wgjc\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") " pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:53.955095 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:53.955064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:32:54.104759 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:54.104549    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56f7dfc5-4wgjc"]
Jul 07 15:32:54.107401 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:32:54.107365    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fec117_e8bf_45fa_893c_0dfde20a91e9.slice/crio-ea5479179ed8e4f9a51ed0b89e45240be5a67f91b1bd16ec2a784c70be9eb6f7 WatchSource:0}: Error finding container ea5479179ed8e4f9a51ed0b89e45240be5a67f91b1bd16ec2a784c70be9eb6f7: Status 404 returned error can't find the container with id ea5479179ed8e4f9a51ed0b89e45240be5a67f91b1bd16ec2a784c70be9eb6f7
Jul 07 15:32:54.876943 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:54.876899    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f7dfc5-4wgjc" event={"ID":"b8fec117-e8bf-45fa-893c-0dfde20a91e9","Type":"ContainerStarted","Data":"8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668"}
Jul 07 15:32:54.877327 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:54.876963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f7dfc5-4wgjc" event={"ID":"b8fec117-e8bf-45fa-893c-0dfde20a91e9","Type":"ContainerStarted","Data":"ea5479179ed8e4f9a51ed0b89e45240be5a67f91b1bd16ec2a784c70be9eb6f7"}
Jul 07 15:32:54.902135 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:32:54.902081    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56f7dfc5-4wgjc" podStartSLOduration=1.902063285 podStartE2EDuration="1.902063285s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:32:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:32:54.900477596 +0000 UTC m=+205.560182069" watchObservedRunningTime="2026-07-07 15:32:54.902063285 +0000 UTC m=+205.561767801"
Jul 07 15:33:03.955929 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:03.955892    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:33:03.956432 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:03.955974    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:33:03.960619 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:03.960597    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:33:04.918195 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:04.918160    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:33:04.981055 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:04.981019    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd85c7c87-w7src"]
Jul 07 15:33:30.009992 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.009944    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-cd85c7c87-w7src" podUID="aaf1580b-7093-4068-9e14-1c9f8b2ff544" containerName="console" containerID="cri-o://0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a" gracePeriod=15
Jul 07 15:33:30.252818 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.252790    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:33:30.366036 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.365945    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-serving-cert\") pod \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") "
Jul 07 15:33:30.366036 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366011    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66wpj\" (UniqueName: \"kubernetes.io/projected/aaf1580b-7093-4068-9e14-1c9f8b2ff544-kube-api-access-66wpj\") pod \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") "
Jul 07 15:33:30.366276 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366054    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-oauth-config\") pod \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") "
Jul 07 15:33:30.366276 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-oauth-serving-cert\") pod \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") "
Jul 07 15:33:30.366276 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366095    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-trusted-ca-bundle\") pod \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") "
Jul 07 15:33:30.366276 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366196    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-config\") pod \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") "
Jul 07 15:33:30.366473 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-service-ca\") pod \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\" (UID: \"aaf1580b-7093-4068-9e14-1c9f8b2ff544\") "
Jul 07 15:33:30.366586 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366546    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aaf1580b-7093-4068-9e14-1c9f8b2ff544" (UID: "aaf1580b-7093-4068-9e14-1c9f8b2ff544"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:33:30.366586 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366563    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aaf1580b-7093-4068-9e14-1c9f8b2ff544" (UID: "aaf1580b-7093-4068-9e14-1c9f8b2ff544"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:33:30.366586 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366571    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-config" (OuterVolumeSpecName: "console-config") pod "aaf1580b-7093-4068-9e14-1c9f8b2ff544" (UID: "aaf1580b-7093-4068-9e14-1c9f8b2ff544"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:33:30.366900 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.366878    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-service-ca" (OuterVolumeSpecName: "service-ca") pod "aaf1580b-7093-4068-9e14-1c9f8b2ff544" (UID: "aaf1580b-7093-4068-9e14-1c9f8b2ff544"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:33:30.368312 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.368286    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aaf1580b-7093-4068-9e14-1c9f8b2ff544" (UID: "aaf1580b-7093-4068-9e14-1c9f8b2ff544"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:33:30.368408 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.368312    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aaf1580b-7093-4068-9e14-1c9f8b2ff544" (UID: "aaf1580b-7093-4068-9e14-1c9f8b2ff544"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:33:30.368408 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.368396    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf1580b-7093-4068-9e14-1c9f8b2ff544-kube-api-access-66wpj" (OuterVolumeSpecName: "kube-api-access-66wpj") pod "aaf1580b-7093-4068-9e14-1c9f8b2ff544" (UID: "aaf1580b-7093-4068-9e14-1c9f8b2ff544"). InnerVolumeSpecName "kube-api-access-66wpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:33:30.467695 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.467646    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66wpj\" (UniqueName: \"kubernetes.io/projected/aaf1580b-7093-4068-9e14-1c9f8b2ff544-kube-api-access-66wpj\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:33:30.467695 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.467688    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-oauth-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:33:30.467695 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.467700    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-oauth-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:33:30.467695 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.467708    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-trusted-ca-bundle\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:33:30.467969 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.467718    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:33:30.467969 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.467726    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf1580b-7093-4068-9e14-1c9f8b2ff544-service-ca\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:33:30.467969 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:30.467734    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aaf1580b-7093-4068-9e14-1c9f8b2ff544-console-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:33:31.011517 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.011480    2580 generic.go:356] "Generic (PLEG): container finished" podID="aaf1580b-7093-4068-9e14-1c9f8b2ff544" containerID="0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a" exitCode=0
Jul 07 15:33:31.011958 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.011526    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cd85c7c87-w7src"
Jul 07 15:33:31.011958 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.011570    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd85c7c87-w7src" event={"ID":"aaf1580b-7093-4068-9e14-1c9f8b2ff544","Type":"ContainerDied","Data":"0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a"}
Jul 07 15:33:31.011958 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.011611    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cd85c7c87-w7src" event={"ID":"aaf1580b-7093-4068-9e14-1c9f8b2ff544","Type":"ContainerDied","Data":"dd4c698ec773cde731b3fb52f16f9a4f0934f794d398b4b2bf0b8b76f508ef30"}
Jul 07 15:33:31.011958 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.011649    2580 scope.go:117] "RemoveContainer" containerID="0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a"
Jul 07 15:33:31.020576 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.020556    2580 scope.go:117] "RemoveContainer" containerID="0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a"
Jul 07 15:33:31.020819 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:33:31.020801    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a\": container with ID starting with 0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a not found: ID does not exist" containerID="0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a"
Jul 07 15:33:31.020886 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.020827    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a"} err="failed to get container status \"0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a\": rpc error: code = NotFound desc = could not find container \"0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a\": container with ID starting with 0f38bcd4d28e15992e166e919ff3b7efaa1ae0939469d8aacef1f8f3f68d973a not found: ID does not exist"
Jul 07 15:33:31.036738 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.036715    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-cd85c7c87-w7src"]
Jul 07 15:33:31.042852 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.042830    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-cd85c7c87-w7src"]
Jul 07 15:33:31.869284 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:33:31.869241    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf1580b-7093-4068-9e14-1c9f8b2ff544" path="/var/lib/kubelet/pods/aaf1580b-7093-4068-9e14-1c9f8b2ff544/volumes"
Jul 07 15:34:29.769680 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:34:29.769646    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 15:35:24.250247 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.250167    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrm5r"]
Jul 07 15:35:24.250706 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.250474    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf1580b-7093-4068-9e14-1c9f8b2ff544" containerName="console"
Jul 07 15:35:24.250706 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.250489    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf1580b-7093-4068-9e14-1c9f8b2ff544" containerName="console"
Jul 07 15:35:24.250706 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.250575    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf1580b-7093-4068-9e14-1c9f8b2ff544" containerName="console"
Jul 07 15:35:24.252230 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.252215    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:24.254590 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.254566    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 15:35:24.255354 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.255337    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 15:35:24.255448 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.255356    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2fsmb\""
Jul 07 15:35:24.263448 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.263423    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrm5r"]
Jul 07 15:35:24.376872 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.376834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48kgn\" (UniqueName: \"kubernetes.io/projected/46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c-kube-api-access-48kgn\") pod \"cert-manager-webhook-6486ffd997-lrm5r\" (UID: \"46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:24.377042 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.376893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrm5r\" (UID: \"46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:24.477394 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.477353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrm5r\" (UID: \"46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:24.477575 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.477425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48kgn\" (UniqueName: \"kubernetes.io/projected/46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c-kube-api-access-48kgn\") pod \"cert-manager-webhook-6486ffd997-lrm5r\" (UID: \"46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:24.486715 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.486684    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lrm5r\" (UID: \"46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:24.486997 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.486973    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48kgn\" (UniqueName: \"kubernetes.io/projected/46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c-kube-api-access-48kgn\") pod \"cert-manager-webhook-6486ffd997-lrm5r\" (UID: \"46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:24.568109 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.568027    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:24.702838 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.702806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lrm5r"]
Jul 07 15:35:24.705772 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:35:24.705744    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46ec9ba3_07f0_4f52_a4e7_c6bd35ecca2c.slice/crio-f8f509c1338640ee899373cf809322dfc7bdb573ffa12ce47160ed687df020ad WatchSource:0}: Error finding container f8f509c1338640ee899373cf809322dfc7bdb573ffa12ce47160ed687df020ad: Status 404 returned error can't find the container with id f8f509c1338640ee899373cf809322dfc7bdb573ffa12ce47160ed687df020ad
Jul 07 15:35:24.707519 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:24.707505    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:35:25.433664 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:25.433597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r" event={"ID":"46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c","Type":"ContainerStarted","Data":"f8f509c1338640ee899373cf809322dfc7bdb573ffa12ce47160ed687df020ad"}
Jul 07 15:35:26.440497 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.440468    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mw26r"]
Jul 07 15:35:26.443684 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.443661    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mw26r"
Jul 07 15:35:26.446465 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.446438    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gdvdp\""
Jul 07 15:35:26.456552 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.456519    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mw26r"]
Jul 07 15:35:26.492688 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.492646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e8721b7-174d-403e-8db4-3e7faf254318-bound-sa-token\") pod \"cert-manager-55b4d954d5-mw26r\" (UID: \"6e8721b7-174d-403e-8db4-3e7faf254318\") " pod="cert-manager/cert-manager-55b4d954d5-mw26r"
Jul 07 15:35:26.492688 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.492689    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v5zd\" (UniqueName: \"kubernetes.io/projected/6e8721b7-174d-403e-8db4-3e7faf254318-kube-api-access-8v5zd\") pod \"cert-manager-55b4d954d5-mw26r\" (UID: \"6e8721b7-174d-403e-8db4-3e7faf254318\") " pod="cert-manager/cert-manager-55b4d954d5-mw26r"
Jul 07 15:35:26.593781 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.593749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e8721b7-174d-403e-8db4-3e7faf254318-bound-sa-token\") pod \"cert-manager-55b4d954d5-mw26r\" (UID: \"6e8721b7-174d-403e-8db4-3e7faf254318\") " pod="cert-manager/cert-manager-55b4d954d5-mw26r"
Jul 07 15:35:26.593966 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.593798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v5zd\" (UniqueName: \"kubernetes.io/projected/6e8721b7-174d-403e-8db4-3e7faf254318-kube-api-access-8v5zd\") pod \"cert-manager-55b4d954d5-mw26r\" (UID: \"6e8721b7-174d-403e-8db4-3e7faf254318\") " pod="cert-manager/cert-manager-55b4d954d5-mw26r"
Jul 07 15:35:26.606817 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.606778    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e8721b7-174d-403e-8db4-3e7faf254318-bound-sa-token\") pod \"cert-manager-55b4d954d5-mw26r\" (UID: \"6e8721b7-174d-403e-8db4-3e7faf254318\") " pod="cert-manager/cert-manager-55b4d954d5-mw26r"
Jul 07 15:35:26.606955 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.606930    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v5zd\" (UniqueName: \"kubernetes.io/projected/6e8721b7-174d-403e-8db4-3e7faf254318-kube-api-access-8v5zd\") pod \"cert-manager-55b4d954d5-mw26r\" (UID: \"6e8721b7-174d-403e-8db4-3e7faf254318\") " pod="cert-manager/cert-manager-55b4d954d5-mw26r"
Jul 07 15:35:26.755782 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:26.755685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mw26r"
Jul 07 15:35:27.760258 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:27.760223    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mw26r"]
Jul 07 15:35:27.764259 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:35:27.764223    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e8721b7_174d_403e_8db4_3e7faf254318.slice/crio-ac381510d96c80a6711a5d0e3068b6cfa9b30f6654883a82e3b9a686ffe85ff5 WatchSource:0}: Error finding container ac381510d96c80a6711a5d0e3068b6cfa9b30f6654883a82e3b9a686ffe85ff5: Status 404 returned error can't find the container with id ac381510d96c80a6711a5d0e3068b6cfa9b30f6654883a82e3b9a686ffe85ff5
Jul 07 15:35:28.451188 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:28.451143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r" event={"ID":"46ec9ba3-07f0-4f52-a4e7-c6bd35ecca2c","Type":"ContainerStarted","Data":"308af6e5043348253a17818195681cd790cbf44fa3e1625257a0169a6be2cf0f"}
Jul 07 15:35:28.451396 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:28.451205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:28.452572 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:28.452546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mw26r" event={"ID":"6e8721b7-174d-403e-8db4-3e7faf254318","Type":"ContainerStarted","Data":"0b31f15000e1194cab60aa644ea755c78b54d4d921d45bae30cd40d53eea5a36"}
Jul 07 15:35:28.452698 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:28.452582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mw26r" event={"ID":"6e8721b7-174d-403e-8db4-3e7faf254318","Type":"ContainerStarted","Data":"ac381510d96c80a6711a5d0e3068b6cfa9b30f6654883a82e3b9a686ffe85ff5"}
Jul 07 15:35:28.474209 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:28.474146    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r" podStartSLOduration=1.5187620979999998 podStartE2EDuration="4.474131894s" totalImagesPullingTime="2.955369796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:28.473857243 +0000 UTC m=+359.133561728" watchObservedRunningTime="2026-07-07 15:35:28.474131894 +0000 UTC m=+359.133836367"
Jul 07 15:35:28.496057 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:28.496000    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mw26r" podStartSLOduration=2.495984542 podStartE2EDuration="2.495984542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:28.494744729 +0000 UTC m=+359.154449227" watchObservedRunningTime="2026-07-07 15:35:28.495984542 +0000 UTC m=+359.155689015"
Jul 07 15:35:34.459005 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:34.458968    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lrm5r"
Jul 07 15:35:52.195294 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.195252    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"]
Jul 07 15:35:52.199089 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.199064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.203894 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.203870    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 15:35:52.203894 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.203889    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 15:35:52.204044 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.203997    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cn75m\""
Jul 07 15:35:52.204133 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.204117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 15:35:52.204260 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.204245    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 15:35:52.216952 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.216922    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"]
Jul 07 15:35:52.300734 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.300701    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6938db07-72c3-4f53-b012-952ff167b359-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.300734 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.300735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6938db07-72c3-4f53-b012-952ff167b359-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.300938 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.300772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6938db07-72c3-4f53-b012-952ff167b359-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.300938 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.300832    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6938db07-72c3-4f53-b012-952ff167b359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.300938 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.300859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk2rw\" (UniqueName: \"kubernetes.io/projected/6938db07-72c3-4f53-b012-952ff167b359-kube-api-access-tk2rw\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.401381 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.401343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6938db07-72c3-4f53-b012-952ff167b359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.401381 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.401385    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk2rw\" (UniqueName: \"kubernetes.io/projected/6938db07-72c3-4f53-b012-952ff167b359-kube-api-access-tk2rw\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.401675 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.401423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6938db07-72c3-4f53-b012-952ff167b359-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.401675 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.401443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6938db07-72c3-4f53-b012-952ff167b359-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.401675 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.401477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6938db07-72c3-4f53-b012-952ff167b359-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.402380 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.402354    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6938db07-72c3-4f53-b012-952ff167b359-manifests\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.408555 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.404943    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6938db07-72c3-4f53-b012-952ff167b359-tmp\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.408555 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.405015    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6938db07-72c3-4f53-b012-952ff167b359-webhook-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.408555 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.405137    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6938db07-72c3-4f53-b012-952ff167b359-apiservice-cert\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.415480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.415459    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk2rw\" (UniqueName: \"kubernetes.io/projected/6938db07-72c3-4f53-b012-952ff167b359-kube-api-access-tk2rw\") pod \"opendatahub-operator-controller-manager-578f9687cc-n5mtc\" (UID: \"6938db07-72c3-4f53-b012-952ff167b359\") " pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.508926 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.508842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:52.663336 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:52.663312    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"]
Jul 07 15:35:52.665832 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:35:52.665799    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6938db07_72c3_4f53_b012_952ff167b359.slice/crio-2b7220e123ba4e820346917bb2b604dc9f8d01b93da857f87fc2cc1cf1729e59 WatchSource:0}: Error finding container 2b7220e123ba4e820346917bb2b604dc9f8d01b93da857f87fc2cc1cf1729e59: Status 404 returned error can't find the container with id 2b7220e123ba4e820346917bb2b604dc9f8d01b93da857f87fc2cc1cf1729e59
Jul 07 15:35:53.551866 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:53.551828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc" event={"ID":"6938db07-72c3-4f53-b012-952ff167b359","Type":"ContainerStarted","Data":"2b7220e123ba4e820346917bb2b604dc9f8d01b93da857f87fc2cc1cf1729e59"}
Jul 07 15:35:56.567341 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:56.567303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc" event={"ID":"6938db07-72c3-4f53-b012-952ff167b359","Type":"ContainerStarted","Data":"4458645336e2240663ef629c652b10fab50a0aa9f8f9b41323f3b83975da5216"}
Jul 07 15:35:57.574078 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:57.574037    2580 generic.go:356] "Generic (PLEG): container finished" podID="6938db07-72c3-4f53-b012-952ff167b359" containerID="4458645336e2240663ef629c652b10fab50a0aa9f8f9b41323f3b83975da5216" exitCode=0
Jul 07 15:35:57.574567 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:57.574084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc" event={"ID":"6938db07-72c3-4f53-b012-952ff167b359","Type":"ContainerDied","Data":"4458645336e2240663ef629c652b10fab50a0aa9f8f9b41323f3b83975da5216"}
Jul 07 15:35:58.580551 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:58.580520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc" event={"ID":"6938db07-72c3-4f53-b012-952ff167b359","Type":"ContainerStarted","Data":"fb8a2d8996414b35374ff40a5ef2504c5d234109a793c708e83fc9bc0b64256c"}
Jul 07 15:35:58.581010 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:58.580656    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:35:58.653007 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:35:58.652953    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc" podStartSLOduration=1.436100164 podStartE2EDuration="6.652934966s" totalImagesPullingTime="4.136077574s" totalInitContainerRuntime="1.080757228s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:58.651769105 +0000 UTC m=+389.311473580" watchObservedRunningTime="2026-07-07 15:35:58.652934966 +0000 UTC m=+389.312639438"
Jul 07 15:36:09.587446 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:09.587415    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-578f9687cc-n5mtc"
Jul 07 15:36:12.645349 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.645318    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"]
Jul 07 15:36:12.655754 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.655720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:12.660841 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.660822    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 15:36:12.661089 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.661060    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nwq86\""
Jul 07 15:36:12.661341 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.661324    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 15:36:12.676029 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.676006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp5m2\" (UniqueName: \"kubernetes.io/projected/3829dc3e-6588-49c9-82ef-f991b08ca4d4-kube-api-access-hp5m2\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:12.676148 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.676034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tmp\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:12.676148 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.676081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tls-certs\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:12.679633 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.679596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"]
Jul 07 15:36:12.776794 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.776752    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp5m2\" (UniqueName: \"kubernetes.io/projected/3829dc3e-6588-49c9-82ef-f991b08ca4d4-kube-api-access-hp5m2\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:12.776794 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.776794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tmp\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:12.777066 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.776941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tls-certs\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:12.777066 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:36:12.777060    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 15:36:12.777319 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:36:12.777300    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tls-certs podName:3829dc3e-6588-49c9-82ef-f991b08ca4d4 nodeName:}" failed. No retries permitted until 2026-07-07 15:36:13.277128236 +0000 UTC m=+403.936832703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tls-certs") pod "kube-auth-proxy-6fd979f9c8-fwtqh" (UID: "3829dc3e-6588-49c9-82ef-f991b08ca4d4") : secret "kube-auth-proxy-tls" not found
Jul 07 15:36:12.779305 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.779282    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tmp\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:12.811186 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:12.811146    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp5m2\" (UniqueName: \"kubernetes.io/projected/3829dc3e-6588-49c9-82ef-f991b08ca4d4-kube-api-access-hp5m2\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:13.280796 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:13.280754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tls-certs\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:13.283215 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:13.283183    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3829dc3e-6588-49c9-82ef-f991b08ca4d4-tls-certs\") pod \"kube-auth-proxy-6fd979f9c8-fwtqh\" (UID: \"3829dc3e-6588-49c9-82ef-f991b08ca4d4\") " pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:13.565108 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:13.565025    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"
Jul 07 15:36:13.732165 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:13.732120    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh"]
Jul 07 15:36:13.734987 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:36:13.734954    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3829dc3e_6588_49c9_82ef_f991b08ca4d4.slice/crio-8c72fd387f022b454e2ae6306c57c8888818fdad415c5e3887509b462a360a81 WatchSource:0}: Error finding container 8c72fd387f022b454e2ae6306c57c8888818fdad415c5e3887509b462a360a81: Status 404 returned error can't find the container with id 8c72fd387f022b454e2ae6306c57c8888818fdad415c5e3887509b462a360a81
Jul 07 15:36:14.333728 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.333690    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cjqnd"]
Jul 07 15:36:14.338287 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.338268    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:14.341525 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.341504    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 15:36:14.342150 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.342117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-55md2\""
Jul 07 15:36:14.357919 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.357890    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cjqnd"]
Jul 07 15:36:14.391845 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.391808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50284799-49d6-42de-bc2f-cca699770cd7-tls-certs\") pod \"model-serving-api-54d89bd5fc-cjqnd\" (UID: \"50284799-49d6-42de-bc2f-cca699770cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:14.392017 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.391865    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qrj8\" (UniqueName: \"kubernetes.io/projected/50284799-49d6-42de-bc2f-cca699770cd7-kube-api-access-8qrj8\") pod \"model-serving-api-54d89bd5fc-cjqnd\" (UID: \"50284799-49d6-42de-bc2f-cca699770cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:14.492636 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.492582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50284799-49d6-42de-bc2f-cca699770cd7-tls-certs\") pod \"model-serving-api-54d89bd5fc-cjqnd\" (UID: \"50284799-49d6-42de-bc2f-cca699770cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:14.492826 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.492661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qrj8\" (UniqueName: \"kubernetes.io/projected/50284799-49d6-42de-bc2f-cca699770cd7-kube-api-access-8qrj8\") pod \"model-serving-api-54d89bd5fc-cjqnd\" (UID: \"50284799-49d6-42de-bc2f-cca699770cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:14.495149 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.495125    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/50284799-49d6-42de-bc2f-cca699770cd7-tls-certs\") pod \"model-serving-api-54d89bd5fc-cjqnd\" (UID: \"50284799-49d6-42de-bc2f-cca699770cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:14.512726 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.512695    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qrj8\" (UniqueName: \"kubernetes.io/projected/50284799-49d6-42de-bc2f-cca699770cd7-kube-api-access-8qrj8\") pod \"model-serving-api-54d89bd5fc-cjqnd\" (UID: \"50284799-49d6-42de-bc2f-cca699770cd7\") " pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:14.648431 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.648337    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:14.652283 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.652246    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh" event={"ID":"3829dc3e-6588-49c9-82ef-f991b08ca4d4","Type":"ContainerStarted","Data":"8c72fd387f022b454e2ae6306c57c8888818fdad415c5e3887509b462a360a81"}
Jul 07 15:36:14.810275 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:14.810190    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cjqnd"]
Jul 07 15:36:14.816568 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:36:14.816523    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50284799_49d6_42de_bc2f_cca699770cd7.slice/crio-975558be61fe61ebeea36649138edf34229ae0d344d8e6108cd1e9aa2e9cc542 WatchSource:0}: Error finding container 975558be61fe61ebeea36649138edf34229ae0d344d8e6108cd1e9aa2e9cc542: Status 404 returned error can't find the container with id 975558be61fe61ebeea36649138edf34229ae0d344d8e6108cd1e9aa2e9cc542
Jul 07 15:36:15.659172 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:15.659058    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd" event={"ID":"50284799-49d6-42de-bc2f-cca699770cd7","Type":"ContainerStarted","Data":"975558be61fe61ebeea36649138edf34229ae0d344d8e6108cd1e9aa2e9cc542"}
Jul 07 15:36:17.670729 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:17.670688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd" event={"ID":"50284799-49d6-42de-bc2f-cca699770cd7","Type":"ContainerStarted","Data":"2e68f94cd5f4b6928fc95e3d02f11fa52effa2cf5cd6a867f2928662b073e72f"}
Jul 07 15:36:17.671208 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:17.670758    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:36:17.672163 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:17.672136    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh" event={"ID":"3829dc3e-6588-49c9-82ef-f991b08ca4d4","Type":"ContainerStarted","Data":"a0df9f43504b462a48bf752e95e4d4ea96986e1e82f3c6c3193443bd92b4c473"}
Jul 07 15:36:17.695830 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:17.695782    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd" podStartSLOduration=1.343611689 podStartE2EDuration="3.695767435s" totalImagesPullingTime="2.352155746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:17.695159346 +0000 UTC m=+408.354863820" watchObservedRunningTime="2026-07-07 15:36:17.695767435 +0000 UTC m=+408.355471911"
Jul 07 15:36:17.729319 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:17.729270    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fd979f9c8-fwtqh" podStartSLOduration=2.294915479 podStartE2EDuration="5.729252219s" totalImagesPullingTime="3.43433674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:17.729175994 +0000 UTC m=+408.388880468" watchObservedRunningTime="2026-07-07 15:36:17.729252219 +0000 UTC m=+408.388956719"
Jul 07 15:36:20.458772 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.458731    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"]
Jul 07 15:36:20.462203 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.462182    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.467350 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.467320    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 15:36:20.467513 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.467489    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 15:36:20.468241 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.468219    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 15:36:20.468241 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.468233    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 15:36:20.468373 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.468270    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xdtl5\""
Jul 07 15:36:20.482223 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.482198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"]
Jul 07 15:36:20.545268 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.545235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.545461 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.545274    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.545461 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.545301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h6bk\" (UniqueName: \"kubernetes.io/projected/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-kube-api-access-7h6bk\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.545461 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.545394    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.545461 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.545437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.545461 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.545454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.545747 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.545504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.646603 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.646559    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.646603 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.646602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.646902 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.646677    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.646902 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.646808    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.646902 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.646856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.647108 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.646899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h6bk\" (UniqueName: \"kubernetes.io/projected/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-kube-api-access-7h6bk\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.647108 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.647076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.647508 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.647482    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.649166 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.649138    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.649453 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.649432    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.649511 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.649494    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.650641 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.650600    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.659014 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.658986    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h6bk\" (UniqueName: \"kubernetes.io/projected/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-kube-api-access-7h6bk\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.659141 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.659102    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-98799\" (UID: \"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:20.771642 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:20.771535    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:21.004921 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:36:21.004887    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2aa4f36_f0ae_4943_b78e_d0fd70dfa05e.slice/crio-36aa0cdf02e554f336639a595144362bc9c2d579b1167c7faf97ba03b3e892b5 WatchSource:0}: Error finding container 36aa0cdf02e554f336639a595144362bc9c2d579b1167c7faf97ba03b3e892b5: Status 404 returned error can't find the container with id 36aa0cdf02e554f336639a595144362bc9c2d579b1167c7faf97ba03b3e892b5
Jul 07 15:36:21.013073 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:21.013008    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"]
Jul 07 15:36:21.694204 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:21.694159    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799" event={"ID":"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e","Type":"ContainerStarted","Data":"36aa0cdf02e554f336639a595144362bc9c2d579b1167c7faf97ba03b3e892b5"}
Jul 07 15:36:23.274945 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:23.274903    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 15:36:23.275227 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:23.274973    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 15:36:23.705187 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:23.705150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799" event={"ID":"f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e","Type":"ContainerStarted","Data":"f89c826df35a1dec11e011a0cf04faa474070f9f026ca9cca5e26ebff0ef4dc3"}
Jul 07 15:36:23.705372 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:23.705258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:23.750028 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:23.749977    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799" podStartSLOduration=1.482367246 podStartE2EDuration="3.749960935s" totalImagesPullingTime="2.267593689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:23.747767828 +0000 UTC m=+414.407472311" watchObservedRunningTime="2026-07-07 15:36:23.749960935 +0000 UTC m=+414.409665407"
Jul 07 15:36:24.711788 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:24.711760    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-98799"
Jul 07 15:36:28.680959 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:36:28.680925    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cjqnd"
Jul 07 15:37:13.425453 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.425359    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td4rp"]
Jul 07 15:37:13.435191 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.435164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-td4rp"
Jul 07 15:37:13.438409 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.438389    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 15:37:13.438665 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.438651    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 15:37:13.439285 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.439268    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-fc878\""
Jul 07 15:37:13.450419 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.450398    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td4rp"]
Jul 07 15:37:13.510813 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.510779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8pcb\" (UniqueName: \"kubernetes.io/projected/183b1788-aae7-43c6-912f-b9f0bfbb8801-kube-api-access-g8pcb\") pod \"kuadrant-operator-catalog-td4rp\" (UID: \"183b1788-aae7-43c6-912f-b9f0bfbb8801\") " pod="kuadrant-system/kuadrant-operator-catalog-td4rp"
Jul 07 15:37:13.611532 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.611497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8pcb\" (UniqueName: \"kubernetes.io/projected/183b1788-aae7-43c6-912f-b9f0bfbb8801-kube-api-access-g8pcb\") pod \"kuadrant-operator-catalog-td4rp\" (UID: \"183b1788-aae7-43c6-912f-b9f0bfbb8801\") " pod="kuadrant-system/kuadrant-operator-catalog-td4rp"
Jul 07 15:37:13.621257 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.621226    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8pcb\" (UniqueName: \"kubernetes.io/projected/183b1788-aae7-43c6-912f-b9f0bfbb8801-kube-api-access-g8pcb\") pod \"kuadrant-operator-catalog-td4rp\" (UID: \"183b1788-aae7-43c6-912f-b9f0bfbb8801\") " pod="kuadrant-system/kuadrant-operator-catalog-td4rp"
Jul 07 15:37:13.670647 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.670603    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td4rp"]
Jul 07 15:37:13.670940 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.670924    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-td4rp"
Jul 07 15:37:13.808762 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.808724    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td4rp"]
Jul 07 15:37:13.811778 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:37:13.811751    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183b1788_aae7_43c6_912f_b9f0bfbb8801.slice/crio-8f33a582c5884fc31a4cf074bf08e70b72c5e5f3c570f6aee0a13637b3877b88 WatchSource:0}: Error finding container 8f33a582c5884fc31a4cf074bf08e70b72c5e5f3c570f6aee0a13637b3877b88: Status 404 returned error can't find the container with id 8f33a582c5884fc31a4cf074bf08e70b72c5e5f3c570f6aee0a13637b3877b88
Jul 07 15:37:13.914067 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.914030    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dq7q2"]
Jul 07 15:37:13.918781 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.918756    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:13.929606 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.929583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dq7q2"]
Jul 07 15:37:13.931220 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:13.931187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-td4rp" event={"ID":"183b1788-aae7-43c6-912f-b9f0bfbb8801","Type":"ContainerStarted","Data":"8f33a582c5884fc31a4cf074bf08e70b72c5e5f3c570f6aee0a13637b3877b88"}
Jul 07 15:37:14.014636 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:14.014586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6j8v\" (UniqueName: \"kubernetes.io/projected/96144adc-bac1-4034-ac4c-1f78ca918389-kube-api-access-v6j8v\") pod \"kuadrant-operator-catalog-dq7q2\" (UID: \"96144adc-bac1-4034-ac4c-1f78ca918389\") " pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:14.115505 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:14.115468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6j8v\" (UniqueName: \"kubernetes.io/projected/96144adc-bac1-4034-ac4c-1f78ca918389-kube-api-access-v6j8v\") pod \"kuadrant-operator-catalog-dq7q2\" (UID: \"96144adc-bac1-4034-ac4c-1f78ca918389\") " pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:14.125839 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:14.125803    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6j8v\" (UniqueName: \"kubernetes.io/projected/96144adc-bac1-4034-ac4c-1f78ca918389-kube-api-access-v6j8v\") pod \"kuadrant-operator-catalog-dq7q2\" (UID: \"96144adc-bac1-4034-ac4c-1f78ca918389\") " pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:14.229757 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:14.229720    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:14.365939 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:14.365906    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dq7q2"]
Jul 07 15:37:14.369197 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:37:14.369169    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96144adc_bac1_4034_ac4c_1f78ca918389.slice/crio-b2f5db79f90c932748c36326ee9a9b8602e0203d018fd0597d04f37ccf03f3f5 WatchSource:0}: Error finding container b2f5db79f90c932748c36326ee9a9b8602e0203d018fd0597d04f37ccf03f3f5: Status 404 returned error can't find the container with id b2f5db79f90c932748c36326ee9a9b8602e0203d018fd0597d04f37ccf03f3f5
Jul 07 15:37:14.937073 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:14.937037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2" event={"ID":"96144adc-bac1-4034-ac4c-1f78ca918389","Type":"ContainerStarted","Data":"b2f5db79f90c932748c36326ee9a9b8602e0203d018fd0597d04f37ccf03f3f5"}
Jul 07 15:37:16.947094 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:16.947061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2" event={"ID":"96144adc-bac1-4034-ac4c-1f78ca918389","Type":"ContainerStarted","Data":"89ca9f25c3586876933e325dd198d71291733dd5041789f0b2f60200beac4dee"}
Jul 07 15:37:16.948495 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:16.948465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-td4rp" event={"ID":"183b1788-aae7-43c6-912f-b9f0bfbb8801","Type":"ContainerStarted","Data":"436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53"}
Jul 07 15:37:16.948604 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:16.948492    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-td4rp" podUID="183b1788-aae7-43c6-912f-b9f0bfbb8801" containerName="registry-server" containerID="cri-o://436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53" gracePeriod=2
Jul 07 15:37:16.969523 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:16.969478    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2" podStartSLOduration=2.027791645 podStartE2EDuration="3.969461237s" totalImagesPullingTime="1.941669592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:37:16.969131884 +0000 UTC m=+467.628836359" watchObservedRunningTime="2026-07-07 15:37:16.969461237 +0000 UTC m=+467.629165761"
Jul 07 15:37:16.987771 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:16.987718    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-td4rp" podStartSLOduration=1.485418434 podStartE2EDuration="3.987697149s" totalImagesPullingTime="2.502278715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:37:16.986714366 +0000 UTC m=+467.646418839" watchObservedRunningTime="2026-07-07 15:37:16.987697149 +0000 UTC m=+467.647401622"
Jul 07 15:37:17.200245 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.200178    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-td4rp"
Jul 07 15:37:17.346097 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.346053    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8pcb\" (UniqueName: \"kubernetes.io/projected/183b1788-aae7-43c6-912f-b9f0bfbb8801-kube-api-access-g8pcb\") pod \"183b1788-aae7-43c6-912f-b9f0bfbb8801\" (UID: \"183b1788-aae7-43c6-912f-b9f0bfbb8801\") "
Jul 07 15:37:17.348212 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.348184    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183b1788-aae7-43c6-912f-b9f0bfbb8801-kube-api-access-g8pcb" (OuterVolumeSpecName: "kube-api-access-g8pcb") pod "183b1788-aae7-43c6-912f-b9f0bfbb8801" (UID: "183b1788-aae7-43c6-912f-b9f0bfbb8801"). InnerVolumeSpecName "kube-api-access-g8pcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:37:17.447237 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.447194    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8pcb\" (UniqueName: \"kubernetes.io/projected/183b1788-aae7-43c6-912f-b9f0bfbb8801-kube-api-access-g8pcb\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:37:17.954454 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.954420    2580 generic.go:356] "Generic (PLEG): container finished" podID="183b1788-aae7-43c6-912f-b9f0bfbb8801" containerID="436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53" exitCode=0
Jul 07 15:37:17.954920 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.954462    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-td4rp"
Jul 07 15:37:17.954920 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.954507    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-td4rp" event={"ID":"183b1788-aae7-43c6-912f-b9f0bfbb8801","Type":"ContainerDied","Data":"436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53"}
Jul 07 15:37:17.954920 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.954561    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-td4rp" event={"ID":"183b1788-aae7-43c6-912f-b9f0bfbb8801","Type":"ContainerDied","Data":"8f33a582c5884fc31a4cf074bf08e70b72c5e5f3c570f6aee0a13637b3877b88"}
Jul 07 15:37:17.954920 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.954590    2580 scope.go:117] "RemoveContainer" containerID="436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53"
Jul 07 15:37:17.963323 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.963303    2580 scope.go:117] "RemoveContainer" containerID="436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53"
Jul 07 15:37:17.963590 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:37:17.963571    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53\": container with ID starting with 436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53 not found: ID does not exist" containerID="436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53"
Jul 07 15:37:17.963657 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.963603    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53"} err="failed to get container status \"436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53\": rpc error: code = NotFound desc = could not find container \"436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53\": container with ID starting with 436ef6ac05c49e86a5856af9669b1bb01f6ac7b79c08f632c352fe50fbb40a53 not found: ID does not exist"
Jul 07 15:37:17.974816 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.974795    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td4rp"]
Jul 07 15:37:17.979087 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:17.979068    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-td4rp"]
Jul 07 15:37:19.869638 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:19.869584    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183b1788-aae7-43c6-912f-b9f0bfbb8801" path="/var/lib/kubelet/pods/183b1788-aae7-43c6-912f-b9f0bfbb8801/volumes"
Jul 07 15:37:24.230245 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:24.230216    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:24.230648 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:24.230273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:24.253333 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:24.253304    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:25.008317 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:25.008288    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dq7q2"
Jul 07 15:37:44.373743 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.373707    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"]
Jul 07 15:37:44.374144 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.374055    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183b1788-aae7-43c6-912f-b9f0bfbb8801" containerName="registry-server"
Jul 07 15:37:44.374144 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.374067    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="183b1788-aae7-43c6-912f-b9f0bfbb8801" containerName="registry-server"
Jul 07 15:37:44.374144 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.374132    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="183b1788-aae7-43c6-912f-b9f0bfbb8801" containerName="registry-server"
Jul 07 15:37:44.381794 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.381769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"
Jul 07 15:37:44.384750 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.384726    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 15:37:44.384750 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.384747    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qzkq4\""
Jul 07 15:37:44.389749 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.389727    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"]
Jul 07 15:37:44.481647 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.481590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j259h\" (UniqueName: \"kubernetes.io/projected/9cc133dc-643f-4259-83fc-fd6ed064813e-kube-api-access-j259h\") pod \"dns-operator-controller-manager-864dd78c4c-g2c2r\" (UID: \"9cc133dc-643f-4259-83fc-fd6ed064813e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"
Jul 07 15:37:44.582916 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.582872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j259h\" (UniqueName: \"kubernetes.io/projected/9cc133dc-643f-4259-83fc-fd6ed064813e-kube-api-access-j259h\") pod \"dns-operator-controller-manager-864dd78c4c-g2c2r\" (UID: \"9cc133dc-643f-4259-83fc-fd6ed064813e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"
Jul 07 15:37:44.592466 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.592440    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j259h\" (UniqueName: \"kubernetes.io/projected/9cc133dc-643f-4259-83fc-fd6ed064813e-kube-api-access-j259h\") pod \"dns-operator-controller-manager-864dd78c4c-g2c2r\" (UID: \"9cc133dc-643f-4259-83fc-fd6ed064813e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"
Jul 07 15:37:44.692315 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.692283    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"
Jul 07 15:37:44.830963 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:44.830938    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"]
Jul 07 15:37:44.832590 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:37:44.832554    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc133dc_643f_4259_83fc_fd6ed064813e.slice/crio-2f4fdd47bb0abae5b371c0b810a58dfc6243edfdca9e514163cf94a3af89d066 WatchSource:0}: Error finding container 2f4fdd47bb0abae5b371c0b810a58dfc6243edfdca9e514163cf94a3af89d066: Status 404 returned error can't find the container with id 2f4fdd47bb0abae5b371c0b810a58dfc6243edfdca9e514163cf94a3af89d066
Jul 07 15:37:45.087662 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:45.087540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r" event={"ID":"9cc133dc-643f-4259-83fc-fd6ed064813e","Type":"ContainerStarted","Data":"2f4fdd47bb0abae5b371c0b810a58dfc6243edfdca9e514163cf94a3af89d066"}
Jul 07 15:37:48.105064 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:48.105025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r" event={"ID":"9cc133dc-643f-4259-83fc-fd6ed064813e","Type":"ContainerStarted","Data":"1b8506a1493b4d76d1396ce9c9486f2456a73fa57ed1108a6c5e2c753e5be08f"}
Jul 07 15:37:48.105496 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:48.105155    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"
Jul 07 15:37:48.131037 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:48.130983    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r" podStartSLOduration=1.428187883 podStartE2EDuration="4.130965692s" totalImagesPullingTime="2.702777809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:37:48.128604417 +0000 UTC m=+498.788308903" watchObservedRunningTime="2026-07-07 15:37:48.130965692 +0000 UTC m=+498.790670165"
Jul 07 15:37:49.742501 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.742465    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"]
Jul 07 15:37:49.745917 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.745898    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:49.748441 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.748419    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wz8nb\""
Jul 07 15:37:49.765941 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.765912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"]
Jul 07 15:37:49.828143 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.828109    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqjbl\" (UniqueName: \"kubernetes.io/projected/867350a5-85ab-4dfc-8072-08dc89acd993-kube-api-access-sqjbl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" (UID: \"867350a5-85ab-4dfc-8072-08dc89acd993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:49.828321 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.828150    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/867350a5-85ab-4dfc-8072-08dc89acd993-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" (UID: \"867350a5-85ab-4dfc-8072-08dc89acd993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:49.929109 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.929070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqjbl\" (UniqueName: \"kubernetes.io/projected/867350a5-85ab-4dfc-8072-08dc89acd993-kube-api-access-sqjbl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" (UID: \"867350a5-85ab-4dfc-8072-08dc89acd993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:49.929109 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.929113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/867350a5-85ab-4dfc-8072-08dc89acd993-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" (UID: \"867350a5-85ab-4dfc-8072-08dc89acd993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:49.929468 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.929450    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/867350a5-85ab-4dfc-8072-08dc89acd993-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" (UID: \"867350a5-85ab-4dfc-8072-08dc89acd993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:49.945114 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:49.945081    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqjbl\" (UniqueName: \"kubernetes.io/projected/867350a5-85ab-4dfc-8072-08dc89acd993-kube-api-access-sqjbl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" (UID: \"867350a5-85ab-4dfc-8072-08dc89acd993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:50.056171 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:50.056084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:50.197423 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:50.197387    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"]
Jul 07 15:37:50.200419 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:37:50.200391    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867350a5_85ab_4dfc_8072_08dc89acd993.slice/crio-1c9f21ff9cc77df4be7c5e67c1e9981fd521d8cecc7706cec29da17a95be0de5 WatchSource:0}: Error finding container 1c9f21ff9cc77df4be7c5e67c1e9981fd521d8cecc7706cec29da17a95be0de5: Status 404 returned error can't find the container with id 1c9f21ff9cc77df4be7c5e67c1e9981fd521d8cecc7706cec29da17a95be0de5
Jul 07 15:37:51.121564 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:51.121510    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77" event={"ID":"867350a5-85ab-4dfc-8072-08dc89acd993","Type":"ContainerStarted","Data":"1c9f21ff9cc77df4be7c5e67c1e9981fd521d8cecc7706cec29da17a95be0de5"}
Jul 07 15:37:56.981062 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:56.981023    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-82892"]
Jul 07 15:37:56.984691 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:56.984670    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892"
Jul 07 15:37:56.987201 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:56.987177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-l8lqv\""
Jul 07 15:37:56.998061 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:56.998032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-82892"]
Jul 07 15:37:57.091940 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:57.091891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhnkb\" (UniqueName: \"kubernetes.io/projected/c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25-kube-api-access-rhnkb\") pod \"authorino-operator-75cc8d5cb7-82892\" (UID: \"c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892"
Jul 07 15:37:57.193259 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:57.193216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhnkb\" (UniqueName: \"kubernetes.io/projected/c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25-kube-api-access-rhnkb\") pod \"authorino-operator-75cc8d5cb7-82892\" (UID: \"c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892"
Jul 07 15:37:57.210422 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:57.210395    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhnkb\" (UniqueName: \"kubernetes.io/projected/c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25-kube-api-access-rhnkb\") pod \"authorino-operator-75cc8d5cb7-82892\" (UID: \"c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892"
Jul 07 15:37:57.297754 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:57.297717    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892"
Jul 07 15:37:57.434825 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:57.434797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-82892"]
Jul 07 15:37:57.437723 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:37:57.437693    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ebfc0f_d003_475a_a6f9_f87f4e3c2b25.slice/crio-5743bea62b1ea9f3c99c69284150e2483f66de8be173af5fe67cc8a239fa9d16 WatchSource:0}: Error finding container 5743bea62b1ea9f3c99c69284150e2483f66de8be173af5fe67cc8a239fa9d16: Status 404 returned error can't find the container with id 5743bea62b1ea9f3c99c69284150e2483f66de8be173af5fe67cc8a239fa9d16
Jul 07 15:37:58.155788 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:58.155742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892" event={"ID":"c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25","Type":"ContainerStarted","Data":"5743bea62b1ea9f3c99c69284150e2483f66de8be173af5fe67cc8a239fa9d16"}
Jul 07 15:37:58.157735 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:58.157702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77" event={"ID":"867350a5-85ab-4dfc-8072-08dc89acd993","Type":"ContainerStarted","Data":"66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d"}
Jul 07 15:37:58.157860 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:58.157833    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:37:58.181294 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:58.181239    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77" podStartSLOduration=2.183910312 podStartE2EDuration="9.181218971s" totalImagesPullingTime="6.997308659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:37:58.180696709 +0000 UTC m=+508.840401183" watchObservedRunningTime="2026-07-07 15:37:58.181218971 +0000 UTC m=+508.840923446"
Jul 07 15:37:59.113533 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:37:59.113504    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-g2c2r"
Jul 07 15:38:00.170949 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:00.170841    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892" event={"ID":"c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25","Type":"ContainerStarted","Data":"27c144c2aacd8b743151be5d16e078b58d6107a4fce26017fd219e2a9e12ad02"}
Jul 07 15:38:00.170949 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:00.170926    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892"
Jul 07 15:38:00.195860 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:00.195806    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892" podStartSLOduration=1.8930080569999999 podStartE2EDuration="4.195789337s" totalImagesPullingTime="2.30278128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:00.194836445 +0000 UTC m=+510.854540919" watchObservedRunningTime="2026-07-07 15:38:00.195789337 +0000 UTC m=+510.855493810"
Jul 07 15:38:09.166867 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:09.166835    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:38:10.655224 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.655194    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"]
Jul 07 15:38:10.658572 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.658555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:10.673519 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.673491    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"]
Jul 07 15:38:10.715171 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.715136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4fbba77-2897-4f64-b60e-36576f164a34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" (UID: \"a4fbba77-2897-4f64-b60e-36576f164a34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:10.715353 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.715199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfwzc\" (UniqueName: \"kubernetes.io/projected/a4fbba77-2897-4f64-b60e-36576f164a34-kube-api-access-cfwzc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" (UID: \"a4fbba77-2897-4f64-b60e-36576f164a34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:10.781872 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.781832    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"]
Jul 07 15:38:10.782113 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:10.782094    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-cfwzc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk" podUID="a4fbba77-2897-4f64-b60e-36576f164a34"
Jul 07 15:38:10.816219 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.816181    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfwzc\" (UniqueName: \"kubernetes.io/projected/a4fbba77-2897-4f64-b60e-36576f164a34-kube-api-access-cfwzc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" (UID: \"a4fbba77-2897-4f64-b60e-36576f164a34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:10.816377 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.816332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4fbba77-2897-4f64-b60e-36576f164a34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" (UID: \"a4fbba77-2897-4f64-b60e-36576f164a34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:10.816781 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.816765    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4fbba77-2897-4f64-b60e-36576f164a34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" (UID: \"a4fbba77-2897-4f64-b60e-36576f164a34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:10.830639 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.830595    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"]
Jul 07 15:38:10.834065 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.834043    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:10.850189 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.850160    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfwzc\" (UniqueName: \"kubernetes.io/projected/a4fbba77-2897-4f64-b60e-36576f164a34-kube-api-access-cfwzc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" (UID: \"a4fbba77-2897-4f64-b60e-36576f164a34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:10.917640 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.917530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d44286-391c-4eec-bf4d-98e91181ff56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" (UID: \"58d44286-391c-4eec-bf4d-98e91181ff56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:10.917818 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.917683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7ppk\" (UniqueName: \"kubernetes.io/projected/58d44286-391c-4eec-bf4d-98e91181ff56-kube-api-access-z7ppk\") pod \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" (UID: \"58d44286-391c-4eec-bf4d-98e91181ff56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:10.961370 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:10.961334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"]
Jul 07 15:38:11.018199 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.018152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7ppk\" (UniqueName: \"kubernetes.io/projected/58d44286-391c-4eec-bf4d-98e91181ff56-kube-api-access-z7ppk\") pod \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" (UID: \"58d44286-391c-4eec-bf4d-98e91181ff56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:11.018403 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.018276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d44286-391c-4eec-bf4d-98e91181ff56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" (UID: \"58d44286-391c-4eec-bf4d-98e91181ff56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:11.018724 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.018703    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d44286-391c-4eec-bf4d-98e91181ff56-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" (UID: \"58d44286-391c-4eec-bf4d-98e91181ff56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:11.040068 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.040032    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7ppk\" (UniqueName: \"kubernetes.io/projected/58d44286-391c-4eec-bf4d-98e91181ff56-kube-api-access-z7ppk\") pod \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" (UID: \"58d44286-391c-4eec-bf4d-98e91181ff56\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:11.144546 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.144504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:11.178762 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.178684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-82892"
Jul 07 15:38:11.223990 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.223910    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"]
Jul 07 15:38:11.227008 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.226980    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"]
Jul 07 15:38:11.227712 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.227607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:11.236480 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.236423    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"]
Jul 07 15:38:11.238163 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.238124    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:11.241979 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.241958    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"]
Jul 07 15:38:11.252299 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.252273    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"]
Jul 07 15:38:11.253016 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.252964    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a4fbba77-2897-4f64-b60e-36576f164a34\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\": pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:11.255470 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.255452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:11.259799 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.259759    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:11.261766 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.261742    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"]
Jul 07 15:38:11.261998 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.261949    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77" podUID="867350a5-85ab-4dfc-8072-08dc89acd993" containerName="manager" containerID="cri-o://66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d" gracePeriod=2
Jul 07 15:38:11.272240 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.272204    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"]
Jul 07 15:38:11.274975 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.274922    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"]
Jul 07 15:38:11.290217 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.290156    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:11.292263 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.292173    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:11.295302 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.295209    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"]
Jul 07 15:38:11.295744 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.295726    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867350a5-85ab-4dfc-8072-08dc89acd993" containerName="manager"
Jul 07 15:38:11.295819 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.295746    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="867350a5-85ab-4dfc-8072-08dc89acd993" containerName="manager"
Jul 07 15:38:11.295819 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.295817    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="867350a5-85ab-4dfc-8072-08dc89acd993" containerName="manager"
Jul 07 15:38:11.296737 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.296704    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="867350a5-85ab-4dfc-8072-08dc89acd993" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:38:11.298777 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.298763    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:11.300883 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.300861    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:11.315159 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.315089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"]
Jul 07 15:38:11.320809 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.320782    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfwzc\" (UniqueName: \"kubernetes.io/projected/a4fbba77-2897-4f64-b60e-36576f164a34-kube-api-access-cfwzc\") pod \"a4fbba77-2897-4f64-b60e-36576f164a34\" (UID: \"a4fbba77-2897-4f64-b60e-36576f164a34\") "
Jul 07 15:38:11.320959 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.320849    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4fbba77-2897-4f64-b60e-36576f164a34-extensions-socket-volume\") pod \"a4fbba77-2897-4f64-b60e-36576f164a34\" (UID: \"a4fbba77-2897-4f64-b60e-36576f164a34\") "
Jul 07 15:38:11.321057 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.321022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwrmp\" (UniqueName: \"kubernetes.io/projected/1c0721ea-0792-48c5-907f-ce6aaecb58da-kube-api-access-jwrmp\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww7lz\" (UID: \"1c0721ea-0792-48c5-907f-ce6aaecb58da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:11.321120 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.321090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c0721ea-0792-48c5-907f-ce6aaecb58da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww7lz\" (UID: \"1c0721ea-0792-48c5-907f-ce6aaecb58da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:11.321172 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.321147    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4fbba77-2897-4f64-b60e-36576f164a34-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a4fbba77-2897-4f64-b60e-36576f164a34" (UID: "a4fbba77-2897-4f64-b60e-36576f164a34"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:38:11.322918 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.322893    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4fbba77-2897-4f64-b60e-36576f164a34-kube-api-access-cfwzc" (OuterVolumeSpecName: "kube-api-access-cfwzc") pod "a4fbba77-2897-4f64-b60e-36576f164a34" (UID: "a4fbba77-2897-4f64-b60e-36576f164a34"). InnerVolumeSpecName "kube-api-access-cfwzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:38:11.337006 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.336962    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="867350a5-85ab-4dfc-8072-08dc89acd993" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:38:11.422494 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.422458    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c0721ea-0792-48c5-907f-ce6aaecb58da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww7lz\" (UID: \"1c0721ea-0792-48c5-907f-ce6aaecb58da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:11.422687 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.422646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2kxv\" (UniqueName: \"kubernetes.io/projected/53e74078-e856-4c44-a3dd-afd47e19a0b0-kube-api-access-q2kxv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mpl2n\" (UID: \"53e74078-e856-4c44-a3dd-afd47e19a0b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:11.422764 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.422741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwrmp\" (UniqueName: \"kubernetes.io/projected/1c0721ea-0792-48c5-907f-ce6aaecb58da-kube-api-access-jwrmp\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww7lz\" (UID: \"1c0721ea-0792-48c5-907f-ce6aaecb58da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:11.422821 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.422790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e74078-e856-4c44-a3dd-afd47e19a0b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mpl2n\" (UID: \"53e74078-e856-4c44-a3dd-afd47e19a0b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:11.422880 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.422852    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c0721ea-0792-48c5-907f-ce6aaecb58da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww7lz\" (UID: \"1c0721ea-0792-48c5-907f-ce6aaecb58da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:11.422880 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.422870    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4fbba77-2897-4f64-b60e-36576f164a34-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:11.422958 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.422909    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfwzc\" (UniqueName: \"kubernetes.io/projected/a4fbba77-2897-4f64-b60e-36576f164a34-kube-api-access-cfwzc\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:11.438508 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.438464    2580 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jul 07 15:38:11.438508 ip-10-0-136-174 kubenswrapper[2580]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fklqg_kuadrant-system_58d44286-391c-4eec-bf4d-98e91181ff56_0(f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fklqg to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4" Netns:"/var/run/netns/1bda4482-cf48-4074-9ff1-8b91b320fefc" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-fklqg;K8S_POD_INFRA_CONTAINER_ID=f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4;K8S_POD_UID=58d44286-391c-4eec-bf4d-98e91181ff56" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg/58d44286-391c-4eec-bf4d-98e91181ff56:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:25 [10.133.0.37/23]
Jul 07 15:38:11.438508 ip-10-0-136-174 kubenswrapper[2580]:         '
Jul 07 15:38:11.438508 ip-10-0-136-174 kubenswrapper[2580]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 07 15:38:11.438508 ip-10-0-136-174 kubenswrapper[2580]:  >
Jul 07 15:38:11.438884 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.438543    2580 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jul 07 15:38:11.438884 ip-10-0-136-174 kubenswrapper[2580]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-fklqg_kuadrant-system_58d44286-391c-4eec-bf4d-98e91181ff56_0(f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-fklqg to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4" Netns:"/var/run/netns/1bda4482-cf48-4074-9ff1-8b91b320fefc" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-fklqg;K8S_POD_INFRA_CONTAINER_ID=f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4;K8S_POD_UID=58d44286-391c-4eec-bf4d-98e91181ff56" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg/58d44286-391c-4eec-bf4d-98e91181ff56:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4 network default NAD default NAD key default] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg f4ccd321a89d2dcd9a1c75bb0372a579a070cb48ddbfd9c64b911d697e020ea4 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:85:00:25 [10.133.0.37/23]
Jul 07 15:38:11.438884 ip-10-0-136-174 kubenswrapper[2580]:         '
Jul 07 15:38:11.438884 ip-10-0-136-174 kubenswrapper[2580]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jul 07 15:38:11.438884 ip-10-0-136-174 kubenswrapper[2580]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:11.440906 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.440880    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwrmp\" (UniqueName: \"kubernetes.io/projected/1c0721ea-0792-48c5-907f-ce6aaecb58da-kube-api-access-jwrmp\") pod \"kuadrant-operator-controller-manager-55467d9f7-ww7lz\" (UID: \"1c0721ea-0792-48c5-907f-ce6aaecb58da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:11.491004 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.490977    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:38:11.493130 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.493106    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:11.495120 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:11.495096    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4xh77\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="867350a5-85ab-4dfc-8072-08dc89acd993" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:38:11.523717 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.523684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2kxv\" (UniqueName: \"kubernetes.io/projected/53e74078-e856-4c44-a3dd-afd47e19a0b0-kube-api-access-q2kxv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mpl2n\" (UID: \"53e74078-e856-4c44-a3dd-afd47e19a0b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:11.523857 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.523748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e74078-e856-4c44-a3dd-afd47e19a0b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mpl2n\" (UID: \"53e74078-e856-4c44-a3dd-afd47e19a0b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:11.524075 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.524060    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e74078-e856-4c44-a3dd-afd47e19a0b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mpl2n\" (UID: \"53e74078-e856-4c44-a3dd-afd47e19a0b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:11.540643 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.540601    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2kxv\" (UniqueName: \"kubernetes.io/projected/53e74078-e856-4c44-a3dd-afd47e19a0b0-kube-api-access-q2kxv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mpl2n\" (UID: \"53e74078-e856-4c44-a3dd-afd47e19a0b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:11.569405 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.569376    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:11.625358 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.625332    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/867350a5-85ab-4dfc-8072-08dc89acd993-extensions-socket-volume\") pod \"867350a5-85ab-4dfc-8072-08dc89acd993\" (UID: \"867350a5-85ab-4dfc-8072-08dc89acd993\") "
Jul 07 15:38:11.625501 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.625394    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqjbl\" (UniqueName: \"kubernetes.io/projected/867350a5-85ab-4dfc-8072-08dc89acd993-kube-api-access-sqjbl\") pod \"867350a5-85ab-4dfc-8072-08dc89acd993\" (UID: \"867350a5-85ab-4dfc-8072-08dc89acd993\") "
Jul 07 15:38:11.625878 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.625851    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867350a5-85ab-4dfc-8072-08dc89acd993-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "867350a5-85ab-4dfc-8072-08dc89acd993" (UID: "867350a5-85ab-4dfc-8072-08dc89acd993"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:38:11.627233 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.627212    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867350a5-85ab-4dfc-8072-08dc89acd993-kube-api-access-sqjbl" (OuterVolumeSpecName: "kube-api-access-sqjbl") pod "867350a5-85ab-4dfc-8072-08dc89acd993" (UID: "867350a5-85ab-4dfc-8072-08dc89acd993"). InnerVolumeSpecName "kube-api-access-sqjbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:38:11.644433 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.644398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:11.727581 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.727480    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"]
Jul 07 15:38:11.736206 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.732723    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/867350a5-85ab-4dfc-8072-08dc89acd993-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:11.736206 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.732754    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqjbl\" (UniqueName: \"kubernetes.io/projected/867350a5-85ab-4dfc-8072-08dc89acd993-kube-api-access-sqjbl\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:11.736719 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:38:11.736672    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0721ea_0792_48c5_907f_ce6aaecb58da.slice/crio-66f85689ebc1ae4204c07d92ac8fd2700f1e0f7252632c2129491ea52636f58b WatchSource:0}: Error finding container 66f85689ebc1ae4204c07d92ac8fd2700f1e0f7252632c2129491ea52636f58b: Status 404 returned error can't find the container with id 66f85689ebc1ae4204c07d92ac8fd2700f1e0f7252632c2129491ea52636f58b
Jul 07 15:38:11.825475 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.825440    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"]
Jul 07 15:38:11.829071 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:38:11.829043    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e74078_e856_4c44_a3dd_afd47e19a0b0.slice/crio-602f7da455edd16d294be100468622d6b08e743e2ae72c1db325be755f6ac33d WatchSource:0}: Error finding container 602f7da455edd16d294be100468622d6b08e743e2ae72c1db325be755f6ac33d: Status 404 returned error can't find the container with id 602f7da455edd16d294be100468622d6b08e743e2ae72c1db325be755f6ac33d
Jul 07 15:38:11.871879 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.871845    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="867350a5-85ab-4dfc-8072-08dc89acd993" path="/var/lib/kubelet/pods/867350a5-85ab-4dfc-8072-08dc89acd993/volumes"
Jul 07 15:38:11.872295 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:11.872270    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" path="/var/lib/kubelet/pods/a4fbba77-2897-4f64-b60e-36576f164a34/volumes"
Jul 07 15:38:12.234748 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.234714    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n" event={"ID":"53e74078-e856-4c44-a3dd-afd47e19a0b0","Type":"ContainerStarted","Data":"d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754"}
Jul 07 15:38:12.234936 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.234766    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n" event={"ID":"53e74078-e856-4c44-a3dd-afd47e19a0b0","Type":"ContainerStarted","Data":"602f7da455edd16d294be100468622d6b08e743e2ae72c1db325be755f6ac33d"}
Jul 07 15:38:12.234936 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.234822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:12.236473 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.236448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz" event={"ID":"1c0721ea-0792-48c5-907f-ce6aaecb58da","Type":"ContainerStarted","Data":"bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea"}
Jul 07 15:38:12.236610 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.236491    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz" event={"ID":"1c0721ea-0792-48c5-907f-ce6aaecb58da","Type":"ContainerStarted","Data":"66f85689ebc1ae4204c07d92ac8fd2700f1e0f7252632c2129491ea52636f58b"}
Jul 07 15:38:12.236610 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.236521    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:12.237713 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.237685    2580 generic.go:356] "Generic (PLEG): container finished" podID="867350a5-85ab-4dfc-8072-08dc89acd993" containerID="66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d" exitCode=0
Jul 07 15:38:12.237788 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.237721    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4xh77"
Jul 07 15:38:12.237788 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.237765    2580 scope.go:117] "RemoveContainer" containerID="66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d"
Jul 07 15:38:12.237848 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.237829    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:12.237886 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.237855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:12.247277 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.247254    2580 scope.go:117] "RemoveContainer" containerID="66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d"
Jul 07 15:38:12.247543 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:12.247525    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d\": container with ID starting with 66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d not found: ID does not exist" containerID="66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d"
Jul 07 15:38:12.247603 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.247553    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d"} err="failed to get container status \"66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d\": rpc error: code = NotFound desc = could not find container \"66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d\": container with ID starting with 66cc9c945e28d1f1aaa953ebc9155322f842048ff64f2e8389852ae4dc15712d not found: ID does not exist"
Jul 07 15:38:12.248067 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.248053    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:12.260527 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.260467    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n" podStartSLOduration=1.260449256 podStartE2EDuration="1.260449256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:12.259647681 +0000 UTC m=+522.919352157" watchObservedRunningTime="2026-07-07 15:38:12.260449256 +0000 UTC m=+522.920153731"
Jul 07 15:38:12.282189 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.282135    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz" podStartSLOduration=1.282115199 podStartE2EDuration="1.282115199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:12.281871548 +0000 UTC m=+522.941576022" watchObservedRunningTime="2026-07-07 15:38:12.282115199 +0000 UTC m=+522.941819674"
Jul 07 15:38:12.283871 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:12.283845    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="58d44286-391c-4eec-bf4d-98e91181ff56" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:12.285732 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:12.285700    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:12.336825 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.336793    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d44286-391c-4eec-bf4d-98e91181ff56-extensions-socket-volume\") pod \"58d44286-391c-4eec-bf4d-98e91181ff56\" (UID: \"58d44286-391c-4eec-bf4d-98e91181ff56\") "
Jul 07 15:38:12.337022 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.336850    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7ppk\" (UniqueName: \"kubernetes.io/projected/58d44286-391c-4eec-bf4d-98e91181ff56-kube-api-access-z7ppk\") pod \"58d44286-391c-4eec-bf4d-98e91181ff56\" (UID: \"58d44286-391c-4eec-bf4d-98e91181ff56\") "
Jul 07 15:38:12.337098 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.337041    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58d44286-391c-4eec-bf4d-98e91181ff56-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "58d44286-391c-4eec-bf4d-98e91181ff56" (UID: "58d44286-391c-4eec-bf4d-98e91181ff56"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:38:12.338922 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.338895    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58d44286-391c-4eec-bf4d-98e91181ff56-kube-api-access-z7ppk" (OuterVolumeSpecName: "kube-api-access-z7ppk") pod "58d44286-391c-4eec-bf4d-98e91181ff56" (UID: "58d44286-391c-4eec-bf4d-98e91181ff56"). InnerVolumeSpecName "kube-api-access-z7ppk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:38:12.438037 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.438005    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/58d44286-391c-4eec-bf4d-98e91181ff56-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:12.438037 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:12.438034    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7ppk\" (UniqueName: \"kubernetes.io/projected/58d44286-391c-4eec-bf4d-98e91181ff56-kube-api-access-z7ppk\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:13.244048 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:13.244020    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:13.246246 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:13.246215    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="58d44286-391c-4eec-bf4d-98e91181ff56" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:13.248149 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:13.248125    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:13.252040 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:13.252016    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-fklqg\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="58d44286-391c-4eec-bf4d-98e91181ff56" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-fklqg"
Jul 07 15:38:13.253851 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:13.253829    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-gj5fk\" is forbidden: User \"system:node:ip-10-0-136-174.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-174.ec2.internal' and this object" podUID="a4fbba77-2897-4f64-b60e-36576f164a34" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-gj5fk"
Jul 07 15:38:13.870492 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:13.870459    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58d44286-391c-4eec-bf4d-98e91181ff56" path="/var/lib/kubelet/pods/58d44286-391c-4eec-bf4d-98e91181ff56/volumes"
Jul 07 15:38:23.246262 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.246189    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:23.246262 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.246258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:23.323773 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.323741    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"]
Jul 07 15:38:23.323945 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.323923    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n" podUID="53e74078-e856-4c44-a3dd-afd47e19a0b0" containerName="manager" containerID="cri-o://d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754" gracePeriod=10
Jul 07 15:38:23.578924 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.578892    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:23.722863 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.722820    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"]
Jul 07 15:38:23.723260 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.723242    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53e74078-e856-4c44-a3dd-afd47e19a0b0" containerName="manager"
Jul 07 15:38:23.723346 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.723263    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="53e74078-e856-4c44-a3dd-afd47e19a0b0" containerName="manager"
Jul 07 15:38:23.723403 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.723360    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="53e74078-e856-4c44-a3dd-afd47e19a0b0" containerName="manager"
Jul 07 15:38:23.726334 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.726311    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:23.742726 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.742695    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"]
Jul 07 15:38:23.744097 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.744075    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2kxv\" (UniqueName: \"kubernetes.io/projected/53e74078-e856-4c44-a3dd-afd47e19a0b0-kube-api-access-q2kxv\") pod \"53e74078-e856-4c44-a3dd-afd47e19a0b0\" (UID: \"53e74078-e856-4c44-a3dd-afd47e19a0b0\") "
Jul 07 15:38:23.744176 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.744131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e74078-e856-4c44-a3dd-afd47e19a0b0-extensions-socket-volume\") pod \"53e74078-e856-4c44-a3dd-afd47e19a0b0\" (UID: \"53e74078-e856-4c44-a3dd-afd47e19a0b0\") "
Jul 07 15:38:23.744548 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.744515    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53e74078-e856-4c44-a3dd-afd47e19a0b0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "53e74078-e856-4c44-a3dd-afd47e19a0b0" (UID: "53e74078-e856-4c44-a3dd-afd47e19a0b0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:38:23.746303 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.746278    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53e74078-e856-4c44-a3dd-afd47e19a0b0-kube-api-access-q2kxv" (OuterVolumeSpecName: "kube-api-access-q2kxv") pod "53e74078-e856-4c44-a3dd-afd47e19a0b0" (UID: "53e74078-e856-4c44-a3dd-afd47e19a0b0"). InnerVolumeSpecName "kube-api-access-q2kxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:38:23.845105 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.845023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn57j\" (UniqueName: \"kubernetes.io/projected/535b5316-1487-4bfc-9594-15db45feb2da-kube-api-access-jn57j\") pod \"kuadrant-operator-controller-manager-86878c769f-m2fsl\" (UID: \"535b5316-1487-4bfc-9594-15db45feb2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:23.845105 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.845090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/535b5316-1487-4bfc-9594-15db45feb2da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2fsl\" (UID: \"535b5316-1487-4bfc-9594-15db45feb2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:23.845324 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.845189    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2kxv\" (UniqueName: \"kubernetes.io/projected/53e74078-e856-4c44-a3dd-afd47e19a0b0-kube-api-access-q2kxv\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:23.845324 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.845214    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/53e74078-e856-4c44-a3dd-afd47e19a0b0-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:23.945825 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.945785    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/535b5316-1487-4bfc-9594-15db45feb2da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2fsl\" (UID: \"535b5316-1487-4bfc-9594-15db45feb2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:23.946004 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.945844    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn57j\" (UniqueName: \"kubernetes.io/projected/535b5316-1487-4bfc-9594-15db45feb2da-kube-api-access-jn57j\") pod \"kuadrant-operator-controller-manager-86878c769f-m2fsl\" (UID: \"535b5316-1487-4bfc-9594-15db45feb2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:23.946173 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.946153    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/535b5316-1487-4bfc-9594-15db45feb2da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-m2fsl\" (UID: \"535b5316-1487-4bfc-9594-15db45feb2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:23.961770 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:23.961736    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn57j\" (UniqueName: \"kubernetes.io/projected/535b5316-1487-4bfc-9594-15db45feb2da-kube-api-access-jn57j\") pod \"kuadrant-operator-controller-manager-86878c769f-m2fsl\" (UID: \"535b5316-1487-4bfc-9594-15db45feb2da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:24.036601 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.036556    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:24.191002 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.190881    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"]
Jul 07 15:38:24.298767 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.298732    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl" event={"ID":"535b5316-1487-4bfc-9594-15db45feb2da","Type":"ContainerStarted","Data":"6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18"}
Jul 07 15:38:24.299188 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.298789    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl" event={"ID":"535b5316-1487-4bfc-9594-15db45feb2da","Type":"ContainerStarted","Data":"4eb629249bce3b050e795c4c0e450c2b00ae7e9f0cb5a26256c61b73c2178483"}
Jul 07 15:38:24.299188 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.298869    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:24.300086 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.300064    2580 generic.go:356] "Generic (PLEG): container finished" podID="53e74078-e856-4c44-a3dd-afd47e19a0b0" containerID="d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754" exitCode=0
Jul 07 15:38:24.300194 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.300109    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"
Jul 07 15:38:24.300194 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.300118    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n" event={"ID":"53e74078-e856-4c44-a3dd-afd47e19a0b0","Type":"ContainerDied","Data":"d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754"}
Jul 07 15:38:24.300194 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.300151    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n" event={"ID":"53e74078-e856-4c44-a3dd-afd47e19a0b0","Type":"ContainerDied","Data":"602f7da455edd16d294be100468622d6b08e743e2ae72c1db325be755f6ac33d"}
Jul 07 15:38:24.300194 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.300173    2580 scope.go:117] "RemoveContainer" containerID="d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754"
Jul 07 15:38:24.308362 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.308340    2580 scope.go:117] "RemoveContainer" containerID="d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754"
Jul 07 15:38:24.308667 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:24.308643    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754\": container with ID starting with d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754 not found: ID does not exist" containerID="d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754"
Jul 07 15:38:24.308771 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.308673    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754"} err="failed to get container status \"d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754\": rpc error: code = NotFound desc = could not find container \"d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754\": container with ID starting with d578fbb6247f26f1cba81885a9ca4b87592bfe3925d337c624e35c10e9d2b754 not found: ID does not exist"
Jul 07 15:38:24.332101 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.332045    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl" podStartSLOduration=1.332029303 podStartE2EDuration="1.332029303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:24.331691845 +0000 UTC m=+534.991396318" watchObservedRunningTime="2026-07-07 15:38:24.332029303 +0000 UTC m=+534.991733851"
Jul 07 15:38:24.360690 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.360652    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"]
Jul 07 15:38:24.373296 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:24.373220    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mpl2n"]
Jul 07 15:38:25.870029 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:25.869995    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53e74078-e856-4c44-a3dd-afd47e19a0b0" path="/var/lib/kubelet/pods/53e74078-e856-4c44-a3dd-afd47e19a0b0/volumes"
Jul 07 15:38:35.309605 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.309572    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:38:35.364988 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.364951    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"]
Jul 07 15:38:35.365205 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.365180    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz" podUID="1c0721ea-0792-48c5-907f-ce6aaecb58da" containerName="manager" containerID="cri-o://bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea" gracePeriod=10
Jul 07 15:38:35.621190 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.621165    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:35.646549 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.646520    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c0721ea-0792-48c5-907f-ce6aaecb58da-extensions-socket-volume\") pod \"1c0721ea-0792-48c5-907f-ce6aaecb58da\" (UID: \"1c0721ea-0792-48c5-907f-ce6aaecb58da\") "
Jul 07 15:38:35.646751 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.646591    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwrmp\" (UniqueName: \"kubernetes.io/projected/1c0721ea-0792-48c5-907f-ce6aaecb58da-kube-api-access-jwrmp\") pod \"1c0721ea-0792-48c5-907f-ce6aaecb58da\" (UID: \"1c0721ea-0792-48c5-907f-ce6aaecb58da\") "
Jul 07 15:38:35.647962 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.647929    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c0721ea-0792-48c5-907f-ce6aaecb58da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1c0721ea-0792-48c5-907f-ce6aaecb58da" (UID: "1c0721ea-0792-48c5-907f-ce6aaecb58da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:38:35.657283 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.657248    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c0721ea-0792-48c5-907f-ce6aaecb58da-kube-api-access-jwrmp" (OuterVolumeSpecName: "kube-api-access-jwrmp") pod "1c0721ea-0792-48c5-907f-ce6aaecb58da" (UID: "1c0721ea-0792-48c5-907f-ce6aaecb58da"). InnerVolumeSpecName "kube-api-access-jwrmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:38:35.748935 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.748898    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1c0721ea-0792-48c5-907f-ce6aaecb58da-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:35.748935 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:35.748929    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwrmp\" (UniqueName: \"kubernetes.io/projected/1c0721ea-0792-48c5-907f-ce6aaecb58da-kube-api-access-jwrmp\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:38:36.361712 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.361677    2580 generic.go:356] "Generic (PLEG): container finished" podID="1c0721ea-0792-48c5-907f-ce6aaecb58da" containerID="bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea" exitCode=0
Jul 07 15:38:36.362123 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.361737    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"
Jul 07 15:38:36.362123 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.361771    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz" event={"ID":"1c0721ea-0792-48c5-907f-ce6aaecb58da","Type":"ContainerDied","Data":"bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea"}
Jul 07 15:38:36.362123 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.361831    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz" event={"ID":"1c0721ea-0792-48c5-907f-ce6aaecb58da","Type":"ContainerDied","Data":"66f85689ebc1ae4204c07d92ac8fd2700f1e0f7252632c2129491ea52636f58b"}
Jul 07 15:38:36.362123 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.361859    2580 scope.go:117] "RemoveContainer" containerID="bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea"
Jul 07 15:38:36.370669 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.370466    2580 scope.go:117] "RemoveContainer" containerID="bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea"
Jul 07 15:38:36.370777 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:38:36.370753    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea\": container with ID starting with bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea not found: ID does not exist" containerID="bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea"
Jul 07 15:38:36.370823 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.370787    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea"} err="failed to get container status \"bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea\": rpc error: code = NotFound desc = could not find container \"bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea\": container with ID starting with bdc87a53926c681ea7d3cad877134bc6a7efe0774651529a9ad8377b603385ea not found: ID does not exist"
Jul 07 15:38:36.384102 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.384075    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"]
Jul 07 15:38:36.385541 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:36.385520    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ww7lz"]
Jul 07 15:38:37.869933 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:37.869901    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c0721ea-0792-48c5-907f-ce6aaecb58da" path="/var/lib/kubelet/pods/1c0721ea-0792-48c5-907f-ce6aaecb58da/volumes"
Jul 07 15:38:54.378495 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.378458    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:38:54.379724 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.379695    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c0721ea-0792-48c5-907f-ce6aaecb58da" containerName="manager"
Jul 07 15:38:54.379724 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.379725    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c0721ea-0792-48c5-907f-ce6aaecb58da" containerName="manager"
Jul 07 15:38:54.379919 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.379902    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c0721ea-0792-48c5-907f-ce6aaecb58da" containerName="manager"
Jul 07 15:38:54.383562 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.383537    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:54.386787 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.386753    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-f2wlw\""
Jul 07 15:38:54.386949 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.386913    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 15:38:54.392687 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.392666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:38:54.423108 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.423076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:38:54.516148 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.516113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxcrp\" (UniqueName: \"kubernetes.io/projected/e704c518-8c05-4a27-9c3d-4966606a8b6e-kube-api-access-rxcrp\") pod \"limitador-limitador-54d6d988d5-gjg52\" (UID: \"e704c518-8c05-4a27-9c3d-4966606a8b6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:54.516340 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.516179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e704c518-8c05-4a27-9c3d-4966606a8b6e-config-file\") pod \"limitador-limitador-54d6d988d5-gjg52\" (UID: \"e704c518-8c05-4a27-9c3d-4966606a8b6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:54.617150 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.617113    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e704c518-8c05-4a27-9c3d-4966606a8b6e-config-file\") pod \"limitador-limitador-54d6d988d5-gjg52\" (UID: \"e704c518-8c05-4a27-9c3d-4966606a8b6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:54.617322 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.617178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxcrp\" (UniqueName: \"kubernetes.io/projected/e704c518-8c05-4a27-9c3d-4966606a8b6e-kube-api-access-rxcrp\") pod \"limitador-limitador-54d6d988d5-gjg52\" (UID: \"e704c518-8c05-4a27-9c3d-4966606a8b6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:54.617764 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.617742    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e704c518-8c05-4a27-9c3d-4966606a8b6e-config-file\") pod \"limitador-limitador-54d6d988d5-gjg52\" (UID: \"e704c518-8c05-4a27-9c3d-4966606a8b6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:54.626970 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.626944    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxcrp\" (UniqueName: \"kubernetes.io/projected/e704c518-8c05-4a27-9c3d-4966606a8b6e-kube-api-access-rxcrp\") pod \"limitador-limitador-54d6d988d5-gjg52\" (UID: \"e704c518-8c05-4a27-9c3d-4966606a8b6e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:54.695782 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.695746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:54.833399 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:54.833372    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:38:54.835994 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:38:54.835968    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode704c518_8c05_4a27_9c3d_4966606a8b6e.slice/crio-931a5b88c01f2dfed9ee43482b3927607039caf65615f0961ec444fc2c52e3da WatchSource:0}: Error finding container 931a5b88c01f2dfed9ee43482b3927607039caf65615f0961ec444fc2c52e3da: Status 404 returned error can't find the container with id 931a5b88c01f2dfed9ee43482b3927607039caf65615f0961ec444fc2c52e3da
Jul 07 15:38:55.447740 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:55.447702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52" event={"ID":"e704c518-8c05-4a27-9c3d-4966606a8b6e","Type":"ContainerStarted","Data":"931a5b88c01f2dfed9ee43482b3927607039caf65615f0961ec444fc2c52e3da"}
Jul 07 15:38:58.465165 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:58.465129    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52" event={"ID":"e704c518-8c05-4a27-9c3d-4966606a8b6e","Type":"ContainerStarted","Data":"2e8778a342592634ec46cb12e45de8048c5ad53f8b88e366d2a74fb433a1caff"}
Jul 07 15:38:58.465588 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:58.465270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:38:58.487002 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:38:58.486950    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52" podStartSLOduration=1.7746276619999999 podStartE2EDuration="4.486930242s" totalImagesPullingTime="2.71230258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:58.485967079 +0000 UTC m=+569.145671551" watchObservedRunningTime="2026-07-07 15:38:58.486930242 +0000 UTC m=+569.146634720"
Jul 07 15:39:09.471070 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:39:09.471039    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-gjg52"
Jul 07 15:40:09.957972 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:09.957887    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:40:33.626657 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:33.626589    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:40:40.694776 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:40.694741    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:40:46.723189 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.723153    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"]
Jul 07 15:40:46.727278 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.727256    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.730886 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.730860    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6dn84\""
Jul 07 15:40:46.731031 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.730994    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 15:40:46.731031 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.731024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 15:40:46.731149 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.731034    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 15:40:46.739752 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.739729    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"]
Jul 07 15:40:46.814994 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.814960    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.815169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.815006    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.815169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.815055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwd8x\" (UniqueName: \"kubernetes.io/projected/9af474b0-5b57-4b0a-ab25-83635f9107c7-kube-api-access-kwd8x\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.815169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.815080    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.815169 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.815100    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.815324 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.815174    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9af474b0-5b57-4b0a-ab25-83635f9107c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.915889 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.915852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9af474b0-5b57-4b0a-ab25-83635f9107c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.916072 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.915899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.916072 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.915942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.916072 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.915975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwd8x\" (UniqueName: \"kubernetes.io/projected/9af474b0-5b57-4b0a-ab25-83635f9107c7-kube-api-access-kwd8x\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.916072 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.916013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.916277 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.916136    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.916407 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.916383    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.916458 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.916416    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.916458 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.916451    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.918250 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.918232    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9af474b0-5b57-4b0a-ab25-83635f9107c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.918321 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.918270    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9af474b0-5b57-4b0a-ab25-83635f9107c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:46.925031 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:46.925009    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwd8x\" (UniqueName: \"kubernetes.io/projected/9af474b0-5b57-4b0a-ab25-83635f9107c7-kube-api-access-kwd8x\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rcsmx\" (UID: \"9af474b0-5b57-4b0a-ab25-83635f9107c7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:47.040213 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:47.040129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:47.180216 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:47.180191    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"]
Jul 07 15:40:47.182556 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:40:47.182534    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af474b0_5b57_4b0a_ab25_83635f9107c7.slice/crio-39d4190164a489de05cd20cd4f6fd28833f5dd21b6c4a318ad667bb9e025076a WatchSource:0}: Error finding container 39d4190164a489de05cd20cd4f6fd28833f5dd21b6c4a318ad667bb9e025076a: Status 404 returned error can't find the container with id 39d4190164a489de05cd20cd4f6fd28833f5dd21b6c4a318ad667bb9e025076a
Jul 07 15:40:47.183874 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:47.183853    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 15:40:47.895773 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:47.895740    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:40:47.964450 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:47.964411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx" event={"ID":"9af474b0-5b57-4b0a-ab25-83635f9107c7","Type":"ContainerStarted","Data":"39d4190164a489de05cd20cd4f6fd28833f5dd21b6c4a318ad667bb9e025076a"}
Jul 07 15:40:48.971489 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:48.971451    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx" event={"ID":"9af474b0-5b57-4b0a-ab25-83635f9107c7","Type":"ContainerStarted","Data":"507bcc931e6a194de401418dfabb52e4c74dbf04d0ddf1aa1f30bb0b42399cc5"}
Jul 07 15:40:48.999211 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:48.999152    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx" podStartSLOduration=1.9046472319999999 podStartE2EDuration="2.999131086s" totalImagesPullingTime="1.094483854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:48.999038322 +0000 UTC m=+679.658742796" watchObservedRunningTime="2026-07-07 15:40:48.999131086 +0000 UTC m=+679.658835559"
Jul 07 15:40:53.824907 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.824875    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"]
Jul 07 15:40:53.828162 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.828145    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:53.831081 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.831063    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 15:40:53.842760 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.842737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"]
Jul 07 15:40:53.981812 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.981778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:53.982009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.981817    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:53.982009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.981849    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vtkv\" (UniqueName: \"kubernetes.io/projected/858f8264-e6a3-4350-a7db-a39ccd0eeba5-kube-api-access-8vtkv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:53.982009 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.981970    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/858f8264-e6a3-4350-a7db-a39ccd0eeba5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:53.982191 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.982110    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:53.982332 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:53.982306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083160 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083160 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083160 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083160 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083157    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083488 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vtkv\" (UniqueName: \"kubernetes.io/projected/858f8264-e6a3-4350-a7db-a39ccd0eeba5-kube-api-access-8vtkv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083488 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/858f8264-e6a3-4350-a7db-a39ccd0eeba5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083594 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083545    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083656 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083608    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.083697 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.083671    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.085333 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.085314    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/858f8264-e6a3-4350-a7db-a39ccd0eeba5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.085679 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.085660    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/858f8264-e6a3-4350-a7db-a39ccd0eeba5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.093025 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.092995    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vtkv\" (UniqueName: \"kubernetes.io/projected/858f8264-e6a3-4350-a7db-a39ccd0eeba5-kube-api-access-8vtkv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w\" (UID: \"858f8264-e6a3-4350-a7db-a39ccd0eeba5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.138781 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.138750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:40:54.282909 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:54.282876    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"]
Jul 07 15:40:54.286722 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:40:54.286691    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858f8264_e6a3_4350_a7db_a39ccd0eeba5.slice/crio-4110238b563e6e53575e150052952034aa8e6dc7aa11e7e9e4add16905500c70 WatchSource:0}: Error finding container 4110238b563e6e53575e150052952034aa8e6dc7aa11e7e9e4add16905500c70: Status 404 returned error can't find the container with id 4110238b563e6e53575e150052952034aa8e6dc7aa11e7e9e4add16905500c70
Jul 07 15:40:55.001217 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:55.001184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w" event={"ID":"858f8264-e6a3-4350-a7db-a39ccd0eeba5","Type":"ContainerStarted","Data":"35c1279a31ab92d6d1e1fccd69f0be131a81d8dce502fd8286617523ff956a47"}
Jul 07 15:40:55.001658 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:55.001244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w" event={"ID":"858f8264-e6a3-4350-a7db-a39ccd0eeba5","Type":"ContainerStarted","Data":"4110238b563e6e53575e150052952034aa8e6dc7aa11e7e9e4add16905500c70"}
Jul 07 15:40:55.023277 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:55.023226    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w" podStartSLOduration=1.766147282 podStartE2EDuration="2.023209604s" totalImagesPullingTime="257.062322ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:40:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:40:55.021552371 +0000 UTC m=+685.681256843" watchObservedRunningTime="2026-07-07 15:40:55.023209604 +0000 UTC m=+685.682914078"
Jul 07 15:40:55.296705 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:55.296604    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:40:57.041175 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:57.041143    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:57.041576 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:57.041211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:57.053841 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:57.053816    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:40:58.027276 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:40:58.027242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rcsmx"
Jul 07 15:41:02.948398 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:41:02.948356    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:41:04.139691 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:41:04.139653    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:41:04.140092 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:41:04.139731    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:41:04.152374 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:41:04.152347    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:41:05.059818 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:41:05.059784    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w"
Jul 07 15:41:09.395233 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:41:09.395193    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:42:23.104999 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:42:23.104960    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:42:32.212667 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:42:32.212610    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:42:43.799547 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:42:43.799509    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:42:52.391437 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:42:52.391352    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:43:04.595363 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:43:04.595323    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:43:32.207420 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:43:32.207378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:43:44.314053 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:43:44.314003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:44:19.699377 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:44:19.699339    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:44:29.506790 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:44:29.506702    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:44:36.593269 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:44:36.593233    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:44:47.310998 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:44:47.310957    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:44:59.194880 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:44:59.194844    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:45:10.200046 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:45:10.200000    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:45:21.782989 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:45:21.782953    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:45:30.809433 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:45:30.809394    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:45:54.004332 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:45:54.004249    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:46:05.390589 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:46:05.390551    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:46:29.593390 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:46:29.593357    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:46:39.886389 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:46:39.886356    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:46:55.996699 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:46:55.996664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:47:06.694735 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:47:06.694700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:47:15.992063 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:47:15.992026    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:47:24.788722 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:47:24.788639    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:47:33.787562 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:47:33.787522    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:48:00.612879 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:00.612842    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"]
Jul 07 15:48:00.613461 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:00.613035    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl" podUID="535b5316-1487-4bfc-9594-15db45feb2da" containerName="manager" containerID="cri-o://6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18" gracePeriod=10
Jul 07 15:48:03.275734 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:03.275673    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:48:03.371570 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:03.371541    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/535b5316-1487-4bfc-9594-15db45feb2da-extensions-socket-volume\") pod \"535b5316-1487-4bfc-9594-15db45feb2da\" (UID: \"535b5316-1487-4bfc-9594-15db45feb2da\") "
Jul 07 15:48:03.371570 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:03.371575    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn57j\" (UniqueName: \"kubernetes.io/projected/535b5316-1487-4bfc-9594-15db45feb2da-kube-api-access-jn57j\") pod \"535b5316-1487-4bfc-9594-15db45feb2da\" (UID: \"535b5316-1487-4bfc-9594-15db45feb2da\") "
Jul 07 15:48:03.371914 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:03.371890    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/535b5316-1487-4bfc-9594-15db45feb2da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "535b5316-1487-4bfc-9594-15db45feb2da" (UID: "535b5316-1487-4bfc-9594-15db45feb2da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 15:48:03.373578 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:03.373560    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/535b5316-1487-4bfc-9594-15db45feb2da-kube-api-access-jn57j" (OuterVolumeSpecName: "kube-api-access-jn57j") pod "535b5316-1487-4bfc-9594-15db45feb2da" (UID: "535b5316-1487-4bfc-9594-15db45feb2da"). InnerVolumeSpecName "kube-api-access-jn57j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:48:03.472415 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:03.472384    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/535b5316-1487-4bfc-9594-15db45feb2da-extensions-socket-volume\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:48:03.472415 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:03.472414    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn57j\" (UniqueName: \"kubernetes.io/projected/535b5316-1487-4bfc-9594-15db45feb2da-kube-api-access-jn57j\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:48:04.038875 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.038831    2580 generic.go:356] "Generic (PLEG): container finished" podID="535b5316-1487-4bfc-9594-15db45feb2da" containerID="6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18" exitCode=0
Jul 07 15:48:04.038875 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.038879    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"
Jul 07 15:48:04.039124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.038909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl" event={"ID":"535b5316-1487-4bfc-9594-15db45feb2da","Type":"ContainerDied","Data":"6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18"}
Jul 07 15:48:04.039124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.038960    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl" event={"ID":"535b5316-1487-4bfc-9594-15db45feb2da","Type":"ContainerDied","Data":"4eb629249bce3b050e795c4c0e450c2b00ae7e9f0cb5a26256c61b73c2178483"}
Jul 07 15:48:04.039124 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.038982    2580 scope.go:117] "RemoveContainer" containerID="6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18"
Jul 07 15:48:04.048185 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.048161    2580 scope.go:117] "RemoveContainer" containerID="6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18"
Jul 07 15:48:04.048432 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:48:04.048413    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18\": container with ID starting with 6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18 not found: ID does not exist" containerID="6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18"
Jul 07 15:48:04.048485 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.048440    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18"} err="failed to get container status \"6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18\": rpc error: code = NotFound desc = could not find container \"6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18\": container with ID starting with 6935814758fd1762f8c4fbb097eac0ced563e8530b444e6d2ff1bef75d699b18 not found: ID does not exist"
Jul 07 15:48:04.057817 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.057793    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"]
Jul 07 15:48:04.063348 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:04.063323    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-m2fsl"]
Jul 07 15:48:05.870330 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:48:05.870291    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="535b5316-1487-4bfc-9594-15db45feb2da" path="/var/lib/kubelet/pods/535b5316-1487-4bfc-9594-15db45feb2da/volumes"
Jul 07 15:49:01.801879 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.801800    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"]
Jul 07 15:49:01.802408 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.802227    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="535b5316-1487-4bfc-9594-15db45feb2da" containerName="manager"
Jul 07 15:49:01.802408 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.802243    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="535b5316-1487-4bfc-9594-15db45feb2da" containerName="manager"
Jul 07 15:49:01.802408 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.802319    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="535b5316-1487-4bfc-9594-15db45feb2da" containerName="manager"
Jul 07 15:49:01.805183 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.805165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:01.807548 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.807528    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wz8nb\""
Jul 07 15:49:01.817226 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.817202    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"]
Jul 07 15:49:01.876192 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.876161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/083adc2c-e541-4179-b423-b3a3be0d1aaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d292n\" (UID: \"083adc2c-e541-4179-b423-b3a3be0d1aaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:01.876379 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.876270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q42vh\" (UniqueName: \"kubernetes.io/projected/083adc2c-e541-4179-b423-b3a3be0d1aaa-kube-api-access-q42vh\") pod \"kuadrant-operator-controller-manager-86878c769f-d292n\" (UID: \"083adc2c-e541-4179-b423-b3a3be0d1aaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:01.977556 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.977519    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/083adc2c-e541-4179-b423-b3a3be0d1aaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d292n\" (UID: \"083adc2c-e541-4179-b423-b3a3be0d1aaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:01.977746 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.977576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q42vh\" (UniqueName: \"kubernetes.io/projected/083adc2c-e541-4179-b423-b3a3be0d1aaa-kube-api-access-q42vh\") pod \"kuadrant-operator-controller-manager-86878c769f-d292n\" (UID: \"083adc2c-e541-4179-b423-b3a3be0d1aaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:01.977933 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.977912    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/083adc2c-e541-4179-b423-b3a3be0d1aaa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-d292n\" (UID: \"083adc2c-e541-4179-b423-b3a3be0d1aaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:01.987380 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:01.987357    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q42vh\" (UniqueName: \"kubernetes.io/projected/083adc2c-e541-4179-b423-b3a3be0d1aaa-kube-api-access-q42vh\") pod \"kuadrant-operator-controller-manager-86878c769f-d292n\" (UID: \"083adc2c-e541-4179-b423-b3a3be0d1aaa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:02.115651 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:02.115540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:02.256940 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:02.256916    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"]
Jul 07 15:49:02.259307 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:49:02.259280    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083adc2c_e541_4179_b423_b3a3be0d1aaa.slice/crio-b27260d0a305150bc44fa00142686af63dd256de362256147c3458a2c9c7b456 WatchSource:0}: Error finding container b27260d0a305150bc44fa00142686af63dd256de362256147c3458a2c9c7b456: Status 404 returned error can't find the container with id b27260d0a305150bc44fa00142686af63dd256de362256147c3458a2c9c7b456
Jul 07 15:49:02.317682 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:02.317654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n" event={"ID":"083adc2c-e541-4179-b423-b3a3be0d1aaa","Type":"ContainerStarted","Data":"b27260d0a305150bc44fa00142686af63dd256de362256147c3458a2c9c7b456"}
Jul 07 15:49:03.329859 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:03.329813    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n" event={"ID":"083adc2c-e541-4179-b423-b3a3be0d1aaa","Type":"ContainerStarted","Data":"cda4bb15187004d4468c0fb2a021002c2e95c5ef5635bcd5ada657e0b4e27f11"}
Jul 07 15:49:03.330252 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:03.329961    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:03.355432 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:03.355371    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n" podStartSLOduration=2.355351428 podStartE2EDuration="2.355351428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:49:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:49:03.353539487 +0000 UTC m=+1174.013243962" watchObservedRunningTime="2026-07-07 15:49:03.355351428 +0000 UTC m=+1174.015055906"
Jul 07 15:49:14.337713 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:14.337683    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-d292n"
Jul 07 15:49:24.386419 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:24.386382    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:49:35.809741 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:35.809701    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:49:46.097225 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:46.097188    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:49:54.944939 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:49:54.944901    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:50:13.197954 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:50:13.197913    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:50:23.232394 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:50:23.232313    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:50:33.499474 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:50:33.499439    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:50:43.382002 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:50:43.381956    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:50:53.661615 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:50:53.661576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:51:01.355932 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:51:01.355893    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:51:13.099349 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:51:13.099314    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:51:35.803018 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:51:35.802971    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:51:44.585974 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:51:44.585937    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:51:54.305907 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:51:54.305815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:52:03.286855 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.286815    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:52:03.738113 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.738076    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b54bcbbdb-8gwnh"]
Jul 07 15:52:03.741671 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.741642    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:03.766866 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.766832    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b54bcbbdb-8gwnh"]
Jul 07 15:52:03.902376 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.902341    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/290d3e1d-9eb5-4654-a74e-afd83791edff-console-serving-cert\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:03.902376 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.902380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plxf8\" (UniqueName: \"kubernetes.io/projected/290d3e1d-9eb5-4654-a74e-afd83791edff-kube-api-access-plxf8\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:03.902594 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.902399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-oauth-serving-cert\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:03.902594 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.902489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-console-config\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:03.902594 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.902508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-trusted-ca-bundle\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:03.902594 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.902585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/290d3e1d-9eb5-4654-a74e-afd83791edff-console-oauth-config\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:03.902755 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:03.902603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-service-ca\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.003562 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.003473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/290d3e1d-9eb5-4654-a74e-afd83791edff-console-serving-cert\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.003562 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.003516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxf8\" (UniqueName: \"kubernetes.io/projected/290d3e1d-9eb5-4654-a74e-afd83791edff-kube-api-access-plxf8\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.003562 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.003538    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-oauth-serving-cert\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.003891 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.003574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-console-config\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.003891 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.003589    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-trusted-ca-bundle\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.003891 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.003710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/290d3e1d-9eb5-4654-a74e-afd83791edff-console-oauth-config\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.003891 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.003741    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-service-ca\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.004490 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.004463    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-service-ca\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.004615 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.004463    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-oauth-serving-cert\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.004615 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.004549    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-console-config\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.004782 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.004681    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/290d3e1d-9eb5-4654-a74e-afd83791edff-trusted-ca-bundle\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.006021 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.005999    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/290d3e1d-9eb5-4654-a74e-afd83791edff-console-oauth-config\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.006121 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.006103    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/290d3e1d-9eb5-4654-a74e-afd83791edff-console-serving-cert\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.014535 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.014515    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plxf8\" (UniqueName: \"kubernetes.io/projected/290d3e1d-9eb5-4654-a74e-afd83791edff-kube-api-access-plxf8\") pod \"console-7b54bcbbdb-8gwnh\" (UID: \"290d3e1d-9eb5-4654-a74e-afd83791edff\") " pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.050534 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.050497    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:04.188222 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:04.188192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b54bcbbdb-8gwnh"]
Jul 07 15:52:04.190756 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:52:04.190712    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290d3e1d_9eb5_4654_a74e_afd83791edff.slice/crio-465934024b5ec96aab05d30a06040291ed1e14334a8895641cd0277d63fb40cb WatchSource:0}: Error finding container 465934024b5ec96aab05d30a06040291ed1e14334a8895641cd0277d63fb40cb: Status 404 returned error can't find the container with id 465934024b5ec96aab05d30a06040291ed1e14334a8895641cd0277d63fb40cb
Jul 07 15:52:05.202070 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:05.202028    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b54bcbbdb-8gwnh" event={"ID":"290d3e1d-9eb5-4654-a74e-afd83791edff","Type":"ContainerStarted","Data":"872369c061e71fedd1931f1fc6e2f25f1ea8007e7f165e54ecd2d547b4cf32ce"}
Jul 07 15:52:05.202477 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:05.202099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b54bcbbdb-8gwnh" event={"ID":"290d3e1d-9eb5-4654-a74e-afd83791edff","Type":"ContainerStarted","Data":"465934024b5ec96aab05d30a06040291ed1e14334a8895641cd0277d63fb40cb"}
Jul 07 15:52:05.225213 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:05.225162    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b54bcbbdb-8gwnh" podStartSLOduration=2.225147842 podStartE2EDuration="2.225147842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:52:05.223666418 +0000 UTC m=+1355.883370892" watchObservedRunningTime="2026-07-07 15:52:05.225147842 +0000 UTC m=+1355.884852314"
Jul 07 15:52:14.051327 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:14.051287    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:14.051850 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:14.051348    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:14.056807 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:14.056784    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:14.254249 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:14.254220    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b54bcbbdb-8gwnh"
Jul 07 15:52:14.304602 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:14.304527    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f7dfc5-4wgjc"]
Jul 07 15:52:19.504255 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:19.504222    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:52:28.494985 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:28.494947    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:52:37.292610 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:37.292566    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:52:39.328614 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.328544    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56f7dfc5-4wgjc" podUID="b8fec117-e8bf-45fa-893c-0dfde20a91e9" containerName="console" containerID="cri-o://8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668" gracePeriod=15
Jul 07 15:52:39.581184 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.581128    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:52:39.616256 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-oauth-config\") pod \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") "
Jul 07 15:52:39.616409 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-oauth-serving-cert\") pod \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") "
Jul 07 15:52:39.616409 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-config\") pod \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") "
Jul 07 15:52:39.616409 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616332    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-trusted-ca-bundle\") pod \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") "
Jul 07 15:52:39.616409 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616347    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-service-ca\") pod \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") "
Jul 07 15:52:39.616409 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616385    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-serving-cert\") pod \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") "
Jul 07 15:52:39.616697 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616428    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46xsh\" (UniqueName: \"kubernetes.io/projected/b8fec117-e8bf-45fa-893c-0dfde20a91e9-kube-api-access-46xsh\") pod \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\" (UID: \"b8fec117-e8bf-45fa-893c-0dfde20a91e9\") "
Jul 07 15:52:39.616821 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616798    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-config" (OuterVolumeSpecName: "console-config") pod "b8fec117-e8bf-45fa-893c-0dfde20a91e9" (UID: "b8fec117-e8bf-45fa-893c-0dfde20a91e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:52:39.616884 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616826    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "b8fec117-e8bf-45fa-893c-0dfde20a91e9" (UID: "b8fec117-e8bf-45fa-893c-0dfde20a91e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:52:39.616884 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616838    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b8fec117-e8bf-45fa-893c-0dfde20a91e9" (UID: "b8fec117-e8bf-45fa-893c-0dfde20a91e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:52:39.616884 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.616846    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b8fec117-e8bf-45fa-893c-0dfde20a91e9" (UID: "b8fec117-e8bf-45fa-893c-0dfde20a91e9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 15:52:39.618674 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.618616    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b8fec117-e8bf-45fa-893c-0dfde20a91e9" (UID: "b8fec117-e8bf-45fa-893c-0dfde20a91e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:52:39.618822 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.618800    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8fec117-e8bf-45fa-893c-0dfde20a91e9-kube-api-access-46xsh" (OuterVolumeSpecName: "kube-api-access-46xsh") pod "b8fec117-e8bf-45fa-893c-0dfde20a91e9" (UID: "b8fec117-e8bf-45fa-893c-0dfde20a91e9"). InnerVolumeSpecName "kube-api-access-46xsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 15:52:39.618883 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.618848    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b8fec117-e8bf-45fa-893c-0dfde20a91e9" (UID: "b8fec117-e8bf-45fa-893c-0dfde20a91e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 15:52:39.717551 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.717520    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:52:39.717551 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.717544    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-trusted-ca-bundle\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:52:39.717551 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.717552    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-service-ca\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:52:39.717802 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.717561    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:52:39.717802 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.717570    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46xsh\" (UniqueName: \"kubernetes.io/projected/b8fec117-e8bf-45fa-893c-0dfde20a91e9-kube-api-access-46xsh\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:52:39.717802 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.717578    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8fec117-e8bf-45fa-893c-0dfde20a91e9-console-oauth-config\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:52:39.717802 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:39.717588    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8fec117-e8bf-45fa-893c-0dfde20a91e9-oauth-serving-cert\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 15:52:40.377692 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.377658    2580 generic.go:356] "Generic (PLEG): container finished" podID="b8fec117-e8bf-45fa-893c-0dfde20a91e9" containerID="8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668" exitCode=0
Jul 07 15:52:40.378119 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.377704    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56f7dfc5-4wgjc"
Jul 07 15:52:40.378119 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.377709    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f7dfc5-4wgjc" event={"ID":"b8fec117-e8bf-45fa-893c-0dfde20a91e9","Type":"ContainerDied","Data":"8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668"}
Jul 07 15:52:40.378119 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.377749    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56f7dfc5-4wgjc" event={"ID":"b8fec117-e8bf-45fa-893c-0dfde20a91e9","Type":"ContainerDied","Data":"ea5479179ed8e4f9a51ed0b89e45240be5a67f91b1bd16ec2a784c70be9eb6f7"}
Jul 07 15:52:40.378119 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.377767    2580 scope.go:117] "RemoveContainer" containerID="8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668"
Jul 07 15:52:40.386315 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.386297    2580 scope.go:117] "RemoveContainer" containerID="8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668"
Jul 07 15:52:40.386562 ip-10-0-136-174 kubenswrapper[2580]: E0707 15:52:40.386539    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668\": container with ID starting with 8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668 not found: ID does not exist" containerID="8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668"
Jul 07 15:52:40.386617 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.386570    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668"} err="failed to get container status \"8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668\": rpc error: code = NotFound desc = could not find container \"8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668\": container with ID starting with 8f599180b1659a029035634ebdf61e532142c628ce914948014b8d3c8a7fc668 not found: ID does not exist"
Jul 07 15:52:40.395268 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.395244    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56f7dfc5-4wgjc"]
Jul 07 15:52:40.399521 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:40.399500    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56f7dfc5-4wgjc"]
Jul 07 15:52:41.870117 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:41.870083    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8fec117-e8bf-45fa-893c-0dfde20a91e9" path="/var/lib/kubelet/pods/b8fec117-e8bf-45fa-893c-0dfde20a91e9/volumes"
Jul 07 15:52:47.096966 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:47.096930    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:52:55.588827 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:52:55.588786    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:53:04.985737 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:53:04.985692    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:53:18.296887 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:53:18.296850    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:53:29.201510 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:53:29.201424    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:53:39.091614 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:53:39.091576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:53:51.801224 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:53:51.801181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:54:03.414912 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:54:03.414873    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:54:11.801050 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:54:11.801016    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:54:23.832877 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:54:23.832837    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:54:35.607020 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:54:35.606982    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:54:48.109050 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:54:48.109012    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:54:56.391553 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:54:56.391474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:55:06.406396 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:55:06.406359    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:55:14.799439 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:55:14.799402    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:55:23.830591 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:55:23.830542    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:55:34.226261 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:55:34.226228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:55:40.372647 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:55:40.372598    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:55:48.368017 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:55:48.367978    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:55:57.125019 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:55:57.124979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:56:07.543501 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:56:07.543464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:56:15.968454 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:56:15.968414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:57:47.820333 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:57:47.820293    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:57:55.400087 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:57:55.399997    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:58:02.843724 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:58:02.843692    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:58:10.522094 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:58:10.522053    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:58:21.714152 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:58:21.714113    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:58:56.186507 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:58:56.186473    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:59:15.655208 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.655170    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"]
Jul 07 15:59:15.655581 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.655530    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8fec117-e8bf-45fa-893c-0dfde20a91e9" containerName="console"
Jul 07 15:59:15.655581 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.655541    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8fec117-e8bf-45fa-893c-0dfde20a91e9" containerName="console"
Jul 07 15:59:15.655966 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.655614    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8fec117-e8bf-45fa-893c-0dfde20a91e9" containerName="console"
Jul 07 15:59:15.658695 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.658680    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.661131 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.661111    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cb778c67\"/\"default-dockercfg-8wbv9\""
Jul 07 15:59:15.662247 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.662116    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-cb778c67\"/\"e2e-lifecycle-model-cb778c67-kserve-self-signed-certs\""
Jul 07 15:59:15.664898 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.664879    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cb778c67\"/\"openshift-service-ca.crt\""
Jul 07 15:59:15.665065 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.664943    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-cb778c67\"/\"kube-root-ca.crt\""
Jul 07 15:59:15.672316 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.672295    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"]
Jul 07 15:59:15.760555 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.760519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-tmp-dir\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.760775 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.760557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-home\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.760775 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.760585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fd696d-308c-4690-8e67-661da5941347-tls-certs\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.760775 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.760709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-model-cache\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.760775 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.760746    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29p5r\" (UniqueName: \"kubernetes.io/projected/14fd696d-308c-4690-8e67-661da5941347-kube-api-access-29p5r\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.760983 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.760861    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-dshm\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862143 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-tmp-dir\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862143 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-home\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862385 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fd696d-308c-4690-8e67-661da5941347-tls-certs\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862385 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-model-cache\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862385 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29p5r\" (UniqueName: \"kubernetes.io/projected/14fd696d-308c-4690-8e67-661da5941347-kube-api-access-29p5r\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862546 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-dshm\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862607 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862543    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-model-cache\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862607 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862588    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-home\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.862726 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.862654    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-tmp-dir\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.864512 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.864479    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-dshm\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.864916 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.864896    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fd696d-308c-4690-8e67-661da5941347-tls-certs\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.871211 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.871188    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29p5r\" (UniqueName: \"kubernetes.io/projected/14fd696d-308c-4690-8e67-661da5941347-kube-api-access-29p5r\") pod \"e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") " pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:15.969409 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:15.969368    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:16.107703 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:16.107674    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"]
Jul 07 15:59:16.110770 ip-10-0-136-174 kubenswrapper[2580]: W0707 15:59:16.110740    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14fd696d_308c_4690_8e67_661da5941347.slice/crio-94684134f674cf224b640aa96a5135c08daef3cf15bd67c1dec4453622a7995d WatchSource:0}: Error finding container 94684134f674cf224b640aa96a5135c08daef3cf15bd67c1dec4453622a7995d: Status 404 returned error can't find the container with id 94684134f674cf224b640aa96a5135c08daef3cf15bd67c1dec4453622a7995d
Jul 07 15:59:16.239089 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:16.238994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t" event={"ID":"14fd696d-308c-4690-8e67-661da5941347","Type":"ContainerStarted","Data":"6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731"}
Jul 07 15:59:16.239089 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:16.239038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t" event={"ID":"14fd696d-308c-4690-8e67-661da5941347","Type":"ContainerStarted","Data":"94684134f674cf224b640aa96a5135c08daef3cf15bd67c1dec4453622a7995d"}
Jul 07 15:59:16.262662 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:16.262593    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t" podStartSLOduration=1.262577307 podStartE2EDuration="1.262577307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:59:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:59:16.260548577 +0000 UTC m=+1786.920253055" watchObservedRunningTime="2026-07-07 15:59:16.262577307 +0000 UTC m=+1786.922281780"
Jul 07 15:59:18.703006 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:18.700828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 15:59:25.970619 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:25.970538    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:25.970619 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:25.970581    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:25.983330 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:25.983302    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:26.298476 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:26.298382    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 15:59:59.689361 ip-10-0-136-174 kubenswrapper[2580]: I0707 15:59:59.689325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:00:13.090168 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:13.090133    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:00:13.512785 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:13.512750    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"]
Jul 07 16:00:28.533578 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.533512    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t" podUID="14fd696d-308c-4690-8e67-661da5941347" containerName="main" containerID="cri-o://6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731" gracePeriod=45
Jul 07 16:00:28.784783 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.784716    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 16:00:28.819374 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819343    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-tmp-dir\") pod \"14fd696d-308c-4690-8e67-661da5941347\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") "
Jul 07 16:00:28.819534 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819468    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fd696d-308c-4690-8e67-661da5941347-tls-certs\") pod \"14fd696d-308c-4690-8e67-661da5941347\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") "
Jul 07 16:00:28.819534 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819509    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-model-cache\") pod \"14fd696d-308c-4690-8e67-661da5941347\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") "
Jul 07 16:00:28.819664 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819538    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-home\") pod \"14fd696d-308c-4690-8e67-661da5941347\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") "
Jul 07 16:00:28.819664 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819563    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29p5r\" (UniqueName: \"kubernetes.io/projected/14fd696d-308c-4690-8e67-661da5941347-kube-api-access-29p5r\") pod \"14fd696d-308c-4690-8e67-661da5941347\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") "
Jul 07 16:00:28.819664 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819588    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-dshm\") pod \"14fd696d-308c-4690-8e67-661da5941347\" (UID: \"14fd696d-308c-4690-8e67-661da5941347\") "
Jul 07 16:00:28.819832 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819661    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14fd696d-308c-4690-8e67-661da5941347" (UID: "14fd696d-308c-4690-8e67-661da5941347"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:00:28.819889 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819849    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-home" (OuterVolumeSpecName: "home") pod "14fd696d-308c-4690-8e67-661da5941347" (UID: "14fd696d-308c-4690-8e67-661da5941347"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:00:28.819889 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819861    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-model-cache" (OuterVolumeSpecName: "model-cache") pod "14fd696d-308c-4690-8e67-661da5941347" (UID: "14fd696d-308c-4690-8e67-661da5941347"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:00:28.820000 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.819916    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-tmp-dir\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:00:28.821918 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.821887    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-dshm" (OuterVolumeSpecName: "dshm") pod "14fd696d-308c-4690-8e67-661da5941347" (UID: "14fd696d-308c-4690-8e67-661da5941347"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:00:28.822030 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.821968    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14fd696d-308c-4690-8e67-661da5941347-kube-api-access-29p5r" (OuterVolumeSpecName: "kube-api-access-29p5r") pod "14fd696d-308c-4690-8e67-661da5941347" (UID: "14fd696d-308c-4690-8e67-661da5941347"). InnerVolumeSpecName "kube-api-access-29p5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:00:28.822108 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.822093    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14fd696d-308c-4690-8e67-661da5941347-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14fd696d-308c-4690-8e67-661da5941347" (UID: "14fd696d-308c-4690-8e67-661da5941347"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:00:28.920572 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.920538    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14fd696d-308c-4690-8e67-661da5941347-tls-certs\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:00:28.920572 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.920568    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-model-cache\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:00:28.920804 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.920581    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-home\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:00:28.920804 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.920594    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29p5r\" (UniqueName: \"kubernetes.io/projected/14fd696d-308c-4690-8e67-661da5941347-kube-api-access-29p5r\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:00:28.920804 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:28.920608    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14fd696d-308c-4690-8e67-661da5941347-dshm\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:00:29.594385 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.594346    2580 generic.go:356] "Generic (PLEG): container finished" podID="14fd696d-308c-4690-8e67-661da5941347" containerID="6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731" exitCode=0
Jul 07 16:00:29.594890 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.594393    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"
Jul 07 16:00:29.594890 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.594432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t" event={"ID":"14fd696d-308c-4690-8e67-661da5941347","Type":"ContainerDied","Data":"6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731"}
Jul 07 16:00:29.594890 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.594483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t" event={"ID":"14fd696d-308c-4690-8e67-661da5941347","Type":"ContainerDied","Data":"94684134f674cf224b640aa96a5135c08daef3cf15bd67c1dec4453622a7995d"}
Jul 07 16:00:29.594890 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.594511    2580 scope.go:117] "RemoveContainer" containerID="6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731"
Jul 07 16:00:29.604714 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.604698    2580 scope.go:117] "RemoveContainer" containerID="6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731"
Jul 07 16:00:29.604982 ip-10-0-136-174 kubenswrapper[2580]: E0707 16:00:29.604963    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731\": container with ID starting with 6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731 not found: ID does not exist" containerID="6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731"
Jul 07 16:00:29.605046 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.604990    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731"} err="failed to get container status \"6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731\": rpc error: code = NotFound desc = could not find container \"6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731\": container with ID starting with 6586ba72d94c6263b1ceb2bd335fce8080abf64d46ac5bfaec66d16eef855731 not found: ID does not exist"
Jul 07 16:00:29.618244 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.618223    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"]
Jul 07 16:00:29.620470 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.620453    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-cb778c67/e2e-lifecycle-model-cb778c67-kserve-7c7d7b847f-x9m9t"]
Jul 07 16:00:29.869578 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:29.869505    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14fd696d-308c-4690-8e67-661da5941347" path="/var/lib/kubelet/pods/14fd696d-308c-4690-8e67-661da5941347/volumes"
Jul 07 16:00:54.409681 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:00:54.409588    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:01:03.097962 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:01:03.097923    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:01:16.396845 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:01:16.396798    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:02:04.397775 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:04.397739    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:02:14.606434 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:14.606397    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:02:31.013410 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.013210    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"]
Jul 07 16:02:31.014221 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.014195    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14fd696d-308c-4690-8e67-661da5941347" containerName="main"
Jul 07 16:02:31.014221 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.014219    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14fd696d-308c-4690-8e67-661da5941347" containerName="main"
Jul 07 16:02:31.014408 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.014299    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14fd696d-308c-4690-8e67-661da5941347" containerName="main"
Jul 07 16:02:31.017416 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.017395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.020926 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.020890    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cea508\"/\"default-dockercfg-2fw6x\""
Jul 07 16:02:31.021038 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.020890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cea508\"/\"openshift-service-ca.crt\""
Jul 07 16:02:31.021106 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.020890    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-cea508\"/\"kube-root-ca.crt\""
Jul 07 16:02:31.021106 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.021024    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-cea508\"/\"test-model-cea508-kserve-self-signed-certs\""
Jul 07 16:02:31.024886 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.024536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-home\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.024886 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.024582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-tmp-dir\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.024886 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.024697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129e664a-2cd0-4349-b08c-3c8c9f75128c-tls-certs\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.024886 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.024745    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9n9q\" (UniqueName: \"kubernetes.io/projected/129e664a-2cd0-4349-b08c-3c8c9f75128c-kube-api-access-p9n9q\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.024886 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.024785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-model-cache\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.024886 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.024853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-dshm\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.027689 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.027665    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"]
Jul 07 16:02:31.125919 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.125879    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9n9q\" (UniqueName: \"kubernetes.io/projected/129e664a-2cd0-4349-b08c-3c8c9f75128c-kube-api-access-p9n9q\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.126119 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.125938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-model-cache\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.126119 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.125993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-dshm\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.126119 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.126036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-home\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.126119 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.126065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-tmp-dir\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.126119 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.126118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129e664a-2cd0-4349-b08c-3c8c9f75128c-tls-certs\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.126367 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.126340    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-model-cache\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.126413 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.126394    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-home\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.126467 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.126451    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-tmp-dir\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.128250 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.128222    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-dshm\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.128615 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.128596    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129e664a-2cd0-4349-b08c-3c8c9f75128c-tls-certs\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.134902 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.134870    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9n9q\" (UniqueName: \"kubernetes.io/projected/129e664a-2cd0-4349-b08c-3c8c9f75128c-kube-api-access-p9n9q\") pod \"test-model-cea508-kserve-5cff847649-v6mpc\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") " pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.327791 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.327684    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:31.466845 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:31.466817    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"]
Jul 07 16:02:31.469257 ip-10-0-136-174 kubenswrapper[2580]: W0707 16:02:31.469229    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod129e664a_2cd0_4349_b08c_3c8c9f75128c.slice/crio-6fa88fa4dc98fa3b7c2ff0188dfd14d1ee1be33e3d188e2da28549b359b7081c WatchSource:0}: Error finding container 6fa88fa4dc98fa3b7c2ff0188dfd14d1ee1be33e3d188e2da28549b359b7081c: Status 404 returned error can't find the container with id 6fa88fa4dc98fa3b7c2ff0188dfd14d1ee1be33e3d188e2da28549b359b7081c
Jul 07 16:02:32.176471 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:32.176432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc" event={"ID":"129e664a-2cd0-4349-b08c-3c8c9f75128c","Type":"ContainerStarted","Data":"f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136"}
Jul 07 16:02:32.176471 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:32.176474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc" event={"ID":"129e664a-2cd0-4349-b08c-3c8c9f75128c","Type":"ContainerStarted","Data":"6fa88fa4dc98fa3b7c2ff0188dfd14d1ee1be33e3d188e2da28549b359b7081c"}
Jul 07 16:02:32.194996 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:32.194948    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc" podStartSLOduration=2.194933652 podStartE2EDuration="2.194933652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:02:32.194880876 +0000 UTC m=+1982.854585355" watchObservedRunningTime="2026-07-07 16:02:32.194933652 +0000 UTC m=+1982.854638121"
Jul 07 16:02:33.987715 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:33.987665    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:02:41.328742 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:41.328700    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:41.329247 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:41.328766    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:41.341582 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:41.341553    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:42.232853 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:42.232818    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:02:44.593255 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:02:44.593216    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:03:04.226015 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.225982    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"]
Jul 07 16:03:04.229286 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.229267    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.232548 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.232523    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-54264f\"/\"kube-root-ca.crt\""
Jul 07 16:03:04.232548 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.232544    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-54264f\"/\"test-model-54264f-kserve-self-signed-certs\""
Jul 07 16:03:04.232767 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.232571    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-54264f\"/\"openshift-service-ca.crt\""
Jul 07 16:03:04.232767 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.232535    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-54264f\"/\"default-dockercfg-9xd8t\""
Jul 07 16:03:04.242026 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.242003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"]
Jul 07 16:03:04.323036 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.323003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-model-cache\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.323221 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.323045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tmp-dir\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.323221 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.323141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-dshm\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.323221 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.323172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk8lz\" (UniqueName: \"kubernetes.io/projected/5a73a3ee-f614-4c0c-984f-686a18c88bcf-kube-api-access-wk8lz\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.323221 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.323212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-home\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.323392 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.323236    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tls-certs\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.424473 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.424421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-dshm\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.424704 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.424483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk8lz\" (UniqueName: \"kubernetes.io/projected/5a73a3ee-f614-4c0c-984f-686a18c88bcf-kube-api-access-wk8lz\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.424704 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.424534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-home\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.424704 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.424568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tls-certs\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.424704 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.424651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-model-cache\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.424704 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.424687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tmp-dir\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.424997 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.424954    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-home\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.425106 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.425077    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tmp-dir\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.425219 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.425180    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-model-cache\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.427199 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.427180    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-dshm\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.427514 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.427490    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tls-certs\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.433497 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.433476    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk8lz\" (UniqueName: \"kubernetes.io/projected/5a73a3ee-f614-4c0c-984f-686a18c88bcf-kube-api-access-wk8lz\") pod \"test-model-54264f-kserve-96854655f-g4c7g\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") " pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.540377 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.540294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:04.678017 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:04.677993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"]
Jul 07 16:03:04.680221 ip-10-0-136-174 kubenswrapper[2580]: W0707 16:03:04.680184    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a73a3ee_f614_4c0c_984f_686a18c88bcf.slice/crio-1e086105699f6db58381208271f31f7b4fa1dc13dcd3263eb258133a5e08a3d4 WatchSource:0}: Error finding container 1e086105699f6db58381208271f31f7b4fa1dc13dcd3263eb258133a5e08a3d4: Status 404 returned error can't find the container with id 1e086105699f6db58381208271f31f7b4fa1dc13dcd3263eb258133a5e08a3d4
Jul 07 16:03:05.334162 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:05.334124    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g" event={"ID":"5a73a3ee-f614-4c0c-984f-686a18c88bcf","Type":"ContainerStarted","Data":"c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8"}
Jul 07 16:03:05.334533 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:05.334172    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g" event={"ID":"5a73a3ee-f614-4c0c-984f-686a18c88bcf","Type":"ContainerStarted","Data":"1e086105699f6db58381208271f31f7b4fa1dc13dcd3263eb258133a5e08a3d4"}
Jul 07 16:03:05.353851 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:05.353798    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g" podStartSLOduration=1.353781446 podStartE2EDuration="1.353781446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:03:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:03:05.351533286 +0000 UTC m=+2016.011237761" watchObservedRunningTime="2026-07-07 16:03:05.353781446 +0000 UTC m=+2016.013485919"
Jul 07 16:03:08.391587 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:08.391548    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:03:14.540979 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:14.540934    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:14.541412 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:14.541002    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:14.554222 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:14.554196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:15.393835 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:15.393806    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:20.990696 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:20.990657    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:03:23.973925 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:23.973886    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"]
Jul 07 16:03:24.917935 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:24.917905    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"]
Jul 07 16:03:35.625478 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:35.625431    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:03:38.995140 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:38.995100    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc" podUID="129e664a-2cd0-4349-b08c-3c8c9f75128c" containerName="main" containerID="cri-o://f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136" gracePeriod=45
Jul 07 16:03:39.247868 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.247804    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:03:39.333357 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333322    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-tmp-dir\") pod \"129e664a-2cd0-4349-b08c-3c8c9f75128c\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") "
Jul 07 16:03:39.333550 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333375    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129e664a-2cd0-4349-b08c-3c8c9f75128c-tls-certs\") pod \"129e664a-2cd0-4349-b08c-3c8c9f75128c\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") "
Jul 07 16:03:39.333550 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333403    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-model-cache\") pod \"129e664a-2cd0-4349-b08c-3c8c9f75128c\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") "
Jul 07 16:03:39.333550 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333420    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-dshm\") pod \"129e664a-2cd0-4349-b08c-3c8c9f75128c\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") "
Jul 07 16:03:39.333550 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333458    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9n9q\" (UniqueName: \"kubernetes.io/projected/129e664a-2cd0-4349-b08c-3c8c9f75128c-kube-api-access-p9n9q\") pod \"129e664a-2cd0-4349-b08c-3c8c9f75128c\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") "
Jul 07 16:03:39.333550 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333501    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-home\") pod \"129e664a-2cd0-4349-b08c-3c8c9f75128c\" (UID: \"129e664a-2cd0-4349-b08c-3c8c9f75128c\") "
Jul 07 16:03:39.333827 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333660    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "129e664a-2cd0-4349-b08c-3c8c9f75128c" (UID: "129e664a-2cd0-4349-b08c-3c8c9f75128c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:03:39.333827 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333725    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-model-cache" (OuterVolumeSpecName: "model-cache") pod "129e664a-2cd0-4349-b08c-3c8c9f75128c" (UID: "129e664a-2cd0-4349-b08c-3c8c9f75128c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:03:39.333953 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333878    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-model-cache\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:39.333953 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333899    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-tmp-dir\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:39.333953 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.333882    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-home" (OuterVolumeSpecName: "home") pod "129e664a-2cd0-4349-b08c-3c8c9f75128c" (UID: "129e664a-2cd0-4349-b08c-3c8c9f75128c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:03:39.335717 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.335692    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-dshm" (OuterVolumeSpecName: "dshm") pod "129e664a-2cd0-4349-b08c-3c8c9f75128c" (UID: "129e664a-2cd0-4349-b08c-3c8c9f75128c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:03:39.335828 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.335764    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/129e664a-2cd0-4349-b08c-3c8c9f75128c-kube-api-access-p9n9q" (OuterVolumeSpecName: "kube-api-access-p9n9q") pod "129e664a-2cd0-4349-b08c-3c8c9f75128c" (UID: "129e664a-2cd0-4349-b08c-3c8c9f75128c"). InnerVolumeSpecName "kube-api-access-p9n9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:03:39.335828 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.335786    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/129e664a-2cd0-4349-b08c-3c8c9f75128c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "129e664a-2cd0-4349-b08c-3c8c9f75128c" (UID: "129e664a-2cd0-4349-b08c-3c8c9f75128c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:03:39.434338 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.434303    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9n9q\" (UniqueName: \"kubernetes.io/projected/129e664a-2cd0-4349-b08c-3c8c9f75128c-kube-api-access-p9n9q\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:39.434338 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.434335    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-home\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:39.434338 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.434344    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/129e664a-2cd0-4349-b08c-3c8c9f75128c-tls-certs\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:39.434569 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.434353    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/129e664a-2cd0-4349-b08c-3c8c9f75128c-dshm\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:39.499399 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.499303    2580 generic.go:356] "Generic (PLEG): container finished" podID="129e664a-2cd0-4349-b08c-3c8c9f75128c" containerID="f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136" exitCode=0
Jul 07 16:03:39.499399 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.499362    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"
Jul 07 16:03:39.499591 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.499394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc" event={"ID":"129e664a-2cd0-4349-b08c-3c8c9f75128c","Type":"ContainerDied","Data":"f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136"}
Jul 07 16:03:39.499591 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.499440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc" event={"ID":"129e664a-2cd0-4349-b08c-3c8c9f75128c","Type":"ContainerDied","Data":"6fa88fa4dc98fa3b7c2ff0188dfd14d1ee1be33e3d188e2da28549b359b7081c"}
Jul 07 16:03:39.499591 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.499457    2580 scope.go:117] "RemoveContainer" containerID="f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136"
Jul 07 16:03:39.508129 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.508112    2580 scope.go:117] "RemoveContainer" containerID="f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136"
Jul 07 16:03:39.508369 ip-10-0-136-174 kubenswrapper[2580]: E0707 16:03:39.508351    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136\": container with ID starting with f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136 not found: ID does not exist" containerID="f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136"
Jul 07 16:03:39.508426 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.508376    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136"} err="failed to get container status \"f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136\": rpc error: code = NotFound desc = could not find container \"f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136\": container with ID starting with f71aca8aa41f34ad615c88f40019d006cf621380334fafca72f7b84d91ed0136 not found: ID does not exist"
Jul 07 16:03:39.520472 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.520447    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"]
Jul 07 16:03:39.524856 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.524832    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-cea508/test-model-cea508-kserve-5cff847649-v6mpc"]
Jul 07 16:03:39.870955 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.870861    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="129e664a-2cd0-4349-b08c-3c8c9f75128c" path="/var/lib/kubelet/pods/129e664a-2cd0-4349-b08c-3c8c9f75128c/volumes"
Jul 07 16:03:39.938347 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:39.938288    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g" podUID="5a73a3ee-f614-4c0c-984f-686a18c88bcf" containerName="main" containerID="cri-o://c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8" gracePeriod=45
Jul 07 16:03:40.191211 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.191180    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:40.243258 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243230    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-model-cache\") pod \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") "
Jul 07 16:03:40.243420 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243265    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tmp-dir\") pod \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") "
Jul 07 16:03:40.243420 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243325    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tls-certs\") pod \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") "
Jul 07 16:03:40.243420 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-home\") pod \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") "
Jul 07 16:03:40.243420 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243412    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-dshm\") pod \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") "
Jul 07 16:03:40.243664 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243428    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk8lz\" (UniqueName: \"kubernetes.io/projected/5a73a3ee-f614-4c0c-984f-686a18c88bcf-kube-api-access-wk8lz\") pod \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\" (UID: \"5a73a3ee-f614-4c0c-984f-686a18c88bcf\") "
Jul 07 16:03:40.243664 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243493    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a73a3ee-f614-4c0c-984f-686a18c88bcf" (UID: "5a73a3ee-f614-4c0c-984f-686a18c88bcf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:03:40.243664 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243560    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a73a3ee-f614-4c0c-984f-686a18c88bcf" (UID: "5a73a3ee-f614-4c0c-984f-686a18c88bcf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:03:40.243802 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243682    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-home" (OuterVolumeSpecName: "home") pod "5a73a3ee-f614-4c0c-984f-686a18c88bcf" (UID: "5a73a3ee-f614-4c0c-984f-686a18c88bcf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:03:40.243802 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243719    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-model-cache\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:40.243802 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.243732    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tmp-dir\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:40.245723 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.245702    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-dshm" (OuterVolumeSpecName: "dshm") pod "5a73a3ee-f614-4c0c-984f-686a18c88bcf" (UID: "5a73a3ee-f614-4c0c-984f-686a18c88bcf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:03:40.245809 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.245705    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a73a3ee-f614-4c0c-984f-686a18c88bcf" (UID: "5a73a3ee-f614-4c0c-984f-686a18c88bcf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:03:40.245853 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.245817    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a73a3ee-f614-4c0c-984f-686a18c88bcf-kube-api-access-wk8lz" (OuterVolumeSpecName: "kube-api-access-wk8lz") pod "5a73a3ee-f614-4c0c-984f-686a18c88bcf" (UID: "5a73a3ee-f614-4c0c-984f-686a18c88bcf"). InnerVolumeSpecName "kube-api-access-wk8lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:03:40.344691 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.344655    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-home\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:40.344691 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.344683    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a73a3ee-f614-4c0c-984f-686a18c88bcf-dshm\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:40.344691 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.344692    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk8lz\" (UniqueName: \"kubernetes.io/projected/5a73a3ee-f614-4c0c-984f-686a18c88bcf-kube-api-access-wk8lz\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:40.344934 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.344703    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a73a3ee-f614-4c0c-984f-686a18c88bcf-tls-certs\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:03:40.505645 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.505591    2580 generic.go:356] "Generic (PLEG): container finished" podID="5a73a3ee-f614-4c0c-984f-686a18c88bcf" containerID="c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8" exitCode=0
Jul 07 16:03:40.505817 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.505663    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"
Jul 07 16:03:40.505817 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.505689    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g" event={"ID":"5a73a3ee-f614-4c0c-984f-686a18c88bcf","Type":"ContainerDied","Data":"c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8"}
Jul 07 16:03:40.505817 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.505739    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g" event={"ID":"5a73a3ee-f614-4c0c-984f-686a18c88bcf","Type":"ContainerDied","Data":"1e086105699f6db58381208271f31f7b4fa1dc13dcd3263eb258133a5e08a3d4"}
Jul 07 16:03:40.505817 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.505758    2580 scope.go:117] "RemoveContainer" containerID="c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8"
Jul 07 16:03:40.514909 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.514888    2580 scope.go:117] "RemoveContainer" containerID="c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8"
Jul 07 16:03:40.515179 ip-10-0-136-174 kubenswrapper[2580]: E0707 16:03:40.515155    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8\": container with ID starting with c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8 not found: ID does not exist" containerID="c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8"
Jul 07 16:03:40.515258 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.515192    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8"} err="failed to get container status \"c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8\": rpc error: code = NotFound desc = could not find container \"c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8\": container with ID starting with c8851a4e2f0ed803de174532322a9f49637f3df263c9569d6ae38f1250baceb8 not found: ID does not exist"
Jul 07 16:03:40.532562 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.532535    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"]
Jul 07 16:03:40.539608 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:40.539583    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-54264f/test-model-54264f-kserve-96854655f-g4c7g"]
Jul 07 16:03:41.870308 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:03:41.870271    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a73a3ee-f614-4c0c-984f-686a18c88bcf" path="/var/lib/kubelet/pods/5a73a3ee-f614-4c0c-984f-686a18c88bcf/volumes"
Jul 07 16:04:12.309479 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:04:12.309395    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:04:25.385271 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:04:25.385237    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:04:32.815099 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:04:32.815060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:04:47.455058 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:04:47.455025    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:04:56.985506 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:04:56.985466    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:05:06.865099 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:06.865058    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:05:14.911787 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:14.911751    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:05:26.307264 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.307178    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"]
Jul 07 16:05:26.307693 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.307563    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="129e664a-2cd0-4349-b08c-3c8c9f75128c" containerName="main"
Jul 07 16:05:26.307693 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.307575    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="129e664a-2cd0-4349-b08c-3c8c9f75128c" containerName="main"
Jul 07 16:05:26.307693 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.307590    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a73a3ee-f614-4c0c-984f-686a18c88bcf" containerName="main"
Jul 07 16:05:26.307693 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.307597    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a73a3ee-f614-4c0c-984f-686a18c88bcf" containerName="main"
Jul 07 16:05:26.307693 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.307692    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a73a3ee-f614-4c0c-984f-686a18c88bcf" containerName="main"
Jul 07 16:05:26.307867 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.307705    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="129e664a-2cd0-4349-b08c-3c8c9f75128c" containerName="main"
Jul 07 16:05:26.311003 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.310984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.313451 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.313428    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e777d\"/\"openshift-service-ca.crt\""
Jul 07 16:05:26.313561 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.313469    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-4e777d\"/\"kube-root-ca.crt\""
Jul 07 16:05:26.314227 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.314205    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e777d\"/\"default-dockercfg-q7dft\""
Jul 07 16:05:26.314315 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.314245    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e777d\"/\"auth-test-model-4e777d-kserve-self-signed-certs\""
Jul 07 16:05:26.323728 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.323697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"]
Jul 07 16:05:26.381098 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.381061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tmp-dir\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.381313 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.381142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-home\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.381313 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.381177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tls-certs\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.381313 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.381215    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt7ws\" (UniqueName: \"kubernetes.io/projected/b12ef7e4-f615-401d-b76b-a03c68fe5e09-kube-api-access-wt7ws\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.381313 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.381251    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-model-cache\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.381313 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.381312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-dshm\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.483148 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.483108    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-dshm\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.483606 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.483577    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tmp-dir\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.483893 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.483873    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-home\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.484028 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.484014    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tls-certs\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.484153 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.484138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt7ws\" (UniqueName: \"kubernetes.io/projected/b12ef7e4-f615-401d-b76b-a03c68fe5e09-kube-api-access-wt7ws\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.484277 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.484259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-model-cache\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.484895 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.484872    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-model-cache\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.489686 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.489655    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-home\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.489802 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.489711    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tmp-dir\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.490649 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.490597    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-dshm\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.492794 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.492767    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tls-certs\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.498582 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.498561    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt7ws\" (UniqueName: \"kubernetes.io/projected/b12ef7e4-f615-401d-b76b-a03c68fe5e09-kube-api-access-wt7ws\") pod \"auth-test-model-4e777d-kserve-74dfb84b7-gn6qd\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") " pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.622448 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.622357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:26.764170 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:26.764142    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"]
Jul 07 16:05:26.766133 ip-10-0-136-174 kubenswrapper[2580]: W0707 16:05:26.766106    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb12ef7e4_f615_401d_b76b_a03c68fe5e09.slice/crio-6423b30b706945244e31f83c840d8f24945be94955d7064b17066695da25186e WatchSource:0}: Error finding container 6423b30b706945244e31f83c840d8f24945be94955d7064b17066695da25186e: Status 404 returned error can't find the container with id 6423b30b706945244e31f83c840d8f24945be94955d7064b17066695da25186e
Jul 07 16:05:27.028113 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:27.028074    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd" event={"ID":"b12ef7e4-f615-401d-b76b-a03c68fe5e09","Type":"ContainerStarted","Data":"cc00610e5d2f1b8b35c03e98d883800c72bc0974604b58bacc98b16197773521"}
Jul 07 16:05:27.028302 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:27.028122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd" event={"ID":"b12ef7e4-f615-401d-b76b-a03c68fe5e09","Type":"ContainerStarted","Data":"6423b30b706945244e31f83c840d8f24945be94955d7064b17066695da25186e"}
Jul 07 16:05:27.048719 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:27.048659    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd" podStartSLOduration=1.048644812 podStartE2EDuration="1.048644812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:05:27.046598255 +0000 UTC m=+2157.706302762" watchObservedRunningTime="2026-07-07 16:05:27.048644812 +0000 UTC m=+2157.708349283"
Jul 07 16:05:29.299070 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:29.299034    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:05:36.623225 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:36.623191    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:36.623757 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:36.623252    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:36.636237 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:36.636210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:37.087819 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:37.087785    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:05:51.386333 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:05:51.386297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:06:06.796810 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:06:06.796760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:06:20.702479 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:06:20.702439    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:06:36.888230 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:06:36.888194    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:06:50.785350 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:06:50.785312    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:07:07.592691 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:07.592590    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:07:23.592956 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:23.592920    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:07:37.986921 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:37.986877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:07:42.601521 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:42.601482    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"]
Jul 07 16:07:52.218152 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.218110    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"]
Jul 07 16:07:52.221803 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.221779    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.224248 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.224219    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e777d\"/\"sub-test-model-4e777d-kserve-self-signed-certs\""
Jul 07 16:07:52.232939 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.232915    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"]
Jul 07 16:07:52.306257 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.306225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-home\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.306475 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.306266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tmp-dir\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.306475 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.306290    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-dshm\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.306475 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.306399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-model-cache\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.306475 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.306467    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tls-certs\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.306740 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.306543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgjzr\" (UniqueName: \"kubernetes.io/projected/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-kube-api-access-lgjzr\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407277 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tmp-dir\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407277 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-dshm\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407509 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-model-cache\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407509 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tls-certs\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407509 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgjzr\" (UniqueName: \"kubernetes.io/projected/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-kube-api-access-lgjzr\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407509 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-home\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407796 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407773    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tmp-dir\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407851 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407826    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-model-cache\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.407908 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.407855    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-home\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.409685 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.409665    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-dshm\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.409991 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.409970    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tls-certs\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.418102 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.418077    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgjzr\" (UniqueName: \"kubernetes.io/projected/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-kube-api-access-lgjzr\") pod \"sub-test-model-4e777d-kserve-847667588c-qlccn\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") " pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.532566 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.532472    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:07:52.673039 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.672968    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"]
Jul 07 16:07:52.675481 ip-10-0-136-174 kubenswrapper[2580]: W0707 16:07:52.675451    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82a3d2bf_c1b5_470b_bd3b_8802b0d7a4b2.slice/crio-32d32495e2432d1450ca76413a57b41f61049efee94d57c727bf168506b75690 WatchSource:0}: Error finding container 32d32495e2432d1450ca76413a57b41f61049efee94d57c727bf168506b75690: Status 404 returned error can't find the container with id 32d32495e2432d1450ca76413a57b41f61049efee94d57c727bf168506b75690
Jul 07 16:07:52.735046 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:52.735010    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn" event={"ID":"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2","Type":"ContainerStarted","Data":"32d32495e2432d1450ca76413a57b41f61049efee94d57c727bf168506b75690"}
Jul 07 16:07:53.742184 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:53.742149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn" event={"ID":"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2","Type":"ContainerStarted","Data":"5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca"}
Jul 07 16:07:53.763675 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:53.763604    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn" podStartSLOduration=1.763587347 podStartE2EDuration="1.763587347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:07:53.761015178 +0000 UTC m=+2304.420719648" watchObservedRunningTime="2026-07-07 16:07:53.763587347 +0000 UTC m=+2304.423291819"
Jul 07 16:07:54.804977 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:54.804942    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:07:57.622206 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:57.622145    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd" podUID="b12ef7e4-f615-401d-b76b-a03c68fe5e09" containerName="main" containerID="cri-o://cc00610e5d2f1b8b35c03e98d883800c72bc0974604b58bacc98b16197773521" gracePeriod=45
Jul 07 16:07:57.765166 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:57.765134    2580 generic.go:356] "Generic (PLEG): container finished" podID="b12ef7e4-f615-401d-b76b-a03c68fe5e09" containerID="cc00610e5d2f1b8b35c03e98d883800c72bc0974604b58bacc98b16197773521" exitCode=0
Jul 07 16:07:57.765362 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:57.765215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd" event={"ID":"b12ef7e4-f615-401d-b76b-a03c68fe5e09","Type":"ContainerDied","Data":"cc00610e5d2f1b8b35c03e98d883800c72bc0974604b58bacc98b16197773521"}
Jul 07 16:07:57.883129 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:57.883068    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:07:58.067924 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.067883    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-dshm\") pod \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") "
Jul 07 16:07:58.068131 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.067940    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-model-cache\") pod \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") "
Jul 07 16:07:58.068131 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.067977    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tmp-dir\") pod \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") "
Jul 07 16:07:58.068131 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068009    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt7ws\" (UniqueName: \"kubernetes.io/projected/b12ef7e4-f615-401d-b76b-a03c68fe5e09-kube-api-access-wt7ws\") pod \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") "
Jul 07 16:07:58.068131 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-home\") pod \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") "
Jul 07 16:07:58.068131 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068089    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tls-certs\") pod \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\" (UID: \"b12ef7e4-f615-401d-b76b-a03c68fe5e09\") "
Jul 07 16:07:58.068372 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068243    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b12ef7e4-f615-401d-b76b-a03c68fe5e09" (UID: "b12ef7e4-f615-401d-b76b-a03c68fe5e09"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:07:58.068372 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068255    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-model-cache" (OuterVolumeSpecName: "model-cache") pod "b12ef7e4-f615-401d-b76b-a03c68fe5e09" (UID: "b12ef7e4-f615-401d-b76b-a03c68fe5e09"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:07:58.068372 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068342    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-home" (OuterVolumeSpecName: "home") pod "b12ef7e4-f615-401d-b76b-a03c68fe5e09" (UID: "b12ef7e4-f615-401d-b76b-a03c68fe5e09"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:07:58.068513 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068409    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-home\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.068513 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068423    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-model-cache\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.068513 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.068434    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tmp-dir\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.070206 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.070185    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-dshm" (OuterVolumeSpecName: "dshm") pod "b12ef7e4-f615-401d-b76b-a03c68fe5e09" (UID: "b12ef7e4-f615-401d-b76b-a03c68fe5e09"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:07:58.070303 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.070275    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b12ef7e4-f615-401d-b76b-a03c68fe5e09-kube-api-access-wt7ws" (OuterVolumeSpecName: "kube-api-access-wt7ws") pod "b12ef7e4-f615-401d-b76b-a03c68fe5e09" (UID: "b12ef7e4-f615-401d-b76b-a03c68fe5e09"). InnerVolumeSpecName "kube-api-access-wt7ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:07:58.070349 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.070290    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b12ef7e4-f615-401d-b76b-a03c68fe5e09" (UID: "b12ef7e4-f615-401d-b76b-a03c68fe5e09"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:07:58.169196 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.169099    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b12ef7e4-f615-401d-b76b-a03c68fe5e09-dshm\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.169196 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.169127    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt7ws\" (UniqueName: \"kubernetes.io/projected/b12ef7e4-f615-401d-b76b-a03c68fe5e09-kube-api-access-wt7ws\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.169196 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.169138    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b12ef7e4-f615-401d-b76b-a03c68fe5e09-tls-certs\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:07:58.771744 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.771717    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"
Jul 07 16:07:58.772233 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.771757    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd" event={"ID":"b12ef7e4-f615-401d-b76b-a03c68fe5e09","Type":"ContainerDied","Data":"6423b30b706945244e31f83c840d8f24945be94955d7064b17066695da25186e"}
Jul 07 16:07:58.772233 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.771819    2580 scope.go:117] "RemoveContainer" containerID="cc00610e5d2f1b8b35c03e98d883800c72bc0974604b58bacc98b16197773521"
Jul 07 16:07:58.796076 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.796044    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"]
Jul 07 16:07:58.806116 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:58.806079    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/auth-test-model-4e777d-kserve-74dfb84b7-gn6qd"]
Jul 07 16:07:59.871204 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:07:59.871169    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b12ef7e4-f615-401d-b76b-a03c68fe5e09" path="/var/lib/kubelet/pods/b12ef7e4-f615-401d-b76b-a03c68fe5e09/volumes"
Jul 07 16:08:02.533459 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:08:02.533423    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:08:02.533892 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:08:02.533482    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:08:02.546049 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:08:02.546018    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:08:02.802588 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:08:02.802509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:08:37.551581 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:08:37.551543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:09:11.598682 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:11.598649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:09:29.990574 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:29.990543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:09:34.933918 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:34.933878    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"]
Jul 07 16:09:43.729889 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.729847    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"]
Jul 07 16:09:43.730453 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.730434    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b12ef7e4-f615-401d-b76b-a03c68fe5e09" containerName="main"
Jul 07 16:09:43.730503 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.730458    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b12ef7e4-f615-401d-b76b-a03c68fe5e09" containerName="main"
Jul 07 16:09:43.730547 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.730536    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b12ef7e4-f615-401d-b76b-a03c68fe5e09" containerName="main"
Jul 07 16:09:43.733979 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.733958    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.737199 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.737178    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-4e777d\"/\"rate-test-model-4e777d-kserve-self-signed-certs\""
Jul 07 16:09:43.742698 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.742665    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"]
Jul 07 16:09:43.808513 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.808477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tls-certs\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.808708 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.808558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-home\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.808708 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.808587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-dshm\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.808708 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.808652    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w26z\" (UniqueName: \"kubernetes.io/projected/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-kube-api-access-6w26z\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.808708 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.808681    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-model-cache\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.808708 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.808699    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tmp-dir\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.909519 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.909491    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w26z\" (UniqueName: \"kubernetes.io/projected/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-kube-api-access-6w26z\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.909715 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.909533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-model-cache\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.909715 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.909553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tmp-dir\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.909715 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.909598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tls-certs\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.909715 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.909655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-home\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.909715 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.909678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-dshm\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.910004 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.909980    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tmp-dir\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.910073 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.909992    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-model-cache\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.910128 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.910092    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-home\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.911878 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.911852    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-dshm\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.912169 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.912153    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tls-certs\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:43.919245 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:43.919221    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w26z\" (UniqueName: \"kubernetes.io/projected/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-kube-api-access-6w26z\") pod \"rate-test-model-4e777d-kserve-ff8b7df47-5fxwf\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") " pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:44.043509 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:44.043417    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:44.183765 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:44.183737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"]
Jul 07 16:09:44.185443 ip-10-0-136-174 kubenswrapper[2580]: W0707 16:09:44.185415    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f37e7bf_dc66_4b6f_9b04_efcdeec31272.slice/crio-7d75ef52a4c03710f928c19ae6ac35de3cd8d555e2bd771a87a0ffa84f6bb198 WatchSource:0}: Error finding container 7d75ef52a4c03710f928c19ae6ac35de3cd8d555e2bd771a87a0ffa84f6bb198: Status 404 returned error can't find the container with id 7d75ef52a4c03710f928c19ae6ac35de3cd8d555e2bd771a87a0ffa84f6bb198
Jul 07 16:09:44.275076 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:44.275039    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf" event={"ID":"7f37e7bf-dc66-4b6f-9b04-efcdeec31272","Type":"ContainerStarted","Data":"b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4"}
Jul 07 16:09:44.275246 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:44.275083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf" event={"ID":"7f37e7bf-dc66-4b6f-9b04-efcdeec31272","Type":"ContainerStarted","Data":"7d75ef52a4c03710f928c19ae6ac35de3cd8d555e2bd771a87a0ffa84f6bb198"}
Jul 07 16:09:44.297169 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:44.297075    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf" podStartSLOduration=1.29705899 podStartE2EDuration="1.29705899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:09:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:09:44.295865706 +0000 UTC m=+2414.955570194" watchObservedRunningTime="2026-07-07 16:09:44.29705899 +0000 UTC m=+2414.956763463"
Jul 07 16:09:45.890674 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:45.890634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:09:49.954045 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:49.954001    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn" podUID="82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" containerName="main" containerID="cri-o://5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca" gracePeriod=45
Jul 07 16:09:50.212073 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.212009    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:09:50.254301 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.254275    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgjzr\" (UniqueName: \"kubernetes.io/projected/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-kube-api-access-lgjzr\") pod \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") "
Jul 07 16:09:50.254486 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.254320    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-dshm\") pod \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") "
Jul 07 16:09:50.254486 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.254387    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-home\") pod \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") "
Jul 07 16:09:50.254649 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.254589    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-model-cache\") pod \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") "
Jul 07 16:09:50.254715 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.254682    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tmp-dir\") pod \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") "
Jul 07 16:09:50.254715 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.254700    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tls-certs\") pod \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\" (UID: \"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2\") "
Jul 07 16:09:50.255128 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.255099    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-home" (OuterVolumeSpecName: "home") pod "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" (UID: "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:09:50.255267 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.255231    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-home\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:09:50.255471 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.255428    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" (UID: "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:09:50.255657 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.255618    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" (UID: "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:09:50.257584 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.257558    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" (UID: "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:09:50.257584 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.257576    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-kube-api-access-lgjzr" (OuterVolumeSpecName: "kube-api-access-lgjzr") pod "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" (UID: "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2"). InnerVolumeSpecName "kube-api-access-lgjzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:09:50.257735 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.257575    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-dshm" (OuterVolumeSpecName: "dshm") pod "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" (UID: "82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:09:50.304749 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.304714    2580 generic.go:356] "Generic (PLEG): container finished" podID="82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" containerID="5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca" exitCode=0
Jul 07 16:09:50.304889 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.304761    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"
Jul 07 16:09:50.304889 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.304797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn" event={"ID":"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2","Type":"ContainerDied","Data":"5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca"}
Jul 07 16:09:50.304889 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.304839    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn" event={"ID":"82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2","Type":"ContainerDied","Data":"32d32495e2432d1450ca76413a57b41f61049efee94d57c727bf168506b75690"}
Jul 07 16:09:50.304889 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.304857    2580 scope.go:117] "RemoveContainer" containerID="5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca"
Jul 07 16:09:50.320468 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.320448    2580 scope.go:117] "RemoveContainer" containerID="5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca"
Jul 07 16:09:50.320747 ip-10-0-136-174 kubenswrapper[2580]: E0707 16:09:50.320726    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca\": container with ID starting with 5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca not found: ID does not exist" containerID="5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca"
Jul 07 16:09:50.320810 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.320759    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca"} err="failed to get container status \"5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca\": rpc error: code = NotFound desc = could not find container \"5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca\": container with ID starting with 5da03155574c0be3a12c1de3a764b11ab7c11931c970973bada4b294a28b10ca not found: ID does not exist"
Jul 07 16:09:50.332348 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.332321    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"]
Jul 07 16:09:50.342148 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.342121    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/sub-test-model-4e777d-kserve-847667588c-qlccn"]
Jul 07 16:09:50.355969 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.355947    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-model-cache\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:09:50.355969 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.355971    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tmp-dir\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:09:50.356085 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.355979    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-tls-certs\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:09:50.356085 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.355988    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgjzr\" (UniqueName: \"kubernetes.io/projected/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-kube-api-access-lgjzr\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:09:50.356085 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:50.355998    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2-dshm\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:09:51.870331 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:51.870287    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" path="/var/lib/kubelet/pods/82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2/volumes"
Jul 07 16:09:54.043890 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:54.043849    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:54.043890 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:54.043896    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:54.057609 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:54.057578    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:09:54.337992 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:09:54.337909    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:10:18.424963 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:10:18.424921    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:10:33.559822 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:10:33.559788    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:10:49.998798 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:10:49.998758    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:10:56.126997 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:10:56.126958    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"]
Jul 07 16:11:03.211366 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:03.211331    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:11:11.147106 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.147061    2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf" podUID="7f37e7bf-dc66-4b6f-9b04-efcdeec31272" containerName="main" containerID="cri-o://b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4" gracePeriod=45
Jul 07 16:11:11.385415 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.385392    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:11:11.401910 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.401844    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tmp-dir\") pod \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") "
Jul 07 16:11:11.402035 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.401921    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-dshm\") pod \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") "
Jul 07 16:11:11.402035 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.401969    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-model-cache\") pod \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") "
Jul 07 16:11:11.402035 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.402011    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6w26z\" (UniqueName: \"kubernetes.io/projected/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-kube-api-access-6w26z\") pod \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") "
Jul 07 16:11:11.402238 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.402052    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tls-certs\") pod \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") "
Jul 07 16:11:11.402238 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.402077    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-home\") pod \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\" (UID: \"7f37e7bf-dc66-4b6f-9b04-efcdeec31272\") "
Jul 07 16:11:11.402238 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.402081    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7f37e7bf-dc66-4b6f-9b04-efcdeec31272" (UID: "7f37e7bf-dc66-4b6f-9b04-efcdeec31272"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:11.402421 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.402340    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tmp-dir\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:11:11.403224 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.403184    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-model-cache" (OuterVolumeSpecName: "model-cache") pod "7f37e7bf-dc66-4b6f-9b04-efcdeec31272" (UID: "7f37e7bf-dc66-4b6f-9b04-efcdeec31272"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:11.403411 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.403364    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-home" (OuterVolumeSpecName: "home") pod "7f37e7bf-dc66-4b6f-9b04-efcdeec31272" (UID: "7f37e7bf-dc66-4b6f-9b04-efcdeec31272"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:11.405380 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.405338    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-dshm" (OuterVolumeSpecName: "dshm") pod "7f37e7bf-dc66-4b6f-9b04-efcdeec31272" (UID: "7f37e7bf-dc66-4b6f-9b04-efcdeec31272"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:11:11.405564 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.405541    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-kube-api-access-6w26z" (OuterVolumeSpecName: "kube-api-access-6w26z") pod "7f37e7bf-dc66-4b6f-9b04-efcdeec31272" (UID: "7f37e7bf-dc66-4b6f-9b04-efcdeec31272"). InnerVolumeSpecName "kube-api-access-6w26z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:11:11.405671 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.405598    2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7f37e7bf-dc66-4b6f-9b04-efcdeec31272" (UID: "7f37e7bf-dc66-4b6f-9b04-efcdeec31272"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:11:11.503384 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.503348    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-dshm\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:11:11.503384 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.503385    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-model-cache\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:11:11.503583 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.503400    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w26z\" (UniqueName: \"kubernetes.io/projected/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-kube-api-access-6w26z\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:11:11.503583 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.503412    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-tls-certs\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:11:11.503583 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.503424    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f37e7bf-dc66-4b6f-9b04-efcdeec31272-home\") on node \"ip-10-0-136-174.ec2.internal\" DevicePath \"\""
Jul 07 16:11:11.688932 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.688901    2580 generic.go:356] "Generic (PLEG): container finished" podID="7f37e7bf-dc66-4b6f-9b04-efcdeec31272" containerID="b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4" exitCode=0
Jul 07 16:11:11.689113 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.688946    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"
Jul 07 16:11:11.689113 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.688984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf" event={"ID":"7f37e7bf-dc66-4b6f-9b04-efcdeec31272","Type":"ContainerDied","Data":"b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4"}
Jul 07 16:11:11.689113 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.689030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf" event={"ID":"7f37e7bf-dc66-4b6f-9b04-efcdeec31272","Type":"ContainerDied","Data":"7d75ef52a4c03710f928c19ae6ac35de3cd8d555e2bd771a87a0ffa84f6bb198"}
Jul 07 16:11:11.689113 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.689051    2580 scope.go:117] "RemoveContainer" containerID="b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4"
Jul 07 16:11:11.697881 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.697862    2580 scope.go:117] "RemoveContainer" containerID="b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4"
Jul 07 16:11:11.698117 ip-10-0-136-174 kubenswrapper[2580]: E0707 16:11:11.698095    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4\": container with ID starting with b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4 not found: ID does not exist" containerID="b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4"
Jul 07 16:11:11.698220 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.698125    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4"} err="failed to get container status \"b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4\": rpc error: code = NotFound desc = could not find container \"b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4\": container with ID starting with b9d7176671031df8be08223c47f2552499682d1e061f0b360df0dfbb6727d2e4 not found: ID does not exist"
Jul 07 16:11:11.711654 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.711599    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"]
Jul 07 16:11:11.713306 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.713288    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-4e777d/rate-test-model-4e777d-kserve-ff8b7df47-5fxwf"]
Jul 07 16:11:11.871272 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:11.871238    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f37e7bf-dc66-4b6f-9b04-efcdeec31272" path="/var/lib/kubelet/pods/7f37e7bf-dc66-4b6f-9b04-efcdeec31272/volumes"
Jul 07 16:11:27.305907 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:27.300846    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-gjg52"]
Jul 07 16:11:37.578366 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:37.578334    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cjqnd_50284799-49d6-42de-bc2f-cca699770cd7/server/0.log"
Jul 07 16:11:38.150270 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:38.150238    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-n5mtc_6938db07-72c3-4f53-b012-952ff167b359/copy-manifests/0.log"
Jul 07 16:11:38.158408 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:38.158379    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-n5mtc_6938db07-72c3-4f53-b012-952ff167b359/manager/0.log"
Jul 07 16:11:39.866323 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:39.866295    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-82892_c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25/manager/0.log"
Jul 07 16:11:39.988892 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:39.988864    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-g2c2r_9cc133dc-643f-4259-83fc-fd6ed064813e/manager/0.log"
Jul 07 16:11:40.246889 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:40.246857    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dq7q2_96144adc-bac1-4034-ac4c-1f78ca918389/registry-server/0.log"
Jul 07 16:11:40.375079 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:40.375046    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-d292n_083adc2c-e541-4179-b423-b3a3be0d1aaa/manager/0.log"
Jul 07 16:11:40.495741 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:40.495710    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gjg52_e704c518-8c05-4a27-9c3d-4966606a8b6e/limitador/0.log"
Jul 07 16:11:41.113890 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:41.113854    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-98799_f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e/discovery/0.log"
Jul 07 16:11:41.235754 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:41.235726    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd979f9c8-fwtqh_3829dc3e-6588-49c9-82ef-f991b08ca4d4/kube-auth-proxy/0.log"
Jul 07 16:11:41.878277 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:41.878244    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75ff8cd87-5nrxd_e205b4d7-91a7-442e-b6af-1bad9c0736d4/router/0.log"
Jul 07 16:11:42.514169 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:42.514138    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rcsmx_9af474b0-5b57-4b0a-ab25-83635f9107c7/main/0.log"
Jul 07 16:11:42.638423 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:42.638395    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db8sq7w_858f8264-e6a3-4350-a7db-a39ccd0eeba5/main/0.log"
Jul 07 16:11:50.955994 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:50.955959    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p58r7_28012edb-db42-4a95-b9f8-b7b4adeee458/global-pull-secret-syncer/0.log"
Jul 07 16:11:51.164445 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:51.164415    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bxnsr_4385ed5d-e9b2-4402-bf7c-09c665163bdc/konnectivity-agent/0.log"
Jul 07 16:11:51.240365 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:51.240258    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-174.ec2.internal_e0910101d25b67a967c4541fac7101e5/haproxy/0.log"
Jul 07 16:11:56.543166 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:56.543133    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-82892_c4ebfc0f-d003-475a-a6f9-f87f4e3c2b25/manager/0.log"
Jul 07 16:11:56.571511 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:56.571481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-g2c2r_9cc133dc-643f-4259-83fc-fd6ed064813e/manager/0.log"
Jul 07 16:11:56.656561 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:56.656524    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dq7q2_96144adc-bac1-4034-ac4c-1f78ca918389/registry-server/0.log"
Jul 07 16:11:56.828902 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:56.828809    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-d292n_083adc2c-e541-4179-b423-b3a3be0d1aaa/manager/0.log"
Jul 07 16:11:56.852425 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:56.852383    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-gjg52_e704c518-8c05-4a27-9c3d-4966606a8b6e/limitador/0.log"
Jul 07 16:11:58.931849 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:58.931815    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7mv7g_bc74221f-165b-4c98-9ca9-a877492a6358/kube-state-metrics/0.log"
Jul 07 16:11:58.953344 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:58.953315    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7mv7g_bc74221f-165b-4c98-9ca9-a877492a6358/kube-rbac-proxy-main/0.log"
Jul 07 16:11:58.981249 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:58.981222    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-7mv7g_bc74221f-165b-4c98-9ca9-a877492a6358/kube-rbac-proxy-self/0.log"
Jul 07 16:11:59.082479 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.082441    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlf8t_5e851d72-b01c-4905-90fa-a8701998e57b/node-exporter/0.log"
Jul 07 16:11:59.105473 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.105446    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlf8t_5e851d72-b01c-4905-90fa-a8701998e57b/kube-rbac-proxy/0.log"
Jul 07 16:11:59.132164 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.132137    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlf8t_5e851d72-b01c-4905-90fa-a8701998e57b/init-textfile/0.log"
Jul 07 16:11:59.677258 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.677223    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-d9brj_da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a/prometheus-operator/0.log"
Jul 07 16:11:59.697117 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.697090    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-d9brj_da4f57c5-27fc-4937-b8d9-a0cbfa3cee4a/kube-rbac-proxy/0.log"
Jul 07 16:11:59.725346 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.725319    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-fnkzk_94a095ee-6fd6-432a-ad04-30e8ec90765d/prometheus-operator-admission-webhook/0.log"
Jul 07 16:11:59.852140 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.852111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f4cd699-5f25g_962513c6-ffa3-4de8-bfff-a8f550b8fc32/thanos-query/0.log"
Jul 07 16:11:59.875687 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.875661    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f4cd699-5f25g_962513c6-ffa3-4de8-bfff-a8f550b8fc32/kube-rbac-proxy-web/0.log"
Jul 07 16:11:59.911897 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.911870    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f4cd699-5f25g_962513c6-ffa3-4de8-bfff-a8f550b8fc32/kube-rbac-proxy/0.log"
Jul 07 16:11:59.936384 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.936359    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f4cd699-5f25g_962513c6-ffa3-4de8-bfff-a8f550b8fc32/prom-label-proxy/0.log"
Jul 07 16:11:59.960040 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.960016    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f4cd699-5f25g_962513c6-ffa3-4de8-bfff-a8f550b8fc32/kube-rbac-proxy-rules/0.log"
Jul 07 16:11:59.985314 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:11:59.985289    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c8f4cd699-5f25g_962513c6-ffa3-4de8-bfff-a8f550b8fc32/kube-rbac-proxy-metrics/0.log"
Jul 07 16:12:00.551274 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.551243    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"]
Jul 07 16:12:00.551666 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.551653    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" containerName="main"
Jul 07 16:12:00.551666 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.551667    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" containerName="main"
Jul 07 16:12:00.551757 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.551678    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f37e7bf-dc66-4b6f-9b04-efcdeec31272" containerName="main"
Jul 07 16:12:00.551757 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.551684    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f37e7bf-dc66-4b6f-9b04-efcdeec31272" containerName="main"
Jul 07 16:12:00.551757 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.551755    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="82a3d2bf-c1b5-470b-bd3b-8802b0d7a4b2" containerName="main"
Jul 07 16:12:00.551852 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.551762    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f37e7bf-dc66-4b6f-9b04-efcdeec31272" containerName="main"
Jul 07 16:12:00.553888 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.553866    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.556339 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.556314    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxzwv\"/\"kube-root-ca.crt\""
Jul 07 16:12:00.556468 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.556386    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxzwv\"/\"openshift-service-ca.crt\""
Jul 07 16:12:00.557187 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.557172    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pxzwv\"/\"default-dockercfg-2rm5d\""
Jul 07 16:12:00.566450 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.566428    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"]
Jul 07 16:12:00.643113 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.643079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-lib-modules\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.643301 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.643127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-proc\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.643301 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.643151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-podres\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.643301 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.643182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfl2r\" (UniqueName: \"kubernetes.io/projected/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-kube-api-access-hfl2r\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.643301 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.643217    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-sys\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.743690 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-sys\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.743866 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-lib-modules\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.743866 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743782    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-sys\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.743866 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-proc\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.743866 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-podres\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.743866 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfl2r\" (UniqueName: \"kubernetes.io/projected/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-kube-api-access-hfl2r\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.744038 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743912    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-proc\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.744038 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743924    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-lib-modules\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.744038 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.743971    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-podres\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.753539 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.753515    2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfl2r\" (UniqueName: \"kubernetes.io/projected/db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5-kube-api-access-hfl2r\") pod \"perf-node-gather-daemonset-rnxhj\" (UID: \"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5\") " pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.863733 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.863614    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:00.998675 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:00.998640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"]
Jul 07 16:12:01.001064 ip-10-0-136-174 kubenswrapper[2580]: W0707 16:12:01.001037    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb1094e5_f3bd_4b00_b124_cf7cdfc7d2d5.slice/crio-6ed3851da913041e39af63290279874b479e1b12b74c32da127b6ea61e687ef3 WatchSource:0}: Error finding container 6ed3851da913041e39af63290279874b479e1b12b74c32da127b6ea61e687ef3: Status 404 returned error can't find the container with id 6ed3851da913041e39af63290279874b479e1b12b74c32da127b6ea61e687ef3
Jul 07 16:12:01.924376 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:01.924337    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj" event={"ID":"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5","Type":"ContainerStarted","Data":"c38eaa8300725512a7d30d4d5e88627eb0153fbae604ff874239390c577e4ae4"}
Jul 07 16:12:01.924576 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:01.924388    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj" event={"ID":"db1094e5-f3bd-4b00-b124-cf7cdfc7d2d5","Type":"ContainerStarted","Data":"6ed3851da913041e39af63290279874b479e1b12b74c32da127b6ea61e687ef3"}
Jul 07 16:12:01.924576 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:01.924474    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:01.944415 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:01.944364    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj" podStartSLOduration=1.944347815 podStartE2EDuration="1.944347815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:12:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:12:01.942692732 +0000 UTC m=+2552.602397205" watchObservedRunningTime="2026-07-07 16:12:01.944347815 +0000 UTC m=+2552.604052290"
Jul 07 16:12:02.265139 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:02.265105    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b54bcbbdb-8gwnh_290d3e1d-9eb5-4654-a74e-afd83791edff/console/0.log"
Jul 07 16:12:02.305058 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:02.305031    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-ztkbk_59f503f1-32fe-49a0-942b-4d12350aab73/download-server/0.log"
Jul 07 16:12:03.006275 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:03.006240    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-z9njq_e9f85275-b570-4e72-bdb7-ec498d2a8a8c/volume-data-source-validator/0.log"
Jul 07 16:12:04.189546 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:04.189518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wwv62_41c280db-27d4-4006-9955-6aab96ec62b0/dns/0.log"
Jul 07 16:12:04.212937 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:04.212909    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wwv62_41c280db-27d4-4006-9955-6aab96ec62b0/kube-rbac-proxy/0.log"
Jul 07 16:12:04.240443 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:04.240418    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6bldp_e8318c5d-53b4-489a-bd64-9e51fc76dc97/dns-node-resolver/0.log"
Jul 07 16:12:04.870451 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:04.870424    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7f46669b9c-9wfkh_27268000-74bd-4300-a746-8560bba1b8ad/registry/0.log"
Jul 07 16:12:04.902842 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:04.902815    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5cmnl_e3087e75-a0cb-4cab-9e40-d2a2140bb8e1/node-ca/0.log"
Jul 07 16:12:06.213758 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:06.213728    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-98799_f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e/discovery/0.log"
Jul 07 16:12:06.236547 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:06.236508    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd979f9c8-fwtqh_3829dc3e-6588-49c9-82ef-f991b08ca4d4/kube-auth-proxy/0.log"
Jul 07 16:12:06.474913 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:06.474821    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75ff8cd87-5nrxd_e205b4d7-91a7-442e-b6af-1bad9c0736d4/router/0.log"
Jul 07 16:12:07.179024 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:07.178989    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bpmc4_f0dd55d9-5dcf-4d65-9d23-a3a6bc25ebfd/serve-healthcheck-canary/0.log"
Jul 07 16:12:07.818342 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:07.818314    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hq8kc_68fef6e3-1771-4d75-b2f1-2b904a415c1c/kube-rbac-proxy/0.log"
Jul 07 16:12:07.845290 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:07.845260    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hq8kc_68fef6e3-1771-4d75-b2f1-2b904a415c1c/exporter/0.log"
Jul 07 16:12:07.871145 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:07.871121    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hq8kc_68fef6e3-1771-4d75-b2f1-2b904a415c1c/extractor/0.log"
Jul 07 16:12:07.938595 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:07.938570    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pxzwv/perf-node-gather-daemonset-rnxhj"
Jul 07 16:12:11.073949 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:11.073859    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cjqnd_50284799-49d6-42de-bc2f-cca699770cd7/server/0.log"
Jul 07 16:12:11.413693 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:11.413590    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-n5mtc_6938db07-72c3-4f53-b012-952ff167b359/manager/0.log"
Jul 07 16:12:11.439556 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:11.439528    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-578f9687cc-n5mtc_6938db07-72c3-4f53-b012-952ff167b359/copy-manifests/0.log"
Jul 07 16:12:11.742240 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:11.742209    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-98799_f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e/discovery/0.log"
Jul 07 16:12:11.798862 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:11.798831    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd979f9c8-fwtqh_3829dc3e-6588-49c9-82ef-f991b08ca4d4/kube-auth-proxy/0.log"
Jul 07 16:12:12.078635 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:12.078590    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75ff8cd87-5nrxd_e205b4d7-91a7-442e-b6af-1bad9c0736d4/router/0.log"
Jul 07 16:12:13.454097 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:13.454063    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-98799_f2aa4f36-f0ae-4943-b78e-d0fd70dfa05e/discovery/0.log"
Jul 07 16:12:13.481253 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:13.481225    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fd979f9c8-fwtqh_3829dc3e-6588-49c9-82ef-f991b08ca4d4/kube-auth-proxy/0.log"
Jul 07 16:12:13.715844 ip-10-0-136-174 kubenswrapper[2580]: I0707 16:12:13.715765    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-75ff8cd87-5nrxd_e205b4d7-91a7-442e-b6af-1bad9c0736d4/router/0.log"