Jul 22 11:23:27.232328 ip-10-0-136-126 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 11:23:27.554117 ip-10-0-136-126 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 11:23:27.554117 ip-10-0-136-126 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 11:23:27.554117 ip-10-0-136-126 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 11:23:27.554117 ip-10-0-136-126 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 11:23:27.554117 ip-10-0-136-126 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 11:23:27.555678 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.555530    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 11:23:27.561751 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561726    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:23:27.561751 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561747    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:23:27.561751 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561752    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:23:27.561751 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561755    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:23:27.561751 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561758    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561761    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561766    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561770    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561773    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561776    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561779    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561782    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561784    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561787    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561789    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561792    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561794    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561797    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561806    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561809    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561811    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561814    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561816    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561819    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:23:27.561958 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561821    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561823    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561826    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561828    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561831    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561833    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561836    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561838    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561840    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561843    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561846    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561848    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561850    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561853    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561856    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561858    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561861    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561863    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561866    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561868    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:23:27.562444 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561870    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561873    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561875    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561878    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561880    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561882    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561886    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561888    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561891    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561893    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561895    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561898    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561901    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561905    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561909    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561913    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561917    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561919    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561923    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:23:27.563026 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561926    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561928    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561931    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561933    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561935    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561938    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561941    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561944    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561947    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561949    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561952    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561954    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561957    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561959    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561962    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561965    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561967    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561970    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561974    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561976    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:23:27.563528 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561979    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561982    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561984    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561987    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561989    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561991    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561994    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561996    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.561999    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562001    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562019    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562022    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562025    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562027    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562030    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562033    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562714    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562721    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562725    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:23:27.564072 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562729    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562732    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562735    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562737    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562740    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562743    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562745    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562748    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562751    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562753    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562756    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562758    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562761    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562763    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562767    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562770    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562772    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562775    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562778    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562780    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:23:27.564563 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562782    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562785    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562787    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562790    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562793    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562795    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562798    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562800    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562802    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562805    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562807    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562810    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562812    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562815    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562817    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562820    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562822    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562825    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562827    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562830    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:23:27.565066 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562832    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562834    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562836    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562839    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562841    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562844    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562846    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562849    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562851    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562853    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562856    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562858    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562861    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562863    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562865    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562868    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562871    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562873    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562876    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562879    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:23:27.565589 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562881    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562883    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562886    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562889    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562891    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562894    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562896    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562899    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562901    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562904    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562906    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562909    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562911    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562914    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562916    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562918    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562921    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562923    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562925    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:23:27.566089 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562928    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562931    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562933    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562936    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562938    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562940    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562943    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562945    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562948    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562953    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562957    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562960    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562963    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562967    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562970    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562973    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.562976    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563377    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563382    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:23:27.566540 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563385    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563388    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563390    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563393    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563396    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563399    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563401    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563404    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563406    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563409    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563412    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563414    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563417    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563419    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563422    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563425    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563428    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563430    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563432    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563435    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:23:27.566994 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563437    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563440    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563442    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563444    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563447    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563449    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563452    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563454    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563457    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563459    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563463    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563466    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563468    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563471    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563473    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563476    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563478    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563481    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563484    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:23:27.567525 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563486    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563488    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563491    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563493    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563495    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563498    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563500    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563503    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563506    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563509    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563511    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563514    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563516    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563518    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563521    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563523    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563525    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563528    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563530    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:23:27.568013 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563533    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563535    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563540    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563543    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563547    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563550    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563554    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563556    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563558    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563561    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563564    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563567    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563570    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563574    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563577    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563580    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563582    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563584    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:23:27.568496 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563589    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563593    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563595    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563598    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563601    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563603    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563606    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563609    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563611    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563614    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563616    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563619    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563621    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563623    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563626    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563628    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563631    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563633    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563637    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563639    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.563642    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:23:27.568923 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563716    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563723    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563730    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563735    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563738    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563741    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563746    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563750    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563753    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563756    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563760    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563763    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563767    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563769    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563772    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563775    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563779    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563782    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563786    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563788    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563791    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563794    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563798    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563801    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 11:23:27.569442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563804    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563807    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563810    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563813    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563816    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563822    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563825    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563828    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563835    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563838    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563841    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563844    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563847    2580 flags.go:64] FLAG: --enable-server="true"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563850    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563853    2580 flags.go:64] FLAG: --event-burst="100"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563856    2580 flags.go:64] FLAG: --event-qps="50"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563859    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563862    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563865    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563869    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563872    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563874    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563877    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563880    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563883    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 11:23:27.570059 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563886    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563889    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563892    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563895    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563898    2580 flags.go:64] FLAG: --feature-gates=""
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563901    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563904    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563907    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563910    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563913    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563916    2580 flags.go:64] FLAG: --help="false"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563919    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563927    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563930    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563933    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563936    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563939    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563942    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563945    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563947    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563950    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563953    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563956    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563959    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 22 11:23:27.570705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563961    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563964    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563967    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563970    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563972    2580 flags.go:64] FLAG: --lock-file=""
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563975    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563978    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563981    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563986    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563989    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563992    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563995    2580 flags.go:64] FLAG: --logging-format="text"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.563997    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564001    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564018    2580 flags.go:64] FLAG: --manifest-url=""
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564021    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564025    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564028    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564032    2580 flags.go:64] FLAG: --max-pods="110"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564035    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564040    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564043    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564046    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564049    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564051    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 11:23:27.571296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564054    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564061    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564064    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564067    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564070    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564073    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564079    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564082    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564085    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564088    2580 flags.go:64] FLAG: --port="10250"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564091    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564094    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b98a2f29affc6d41"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564097    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564100    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564103    2580 flags.go:64] FLAG: --register-node="true"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564106    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564110    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564113    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564116    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564119    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564122    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564126    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564129    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564132    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564135    2580 flags.go:64] FLAG: --runonce="false"
Jul 22 11:23:27.571906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564137    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564140    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564144    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564148    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564151    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564154    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564157    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564159    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564162    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564165    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564168    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564171    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564174    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564176    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564179    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564184    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564187    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564190    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564194    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564197    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564199    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564202    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564204    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564207    2580 flags.go:64] FLAG: --v="2"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564211    2580 flags.go:64] FLAG: --version="false"
Jul 22 11:23:27.572529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564215    2580 flags.go:64] FLAG: --vmodule=""
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564219    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564222    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564335    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564339    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564343    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564346    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564348    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564351    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564355    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564359    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564362    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564364    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564367    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564369    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564372    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564374    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564377    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564379    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564381    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:23:27.573212 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564384    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564386    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564389    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564391    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564394    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564396    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564399    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564401    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564403    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564407    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564411    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564414    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564416    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564421    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564423    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564425    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564428    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564430    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564433    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564435    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:23:27.573695 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564438    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564442    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564446    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564448    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564451    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564453    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564456    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564458    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564461    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564463    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564466    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564469    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564471    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564473    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564476    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564478    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564481    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564483    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564486    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564488    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:23:27.574196 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564491    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564494    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564496    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564498    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564501    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564503    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564506    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564510    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564514    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564516    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564519    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564522    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564524    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564528    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564532    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564534    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564537    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564539    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564543    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:23:27.574712 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564547    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564550    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564552    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564555    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564558    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564560    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564562    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564565    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564568    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564570    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564573    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564575    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564578    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564580    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564583    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564586    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564588    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564590    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564593    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564595    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:23:27.575191 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564598    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564601    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.564603    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.564609    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.571484    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.571507    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.572073    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.572084    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572145    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572151    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572154    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572157    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572160    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572163    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572166    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:23:27.575662 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572169    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572172    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572175    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572177    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572180    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572182    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572185    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572187    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572190    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572192    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572194    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572197    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572199    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572202    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572204    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572206    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572209    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572211    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572214    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572216    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:23:27.576061 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572219    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572221    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572230    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572233    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572236    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572238    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572241    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572243    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572246    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572248    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572251    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572253    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572256    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572258    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572261    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572263    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572266    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572268    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572271    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572273    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:23:27.576551 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572276    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572278    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572281    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572283    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572285    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572288    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572290    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572293    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572295    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572298    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572301    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572303    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572306    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572308    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572311    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572320    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572323    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572326    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572328    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:23:27.577049 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572331    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572335    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572338    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572341    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572344    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572347    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572349    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572353    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572356    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572359    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572361    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572364    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572366    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572369    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572371    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572374    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572376    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572379    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572382    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:23:27.577523 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572384    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572388    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572391    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572394    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572396    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572399    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572401    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572404    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572407    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572409    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572417    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572420    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572423    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572425    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.572431    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 11:23:27.578128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572571    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572575    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572578    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572580    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572583    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572586    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572588    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572590    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572593    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572595    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572598    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572600    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572602    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572605    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572607    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572610    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572612    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572615    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572617    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572620    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 11:23:27.578503 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572622    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572624    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572627    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572629    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572632    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572634    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572636    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572639    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572648    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572651    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572653    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572655    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572658    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572660    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572663    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572665    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572667    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572670    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572672    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572674    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 11:23:27.578986 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572677    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572679    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572681    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572684    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572688    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572691    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572694    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572696    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572699    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572702    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572705    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572708    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572710    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572712    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572715    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572717    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572720    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572722    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572725    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 11:23:27.579483 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572727    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572729    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572737    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572740    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572743    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572745    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572748    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572750    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572752    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572755    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572757    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572760    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572762    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572764    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572768    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572771    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572774    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572777    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572780    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 11:23:27.579945 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572782    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572785    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572787    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572790    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572793    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572795    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572798    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572800    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572802    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572805    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572807    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572810    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572812    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572815    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572818    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572821    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572829    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572831    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572834    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572837    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 11:23:27.580442 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:27.572839    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 11:23:27.580912 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.572844    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 11:23:27.580912 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.572973    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 11:23:27.580912 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.575620    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 11:23:27.580912 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.576736    2580 server.go:1019] "Starting client certificate rotation"
Jul 22 11:23:27.580912 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.576837    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 11:23:27.580912 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.576871    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 11:23:27.580912 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.579015    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 11:23:27.584180 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.584156    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 11:23:27.592590 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.592572    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 22 11:23:27.596035 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.596015    2580 log.go:25] "Validated CRI v1 image API"
Jul 22 11:23:27.596851 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.596832    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 11:23:27.598924 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.598899    2580 fs.go:135] Filesystem UUIDs: map[24058d08-0b6a-45b7-9426-a7a55bf3f041:/dev/nvme0n1p3 35cd507d-5d3d-46b6-b6d8-ae3b1566a18a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 22 11:23:27.598979 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.598925    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 11:23:27.604116 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.603988    2580 manager.go:216] Machine: {Timestamp:2026-07-22 11:23:27.602653394 +0000 UTC m=+0.265300662 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088716 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20c459909fa68d52c2a02ab2bf0252 SystemUUID:ec20c459-909f-a68d-52c2-a02ab2bf0252 BootID:6e970c9d-28dc-4938-9234-94f769ee431b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ba:34:61:a3:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ba:34:61:a3:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:01:f4:8a:a5:ea Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 11:23:27.604116 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.604111    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 11:23:27.604221 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.604192    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 11:23:27.606701 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.606678    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 11:23:27.606847 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.606706    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-126.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 11:23:27.607370 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.607359    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 11:23:27.607408 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.607373    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 11:23:27.607408 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.607380    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 11:23:27.607408 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.607395    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 11:23:27.608485 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.608469    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 11:23:27.608584 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.608570    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 11:23:27.612430 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.612417    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 11:23:27.612554 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.612544    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 11:23:27.612583 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.612577    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 11:23:27.612610 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.612590    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 11:23:27.612610 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.612605    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 11:23:27.612659 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.612614    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 22 11:23:27.612659 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.612623    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 11:23:27.613077 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.613065    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 11:23:27.613147 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.613084    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 11:23:27.615136 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.615122    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 11:23:27.619417 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.619399    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 11:23:27.619488 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.619433    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 11:23:27.620392 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620381    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 11:23:27.620426 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620398    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 11:23:27.620426 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620404    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 11:23:27.620426 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620419    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 11:23:27.620516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620428    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 11:23:27.620516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620435    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 11:23:27.620516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620443    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 11:23:27.620516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620448    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 11:23:27.620516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620454    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 11:23:27.620516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620460    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 11:23:27.620516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620468    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 11:23:27.620516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.620473    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 11:23:27.621078 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.621068    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 11:23:27.621078 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.621079    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 11:23:27.622900 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.622860    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-126.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 11:23:27.623045 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.622921    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 11:23:27.623045 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.622940    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 11:23:27.624340 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.624325    2580 server.go:1268] "Started kubelet"
Jul 22 11:23:27.624419 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.624395    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 11:23:27.624472 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.624397    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 11:23:27.624472 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.624442    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 11:23:27.625194 ip-10-0-136-126 systemd[1]: Started Kubernetes Kubelet.
Jul 22 11:23:27.626098 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.626068    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 11:23:27.626656 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.626641    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 11:23:27.628687 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.628668    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 11:23:27.631865 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.631847    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 11:23:27.631938 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.631853    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 11:23:27.632025 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.631952    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:27.632392 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.632360    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 11:23:27.632474 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.632393    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 11:23:27.632474 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.632407    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 11:23:27.632592 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.632524    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 11:23:27.632592 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.632531    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 11:23:27.632796 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.632779    2580 factory.go:55] Registering systemd factory
Jul 22 11:23:27.632851 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.632809    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 22 11:23:27.633187 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.633168    2580 factory.go:153] Registering CRI-O factory
Jul 22 11:23:27.633187 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.633188    2580 factory.go:223] Registration of the crio container factory successfully
Jul 22 11:23:27.633323 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.633240    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 11:23:27.633323 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.633263    2580 factory.go:103] Registering Raw factory
Jul 22 11:23:27.633323 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.633278    2580 manager.go:1196] Started watching for new ooms in manager
Jul 22 11:23:27.633678 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.633666    2580 manager.go:349] Starting recovery of all containers
Jul 22 11:23:27.638527 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.638504    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 11:23:27.638752 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.638699    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-126.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 11:23:27.639776 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.638554    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-126.ec2.internal.18c498d86b311a79  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-126.ec2.internal,UID:ip-10-0-136-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-126.ec2.internal,},FirstTimestamp:2026-07-22 11:23:27.624297081 +0000 UTC m=+0.286944329,LastTimestamp:2026-07-22 11:23:27.624297081 +0000 UTC m=+0.286944329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-126.ec2.internal,}"
Jul 22 11:23:27.647235 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.647214    2580 manager.go:354] Recovery completed
Jul 22 11:23:27.648925 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.648896    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 22 11:23:27.652192 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.652181    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:23:27.654097 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.654078    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:23:27.654156 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.654107    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:23:27.654156 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.654119    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:23:27.654643 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.654629    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 11:23:27.654643 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.654642    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 11:23:27.654727 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.654646    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:23:27.654727 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.654662    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 11:23:27.655296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.655282    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:23:27.655343 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.655306    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:23:27.655343 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.655316    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:23:27.656819 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.656807    2580 policy_none.go:49] "None policy: Start"
Jul 22 11:23:27.656857 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.656823    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 11:23:27.656857 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.656833    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 11:23:27.657080 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.656942    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-126.ec2.internal.18c498d86cf7c8e9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-126.ec2.internal,UID:ip-10-0-136-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-126.ec2.internal,},FirstTimestamp:2026-07-22 11:23:27.654095081 +0000 UTC m=+0.316742330,LastTimestamp:2026-07-22 11:23:27.654095081 +0000 UTC m=+0.316742330,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-126.ec2.internal,}"
Jul 22 11:23:27.658831 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.658821    2580 policy_none.go:47] "Start"
Jul 22 11:23:27.668274 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.668203    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-126.ec2.internal.18c498d86cf80af7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-126.ec2.internal,UID:ip-10-0-136-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-126.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-126.ec2.internal,},FirstTimestamp:2026-07-22 11:23:27.654111991 +0000 UTC m=+0.316759241,LastTimestamp:2026-07-22 11:23:27.654111991 +0000 UTC m=+0.316759241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-126.ec2.internal,}"
Jul 22 11:23:27.679516 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.679494    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dbjdj"
Jul 22 11:23:27.680605 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.680512    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-126.ec2.internal.18c498d86cf83d18  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-126.ec2.internal,UID:ip-10-0-136-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-126.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-126.ec2.internal,},FirstTimestamp:2026-07-22 11:23:27.654124824 +0000 UTC m=+0.316772074,LastTimestamp:2026-07-22 11:23:27.654124824 +0000 UTC m=+0.316772074,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-126.ec2.internal,}"
Jul 22 11:23:27.689237 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.689217    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dbjdj"
Jul 22 11:23:27.693205 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.693121    2580 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-126.ec2.internal.18c498d86cf7c8e9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-126.ec2.internal.18c498d86cf7c8e9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-126.ec2.internal,UID:ip-10-0-136-126.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-126.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-126.ec2.internal,},FirstTimestamp:2026-07-22 11:23:27.654095081 +0000 UTC m=+0.316742330,LastTimestamp:2026-07-22 11:23:27.655294963 +0000 UTC m=+0.317942211,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-126.ec2.internal,}"
Jul 22 11:23:27.696410 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.696395    2580 manager.go:337] "Starting Device Plugin manager"
Jul 22 11:23:27.696518 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.696427    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 11:23:27.696518 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.696436    2580 server.go:87] "Starting device plugin registration server"
Jul 22 11:23:27.696863 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.696717    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 11:23:27.696910 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.696873    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 11:23:27.697123 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.696999    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 11:23:27.697123 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.697108    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 11:23:27.697123 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.697117    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 11:23:27.697620 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.697604    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 11:23:27.697673 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.697666    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:27.729159 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.729124    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 11:23:27.736809 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.730457    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 11:23:27.736809 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.730499    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 11:23:27.736809 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.730524    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 11:23:27.736809 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.730564    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 11:23:27.736809 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.733124    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:23:27.797268 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.797231    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:23:27.798256 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.798234    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:23:27.798368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.798270    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:23:27.798698 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.798285    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:23:27.798737 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.798722    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.809169 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.809113    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.809169 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.809141    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-126.ec2.internal\": node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:27.831021 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.830974    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal"]
Jul 22 11:23:27.831139 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.831061    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:23:27.831893 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.831878    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:23:27.831941 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.831906    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:23:27.831941 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.831915    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:23:27.833828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.833812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b1945498e9855749cc238a2c280176b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal\" (UID: \"4b1945498e9855749cc238a2c280176b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.833883 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.833835    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b1945498e9855749cc238a2c280176b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal\" (UID: \"4b1945498e9855749cc238a2c280176b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.834403 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.834391    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:23:27.834510 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.834493    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.834546 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.834541    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:23:27.835162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.835146    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:23:27.835223 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.835176    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:23:27.835223 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.835149    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:23:27.835223 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.835185    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:23:27.835223 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.835201    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:23:27.835223 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.835214    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:23:27.837526 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.837513    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.837571 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.837539    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:23:27.838175 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.838162    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:23:27.838245 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.838181    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:23:27.838245 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.838189    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:23:27.843774 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.843755    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:27.852578 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.852551    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-126.ec2.internal\" not found" node="ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.856412 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.856395    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-126.ec2.internal\" not found" node="ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.934031 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.933974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b1945498e9855749cc238a2c280176b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal\" (UID: \"4b1945498e9855749cc238a2c280176b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.934199 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.934032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c6296955c2fb4ca1bbfcf5b3caef41f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-126.ec2.internal\" (UID: \"5c6296955c2fb4ca1bbfcf5b3caef41f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.934199 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.934071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b1945498e9855749cc238a2c280176b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal\" (UID: \"4b1945498e9855749cc238a2c280176b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.934199 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.934083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b1945498e9855749cc238a2c280176b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal\" (UID: \"4b1945498e9855749cc238a2c280176b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.934199 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:27.934116    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4b1945498e9855749cc238a2c280176b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal\" (UID: \"4b1945498e9855749cc238a2c280176b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:27.944120 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:27.944084    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.034217 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.034184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c6296955c2fb4ca1bbfcf5b3caef41f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-126.ec2.internal\" (UID: \"5c6296955c2fb4ca1bbfcf5b3caef41f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:28.034292 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.034138    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c6296955c2fb4ca1bbfcf5b3caef41f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-126.ec2.internal\" (UID: \"5c6296955c2fb4ca1bbfcf5b3caef41f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:28.044235 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.044212    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.144996 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.144938    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.156167 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.156132    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:28.159280 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.159265    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:28.245867 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.245821    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.346333 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.346302    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.446896 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.446801    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.451039 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.451023    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:23:28.547349 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.547310    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.575963 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.575933    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 11:23:28.576439 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.576110    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 11:23:28.576439 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.576155    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 11:23:28.647616 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.647577    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.647811 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.647681    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:23:28.684319 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.684268    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 11:23:28.685428 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.685406    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 11:23:28.685541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.685447    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 11:23:28.685541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.685465    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeHasSufficientPID"
Jul 22 11:23:28.693739 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.693714    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 11:18:27 +0000 UTC" deadline="2028-02-21 09:02:31.606096132 +0000 UTC"
Jul 22 11:23:28.693792 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:28.693739    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13893h39m2.912360089s"
Jul 22 11:23:28.748723 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.748638    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.849715 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.849683    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:28.950928 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:28.950894    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:29.051065 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.050969    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-126.ec2.internal\" not found"
Jul 22 11:23:29.061341 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.061316    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:23:29.113931 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:29.113899    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b1945498e9855749cc238a2c280176b.slice/crio-a00751886826449a4c1b317d793f32fc0aec58a77ae8687b409b6eebf452b4a3 WatchSource:0}: Error finding container a00751886826449a4c1b317d793f32fc0aec58a77ae8687b409b6eebf452b4a3: Status 404 returned error can't find the container with id a00751886826449a4c1b317d793f32fc0aec58a77ae8687b409b6eebf452b4a3
Jul 22 11:23:29.120018 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.119994    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 11:23:29.126852 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:29.126827    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6296955c2fb4ca1bbfcf5b3caef41f.slice/crio-b07fe7d37fca52fa2eedcd3a9230671b767b2773bdc2630db6194ab56adb886a WatchSource:0}: Error finding container b07fe7d37fca52fa2eedcd3a9230671b767b2773bdc2630db6194ab56adb886a: Status 404 returned error can't find the container with id b07fe7d37fca52fa2eedcd3a9230671b767b2773bdc2630db6194ab56adb886a
Jul 22 11:23:29.132964 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.132944    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:29.144897 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.144877    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 11:23:29.145728 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.145712    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"
Jul 22 11:23:29.162961 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.162939    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 11:23:29.615661 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.615606    2580 apiserver.go:52] "Watching apiserver"
Jul 22 11:23:29.627217 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.627190    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 11:23:29.627662 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.627637    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-zhkjq","kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal","openshift-multus/multus-additional-cni-plugins-4ljqz","openshift-multus/network-metrics-daemon-l7hd2","openshift-network-diagnostics/network-check-target-f54g7","openshift-network-operator/iptables-alerter-jz2hf","openshift-ovn-kubernetes/ovnkube-node-dfvpt","kube-system/global-pull-secret-syncer-lrgrw","kube-system/konnectivity-agent-z25mq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw","openshift-cluster-node-tuning-operator/tuned-kzkkd","openshift-dns/node-resolver-lgcn4","openshift-image-registry/node-ca-qxssw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal"]
Jul 22 11:23:29.630966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.630943    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.633232 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.633205    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 11:23:29.633373 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.633352    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.636300 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.636281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.640526 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.640506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:29.640662 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.640641    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:29.642518 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-slash\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642618 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642618 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642558    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642618 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-env-overrides\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.642778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-var-lib-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-node-log\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-log-socket\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-cni-bin\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642819    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovn-node-metrics-cert\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kslj\" (UniqueName: \"kubernetes.io/projected/0055fbaa-71ad-40d1-a04d-dc8e436f4402-kube-api-access-7kslj\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.642916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:29.642916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-run-netns\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-systemd\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642959    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cnibin\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.643162 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.642960    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:29.643162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.642984    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.643162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643026    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-cni-netd\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3020fce0-be50-4058-9ef6-56113e710a41-host\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.643162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-system-cni-dir\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.643162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8h2f\" (UniqueName: \"kubernetes.io/projected/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-kube-api-access-x8h2f\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643199    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-systemd-units\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-etc-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-ovn\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmc5b\" (UniqueName: \"kubernetes.io/projected/3020fce0-be50-4058-9ef6-56113e710a41-kube-api-access-kmc5b\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-os-release\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-kubelet\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovnkube-script-lib\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643386    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovnkube-config\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.643481 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.643423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3020fce0-be50-4058-9ef6-56113e710a41-serviceca\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.645329 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.645315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.647741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.647723    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:29.650255 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.650235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.652591 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.652572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.652691 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.652643    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:29.655063 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.654987    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.657037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.657017    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 11:23:29.657226 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.657204    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 11:23:29.657226 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.657239    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 11:23:29.657411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.657307    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 11:23:29.657411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.657311    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 11:23:29.657411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.657350    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 11:23:29.657411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.657360    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 11:23:29.657823 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.657806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.658341 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.658320    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 11:23:29.658447 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.658375    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 11:23:29.659012 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.658995    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 11:23:29.659135 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.659002    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 11:23:29.659135 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.659108    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4cc9z\""
Jul 22 11:23:29.659408 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.659388    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 11:23:29.659500 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.659388    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 11:23:29.659558 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.659393    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 11:23:29.659558 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.659398    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pjwrh\""
Jul 22 11:23:29.660347 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.660329    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.660819 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.660800    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 11:23:29.660916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.660822    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 11:23:29.660916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.660831    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 11:23:29.661080 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.661061    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zcn57\""
Jul 22 11:23:29.661172 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.661074    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 11:23:29.661172 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.661104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 11:23:29.661172 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.661097    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bxlfx\""
Jul 22 11:23:29.661172 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.661151    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nz2gj\""
Jul 22 11:23:29.661366 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.661260    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5kh7h\""
Jul 22 11:23:29.661366 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.661352    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 11:23:29.673837 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.673804    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 11:23:29.673935 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.673816    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 11:23:29.674184 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.674162    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 11:23:29.674307 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.674201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 11:23:29.676360 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.676343    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 11:23:29.676875 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.676858    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 11:23:29.681194 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.681173    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hbl5s\""
Jul 22 11:23:29.681302 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.681173    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7qvls\""
Jul 22 11:23:29.681413 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.681397    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rc97p\""
Jul 22 11:23:29.688923 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.688908    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 11:23:29.696242 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.696218    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 11:23:29.720319 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.720284    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kn86c"
Jul 22 11:23:29.733635 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.733602    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 11:23:29.736072 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.736001    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal" event={"ID":"5c6296955c2fb4ca1bbfcf5b3caef41f","Type":"ContainerStarted","Data":"b07fe7d37fca52fa2eedcd3a9230671b767b2773bdc2630db6194ab56adb886a"}
Jul 22 11:23:29.737475 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.737448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal" event={"ID":"4b1945498e9855749cc238a2c280176b","Type":"ContainerStarted","Data":"a00751886826449a4c1b317d793f32fc0aec58a77ae8687b409b6eebf452b4a3"}
Jul 22 11:23:29.737782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.737760    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kn86c"
Jul 22 11:23:29.743635 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.743746 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-env-overrides\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.743746 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.743746 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743713    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.743746 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-run-ovn-kubernetes\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743739    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-socket-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743788    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-k8s-cni-cncf-io\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfdhn\" (UniqueName: \"kubernetes.io/projected/2fec41ce-df88-44bf-aba8-44fe5418182c-kube-api-access-vfdhn\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743843    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-sys\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-var-lib-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743901    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-cni-bin\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovn-node-metrics-cert\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kslj\" (UniqueName: \"kubernetes.io/projected/0055fbaa-71ad-40d1-a04d-dc8e436f4402-kube-api-access-7kslj\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-daemon-config\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.743987    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-var-lib-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysctl-d\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744031    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-cni-bin\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744036    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-host\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744090    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-systemd\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744141    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-systemd\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.744168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cnibin\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744181    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04424bd6-9ee4-41be-b934-f966eb467d50-agent-certs\") pod \"konnectivity-agent-z25mq\" (UID: \"04424bd6-9ee4-41be-b934-f966eb467d50\") " pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cnibin\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744222    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-env-overrides\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-system-cni-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-cni-netd\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744303    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-system-cni-dir\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744397    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-system-cni-dir\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-cni-netd\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8edc813e-e977-410e-82d2-647dd46ab2dd-tmp-dir\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r6ph\" (UniqueName: \"kubernetes.io/projected/82c42f71-e5b9-4246-842e-fba169484ef9-kube-api-access-4r6ph\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744539    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-cnibin\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-kubelet\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.745037 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmc5b\" (UniqueName: \"kubernetes.io/projected/3020fce0-be50-4058-9ef6-56113e710a41-kube-api-access-kmc5b\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744613    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744622    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-cni-multus\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-modprobe-d\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysctl-conf\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-tuned\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-kubelet\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744862    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b291c26-0ec8-431a-8c98-1b33c9abc600-kubelet-config\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b291c26-0ec8-431a-8c98-1b33c9abc600-dbus\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-kubelet\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysconfig\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.744981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-systemd\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745060    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-slash\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.745962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-slash\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxp9j\" (UniqueName: \"kubernetes.io/projected/7704f48b-e8f2-4e31-8157-9b26a19cbde2-kube-api-access-rxp9j\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745176    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-os-release\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-hostroot\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745262    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745283    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-node-log\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745307    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-log-socket\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745331    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwvbc\" (UniqueName: \"kubernetes.io/projected/8edc813e-e977-410e-82d2-647dd46ab2dd-kube-api-access-fwvbc\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-conf-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-node-log\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-var-lib-kubelet\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745386    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-log-socket\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-run-netns\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.746722 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-cni-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745497    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-tmp\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745502    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-host-run-netns\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745522    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwns\" (UniqueName: \"kubernetes.io/projected/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-kube-api-access-qlwns\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3020fce0-be50-4058-9ef6-56113e710a41-host\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-device-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745597    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-sys-fs\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745623    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8h2f\" (UniqueName: \"kubernetes.io/projected/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-kube-api-access-x8h2f\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745651    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-registration-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745676    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-socket-dir-parent\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-netns\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745727    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37aca7e8-9c33-4241-a638-30deb9805233-iptables-alerter-script\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-systemd-units\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-etc-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745810    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-ovn\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3020fce0-be50-4058-9ef6-56113e710a41-host\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745876    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-run-ovn\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.747525 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745886    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-systemd-units\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-os-release\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745936    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0055fbaa-71ad-40d1-a04d-dc8e436f4402-etc-openvswitch\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745957    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745973    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8edc813e-e977-410e-82d2-647dd46ab2dd-hosts-file\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.745999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fec41ce-df88-44bf-aba8-44fe5418182c-cni-binary-copy\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-cni-bin\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-multus-certs\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746043    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-os-release\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746111    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovnkube-script-lib\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-etc-selinux\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-etc-kubernetes\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-kubernetes\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746239    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-run\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-lib-modules\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37aca7e8-9c33-4241-a638-30deb9805233-host-slash\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbgs8\" (UniqueName: \"kubernetes.io/projected/37aca7e8-9c33-4241-a638-30deb9805233-kube-api-access-rbgs8\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.748137 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovnkube-config\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.748936 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746375    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3020fce0-be50-4058-9ef6-56113e710a41-serviceca\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.748936 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04424bd6-9ee4-41be-b934-f966eb467d50-konnectivity-ca\") pod \"konnectivity-agent-z25mq\" (UID: \"04424bd6-9ee4-41be-b934-f966eb467d50\") " pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:29.748936 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovnkube-script-lib\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.748936 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746826    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovnkube-config\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.748936 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.746861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3020fce0-be50-4058-9ef6-56113e710a41-serviceca\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.748936 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.748704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0055fbaa-71ad-40d1-a04d-dc8e436f4402-ovn-node-metrics-cert\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.754472 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.754444    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kslj\" (UniqueName: \"kubernetes.io/projected/0055fbaa-71ad-40d1-a04d-dc8e436f4402-kube-api-access-7kslj\") pod \"ovnkube-node-dfvpt\" (UID: \"0055fbaa-71ad-40d1-a04d-dc8e436f4402\") " pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.755271 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.755251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmc5b\" (UniqueName: \"kubernetes.io/projected/3020fce0-be50-4058-9ef6-56113e710a41-kube-api-access-kmc5b\") pod \"node-ca-qxssw\" (UID: \"3020fce0-be50-4058-9ef6-56113e710a41\") " pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.755924 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.755905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8h2f\" (UniqueName: \"kubernetes.io/projected/bd8faaa1-4d59-4dd1-98ef-68260f00d37e-kube-api-access-x8h2f\") pod \"multus-additional-cni-plugins-4ljqz\" (UID: \"bd8faaa1-4d59-4dd1-98ef-68260f00d37e\") " pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.847145 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8edc813e-e977-410e-82d2-647dd46ab2dd-tmp-dir\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.847350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847152    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:29.847350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847180    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r6ph\" (UniqueName: \"kubernetes.io/projected/82c42f71-e5b9-4246-842e-fba169484ef9-kube-api-access-4r6ph\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:29.847350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847210    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-cnibin\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.847350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-kubelet\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.847350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-cni-multus\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.847350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-modprobe-d\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.847350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847314    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysctl-conf\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.847350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847337    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-tuned\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b291c26-0ec8-431a-8c98-1b33c9abc600-kubelet-config\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847391    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b291c26-0ec8-431a-8c98-1b33c9abc600-dbus\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysconfig\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847466    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-systemd\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxp9j\" (UniqueName: \"kubernetes.io/projected/7704f48b-e8f2-4e31-8157-9b26a19cbde2-kube-api-access-rxp9j\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-os-release\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-hostroot\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847571    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvbc\" (UniqueName: \"kubernetes.io/projected/8edc813e-e977-410e-82d2-647dd46ab2dd-kube-api-access-fwvbc\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-conf-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-var-lib-kubelet\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-cni-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-tmp\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwns\" (UniqueName: \"kubernetes.io/projected/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-kube-api-access-qlwns\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.847776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-device-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847777    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-sys-fs\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-registration-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847847    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-socket-dir-parent\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-netns\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37aca7e8-9c33-4241-a638-30deb9805233-iptables-alerter-script\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8edc813e-e977-410e-82d2-647dd46ab2dd-hosts-file\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fec41ce-df88-44bf-aba8-44fe5418182c-cni-binary-copy\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-cni-bin\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.847991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-multus-certs\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-etc-selinux\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-etc-kubernetes\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-kubernetes\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-kubernetes\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-registration-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848280    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysctl-conf\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.848297    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-socket-dir-parent\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.848503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848395    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-netns\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.848399    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret podName:2b291c26-0ec8-431a-8c98-1b33c9abc600 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:30.348370752 +0000 UTC m=+3.011018018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret") pod "global-pull-secret-syncer-lrgrw" (UID: "2b291c26-0ec8-431a-8c98-1b33c9abc600") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-conf-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-var-lib-kubelet\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848722    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-cni-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8edc813e-e977-410e-82d2-647dd46ab2dd-tmp-dir\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.848848    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.848894    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs podName:82c42f71-e5b9-4246-842e-fba169484ef9 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:30.348878922 +0000 UTC m=+3.011526167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs") pod "network-metrics-daemon-l7hd2" (UID: "82c42f71-e5b9-4246-842e-fba169484ef9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.848994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37aca7e8-9c33-4241-a638-30deb9805233-iptables-alerter-script\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8edc813e-e977-410e-82d2-647dd46ab2dd-hosts-file\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849202    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-cnibin\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-kubelet\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-cni-multus\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-modprobe-d\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.849467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-run\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849478    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-lib-modules\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849505    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37aca7e8-9c33-4241-a638-30deb9805233-host-slash\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbgs8\" (UniqueName: \"kubernetes.io/projected/37aca7e8-9c33-4241-a638-30deb9805233-kube-api-access-rbgs8\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04424bd6-9ee4-41be-b934-f966eb467d50-konnectivity-ca\") pod \"konnectivity-agent-z25mq\" (UID: \"04424bd6-9ee4-41be-b934-f966eb467d50\") " pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849600    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-socket-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-k8s-cni-cncf-io\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-var-lib-cni-bin\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfdhn\" (UniqueName: \"kubernetes.io/projected/2fec41ce-df88-44bf-aba8-44fe5418182c-kube-api-access-vfdhn\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-sys\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-daemon-config\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-etc-selinux\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysctl-d\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-host\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-device-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849868    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04424bd6-9ee4-41be-b934-f966eb467d50-agent-certs\") pod \"konnectivity-agent-z25mq\" (UID: \"04424bd6-9ee4-41be-b934-f966eb467d50\") " pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:29.850212 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849896    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849951    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-sys-fs\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849987    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-system-cni-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850109    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-system-cni-dir\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysconfig\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2b291c26-0ec8-431a-8c98-1b33c9abc600-kubelet-config\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-systemd\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-os-release\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2b291c26-0ec8-431a-8c98-1b33c9abc600-dbus\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850254    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-run\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850306    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-multus-certs\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850308    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-lib-modules\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850342    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37aca7e8-9c33-4241-a638-30deb9805233-host-slash\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-etc-kubernetes\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-sys\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850375    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-hostroot\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-sysctl-d\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-host\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.851149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850530    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-socket-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.852111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.849626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fec41ce-df88-44bf-aba8-44fe5418182c-cni-binary-copy\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.852111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850561    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7704f48b-e8f2-4e31-8157-9b26a19cbde2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.852111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850601    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fec41ce-df88-44bf-aba8-44fe5418182c-host-run-k8s-cni-cncf-io\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.852111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/04424bd6-9ee4-41be-b934-f966eb467d50-konnectivity-ca\") pod \"konnectivity-agent-z25mq\" (UID: \"04424bd6-9ee4-41be-b934-f966eb467d50\") " pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:29.852111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.850888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fec41ce-df88-44bf-aba8-44fe5418182c-multus-daemon-config\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.852111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.851896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-tmp\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.852414 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.852171    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-etc-tuned\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.858691 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.858660    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/04424bd6-9ee4-41be-b934-f966eb467d50-agent-certs\") pod \"konnectivity-agent-z25mq\" (UID: \"04424bd6-9ee4-41be-b934-f966eb467d50\") " pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:29.861068 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.860910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwvbc\" (UniqueName: \"kubernetes.io/projected/8edc813e-e977-410e-82d2-647dd46ab2dd-kube-api-access-fwvbc\") pod \"node-resolver-lgcn4\" (UID: \"8edc813e-e977-410e-82d2-647dd46ab2dd\") " pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:29.865655 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.865479    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:23:29.865655 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.865504    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:23:29.865655 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.865518    2580 projected.go:196] Error preparing data for projected volume kube-api-access-msjhm for pod openshift-network-diagnostics/network-check-target-f54g7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:29.865655 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:29.865616    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm podName:c8650cb0-2de2-42f9-88b8-ad59830db009 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:30.365598 +0000 UTC m=+3.028245244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-msjhm" (UniqueName: "kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm") pod "network-check-target-f54g7" (UID: "c8650cb0-2de2-42f9-88b8-ad59830db009") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:29.869264 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.869185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwns\" (UniqueName: \"kubernetes.io/projected/7b5ea956-771e-45fc-a2ae-ca3f0148b65f-kube-api-access-qlwns\") pod \"tuned-kzkkd\" (UID: \"7b5ea956-771e-45fc-a2ae-ca3f0148b65f\") " pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.870156 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.870129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxp9j\" (UniqueName: \"kubernetes.io/projected/7704f48b-e8f2-4e31-8157-9b26a19cbde2-kube-api-access-rxp9j\") pod \"aws-ebs-csi-driver-node-89fgw\" (UID: \"7704f48b-e8f2-4e31-8157-9b26a19cbde2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.871072 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.871046    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfdhn\" (UniqueName: \"kubernetes.io/projected/2fec41ce-df88-44bf-aba8-44fe5418182c-kube-api-access-vfdhn\") pod \"multus-zhkjq\" (UID: \"2fec41ce-df88-44bf-aba8-44fe5418182c\") " pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.872344 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.872321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r6ph\" (UniqueName: \"kubernetes.io/projected/82c42f71-e5b9-4246-842e-fba169484ef9-kube-api-access-4r6ph\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:29.873885 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.873862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbgs8\" (UniqueName: \"kubernetes.io/projected/37aca7e8-9c33-4241-a638-30deb9805233-kube-api-access-rbgs8\") pod \"iptables-alerter-jz2hf\" (UID: \"37aca7e8-9c33-4241-a638-30deb9805233\") " pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.942611 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.942579    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:29.949402 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.949371    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qxssw"
Jul 22 11:23:29.955482 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.955460    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4ljqz"
Jul 22 11:23:29.957785 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:29.957751    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0055fbaa_71ad_40d1_a04d_dc8e436f4402.slice/crio-d72dcea0a3b1592e34d61c74bcd2fc25445fe0368b2e3cc5e20bcf14afba8d76 WatchSource:0}: Error finding container d72dcea0a3b1592e34d61c74bcd2fc25445fe0368b2e3cc5e20bcf14afba8d76: Status 404 returned error can't find the container with id d72dcea0a3b1592e34d61c74bcd2fc25445fe0368b2e3cc5e20bcf14afba8d76
Jul 22 11:23:29.963515 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.963490    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jz2hf"
Jul 22 11:23:29.967829 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.967805    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:29.968699 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:29.968129    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3020fce0_be50_4058_9ef6_56113e710a41.slice/crio-0d53207fcfb42ae17aa85decebe62b3c29fa7cf67a5ac3935365be8a755d5cbb WatchSource:0}: Error finding container 0d53207fcfb42ae17aa85decebe62b3c29fa7cf67a5ac3935365be8a755d5cbb: Status 404 returned error can't find the container with id 0d53207fcfb42ae17aa85decebe62b3c29fa7cf67a5ac3935365be8a755d5cbb
Jul 22 11:23:29.974753 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.974577    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zhkjq"
Jul 22 11:23:29.980963 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:29.980933    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37aca7e8_9c33_4241_a638_30deb9805233.slice/crio-11f5b08a869eafda1fb46883b50dfbb06bffb73b26aed200d52d7e61c04cbe39 WatchSource:0}: Error finding container 11f5b08a869eafda1fb46883b50dfbb06bffb73b26aed200d52d7e61c04cbe39: Status 404 returned error can't find the container with id 11f5b08a869eafda1fb46883b50dfbb06bffb73b26aed200d52d7e61c04cbe39
Jul 22 11:23:29.981248 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.981225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw"
Jul 22 11:23:29.986856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.986818    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kzkkd"
Jul 22 11:23:29.992162 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:29.992135    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04424bd6_9ee4_41be_b934_f966eb467d50.slice/crio-063bc4da4b625549df1c645aa5ab44155a61a9fd2e05afdfa5533eaf88f4be13 WatchSource:0}: Error finding container 063bc4da4b625549df1c645aa5ab44155a61a9fd2e05afdfa5533eaf88f4be13: Status 404 returned error can't find the container with id 063bc4da4b625549df1c645aa5ab44155a61a9fd2e05afdfa5533eaf88f4be13
Jul 22 11:23:29.994181 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:29.994075    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lgcn4"
Jul 22 11:23:30.009672 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:30.009642    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7704f48b_e8f2_4e31_8157_9b26a19cbde2.slice/crio-3b06d4403621a33421d8516a98a53a953fc3ff4fa8924c4711de1948dbeea08d WatchSource:0}: Error finding container 3b06d4403621a33421d8516a98a53a953fc3ff4fa8924c4711de1948dbeea08d: Status 404 returned error can't find the container with id 3b06d4403621a33421d8516a98a53a953fc3ff4fa8924c4711de1948dbeea08d
Jul 22 11:23:30.013533 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:30.013509    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5ea956_771e_45fc_a2ae_ca3f0148b65f.slice/crio-a2c472d6078f5fe9e3d566d1820f05745df731493937c4394e552e91c65e6cdd WatchSource:0}: Error finding container a2c472d6078f5fe9e3d566d1820f05745df731493937c4394e552e91c65e6cdd: Status 404 returned error can't find the container with id a2c472d6078f5fe9e3d566d1820f05745df731493937c4394e552e91c65e6cdd
Jul 22 11:23:30.025322 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:23:30.025293    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8edc813e_e977_410e_82d2_647dd46ab2dd.slice/crio-072d5f88463aac3b1c26f1733712d296ef367056b14015e8cbd4aac3bfb04091 WatchSource:0}: Error finding container 072d5f88463aac3b1c26f1733712d296ef367056b14015e8cbd4aac3bfb04091: Status 404 returned error can't find the container with id 072d5f88463aac3b1c26f1733712d296ef367056b14015e8cbd4aac3bfb04091
Jul 22 11:23:30.059121 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.059072    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:23:30.354552 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.354515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:30.354691 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.354587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:30.354691 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.354677    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:30.354768 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.354685    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:30.354768 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.354757    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret podName:2b291c26-0ec8-431a-8c98-1b33c9abc600 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:31.354734336 +0000 UTC m=+4.017381578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret") pod "global-pull-secret-syncer-lrgrw" (UID: "2b291c26-0ec8-431a-8c98-1b33c9abc600") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:30.354857 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.354778    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs podName:82c42f71-e5b9-4246-842e-fba169484ef9 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:31.354766893 +0000 UTC m=+4.017414131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs") pod "network-metrics-daemon-l7hd2" (UID: "82c42f71-e5b9-4246-842e-fba169484ef9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:30.455155 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.455107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:30.455358 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.455300    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:23:30.455358 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.455321    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:23:30.455358 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.455335    2580 projected.go:196] Error preparing data for projected volume kube-api-access-msjhm for pod openshift-network-diagnostics/network-check-target-f54g7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:30.455528 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.455405    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm podName:c8650cb0-2de2-42f9-88b8-ad59830db009 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:31.455387101 +0000 UTC m=+4.118034343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-msjhm" (UniqueName: "kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm") pod "network-check-target-f54g7" (UID: "c8650cb0-2de2-42f9-88b8-ad59830db009") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:30.731546 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.731512    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:30.732260 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:30.731655    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:30.740612 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.740574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kzkkd" event={"ID":"7b5ea956-771e-45fc-a2ae-ca3f0148b65f","Type":"ContainerStarted","Data":"a2c472d6078f5fe9e3d566d1820f05745df731493937c4394e552e91c65e6cdd"}
Jul 22 11:23:30.740755 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.740669    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 11:18:29 +0000 UTC" deadline="2028-01-28 13:48:08.522154367 +0000 UTC"
Jul 22 11:23:30.740755 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.740687    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13322h24m37.781470524s"
Jul 22 11:23:30.742348 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.742311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zhkjq" event={"ID":"2fec41ce-df88-44bf-aba8-44fe5418182c","Type":"ContainerStarted","Data":"ae83f6bb80f240990568a2d89abdec213043312ccefd573318f0ec2ed6cccd4b"}
Jul 22 11:23:30.744158 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.744125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qxssw" event={"ID":"3020fce0-be50-4058-9ef6-56113e710a41","Type":"ContainerStarted","Data":"0d53207fcfb42ae17aa85decebe62b3c29fa7cf67a5ac3935365be8a755d5cbb"}
Jul 22 11:23:30.745344 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.745318    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"d72dcea0a3b1592e34d61c74bcd2fc25445fe0368b2e3cc5e20bcf14afba8d76"}
Jul 22 11:23:30.746633 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.746612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lgcn4" event={"ID":"8edc813e-e977-410e-82d2-647dd46ab2dd","Type":"ContainerStarted","Data":"072d5f88463aac3b1c26f1733712d296ef367056b14015e8cbd4aac3bfb04091"}
Jul 22 11:23:30.747857 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.747832    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw" event={"ID":"7704f48b-e8f2-4e31-8157-9b26a19cbde2","Type":"ContainerStarted","Data":"3b06d4403621a33421d8516a98a53a953fc3ff4fa8924c4711de1948dbeea08d"}
Jul 22 11:23:30.749115 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.749092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z25mq" event={"ID":"04424bd6-9ee4-41be-b934-f966eb467d50","Type":"ContainerStarted","Data":"063bc4da4b625549df1c645aa5ab44155a61a9fd2e05afdfa5533eaf88f4be13"}
Jul 22 11:23:30.750415 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.750380    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jz2hf" event={"ID":"37aca7e8-9c33-4241-a638-30deb9805233","Type":"ContainerStarted","Data":"11f5b08a869eafda1fb46883b50dfbb06bffb73b26aed200d52d7e61c04cbe39"}
Jul 22 11:23:30.751683 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:30.751662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" event={"ID":"bd8faaa1-4d59-4dd1-98ef-68260f00d37e","Type":"ContainerStarted","Data":"ae5a34daed3500b26b52a5ed51ae73295c0fd9783bc28f4becacfa0f749edd09"}
Jul 22 11:23:31.363195 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:31.363141    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:31.363384 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:31.363220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:31.363384 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.363361    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:31.363549 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.363425    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret podName:2b291c26-0ec8-431a-8c98-1b33c9abc600 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:33.363406205 +0000 UTC m=+6.026053451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret") pod "global-pull-secret-syncer-lrgrw" (UID: "2b291c26-0ec8-431a-8c98-1b33c9abc600") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:31.363879 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.363852    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:31.363978 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.363916    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs podName:82c42f71-e5b9-4246-842e-fba169484ef9 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:33.363900161 +0000 UTC m=+6.026547399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs") pod "network-metrics-daemon-l7hd2" (UID: "82c42f71-e5b9-4246-842e-fba169484ef9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:31.465484 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:31.464437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:31.465484 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.464627    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:23:31.465484 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.464648    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:23:31.465484 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.464662    2580 projected.go:196] Error preparing data for projected volume kube-api-access-msjhm for pod openshift-network-diagnostics/network-check-target-f54g7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:31.465484 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.464724    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm podName:c8650cb0-2de2-42f9-88b8-ad59830db009 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:33.464704566 +0000 UTC m=+6.127351810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-msjhm" (UniqueName: "kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm") pod "network-check-target-f54g7" (UID: "c8650cb0-2de2-42f9-88b8-ad59830db009") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:31.544249 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:31.544211    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 11:23:31.736188 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:31.736053    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:31.737503 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.737455    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:31.737503 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:31.736503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:31.737683 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:31.737591    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:31.741812 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:31.741771    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 11:18:29 +0000 UTC" deadline="2028-03-30 11:04:01.123742394 +0000 UTC"
Jul 22 11:23:31.741812 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:31.741814    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14807h40m29.381933776s"
Jul 22 11:23:32.731725 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:32.731228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:32.731725 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:32.731360    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:33.380990 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:33.380909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:33.381459 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:33.381026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:33.381459 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.381133    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:33.381459 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.381195    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs podName:82c42f71-e5b9-4246-842e-fba169484ef9 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:37.381177178 +0000 UTC m=+10.043824456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs") pod "network-metrics-daemon-l7hd2" (UID: "82c42f71-e5b9-4246-842e-fba169484ef9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:33.381622 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.381537    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:33.381622 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.381579    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret podName:2b291c26-0ec8-431a-8c98-1b33c9abc600 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:37.38156798 +0000 UTC m=+10.044215216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret") pod "global-pull-secret-syncer-lrgrw" (UID: "2b291c26-0ec8-431a-8c98-1b33c9abc600") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:33.482215 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:33.482150    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:33.482401 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.482333    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:23:33.482401 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.482362    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:23:33.482401 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.482375    2580 projected.go:196] Error preparing data for projected volume kube-api-access-msjhm for pod openshift-network-diagnostics/network-check-target-f54g7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:33.482557 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.482456    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm podName:c8650cb0-2de2-42f9-88b8-ad59830db009 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:37.482435932 +0000 UTC m=+10.145083187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-msjhm" (UniqueName: "kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm") pod "network-check-target-f54g7" (UID: "c8650cb0-2de2-42f9-88b8-ad59830db009") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:33.731222 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:33.731121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:33.731382 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.731309    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:33.731382 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:33.731359    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:33.731492 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:33.731463    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:34.731248 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:34.731210    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:34.731699 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:34.731353    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:35.732030 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:35.731499    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:35.732030 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:35.731640    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:35.732473 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:35.732057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:35.732473 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:35.732156    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:36.731449 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:36.731356    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:36.731624 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:36.731500    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:37.416098 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:37.416059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:37.416528 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:37.416127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:37.416528 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.416268    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:37.416528 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.416327    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret podName:2b291c26-0ec8-431a-8c98-1b33c9abc600 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:45.416311499 +0000 UTC m=+18.078958735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret") pod "global-pull-secret-syncer-lrgrw" (UID: "2b291c26-0ec8-431a-8c98-1b33c9abc600") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:37.416680 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.416656    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:37.416803 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.416715    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs podName:82c42f71-e5b9-4246-842e-fba169484ef9 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:45.416698595 +0000 UTC m=+18.079345832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs") pod "network-metrics-daemon-l7hd2" (UID: "82c42f71-e5b9-4246-842e-fba169484ef9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:37.517036 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:37.516608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:37.517036 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.516817    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:23:37.517036 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.516840    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:23:37.517036 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.516852    2580 projected.go:196] Error preparing data for projected volume kube-api-access-msjhm for pod openshift-network-diagnostics/network-check-target-f54g7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:37.517036 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.516910    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm podName:c8650cb0-2de2-42f9-88b8-ad59830db009 nodeName:}" failed. No retries permitted until 2026-07-22 11:23:45.516892519 +0000 UTC m=+18.179539758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-msjhm" (UniqueName: "kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm") pod "network-check-target-f54g7" (UID: "c8650cb0-2de2-42f9-88b8-ad59830db009") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:37.732998 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:37.732456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:37.732998 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.732551    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:37.732998 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:37.732844    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:37.732998 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:37.732914    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:38.730996 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:38.730910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:38.731404 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:38.731072    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:39.733018 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:39.732971    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:39.733018 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:39.732996    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:39.733530 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:39.733149    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:39.733530 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:39.733291    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:40.731270 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:40.731235    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:40.731441 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:40.731362    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:41.731549 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:41.730995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:41.731549 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:41.731154    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:41.732108 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:41.731652    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:41.732108 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:41.731764    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:42.730815 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:42.730788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:42.730983 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:42.730891    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:43.731420 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:43.731378    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:43.731818 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:43.731422    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:43.731818 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:43.731537    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:43.731818 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:43.731680    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:44.731117 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:44.731071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:44.731327 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:44.731205    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:45.480314 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:45.480233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:45.480314 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:45.480286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:45.480901 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.480389    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:45.480901 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.480472    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs podName:82c42f71-e5b9-4246-842e-fba169484ef9 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:01.480447439 +0000 UTC m=+34.143094687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs") pod "network-metrics-daemon-l7hd2" (UID: "82c42f71-e5b9-4246-842e-fba169484ef9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:23:45.480901 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.480394    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:45.480901 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.480857    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret podName:2b291c26-0ec8-431a-8c98-1b33c9abc600 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:01.480840537 +0000 UTC m=+34.143487780 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret") pod "global-pull-secret-syncer-lrgrw" (UID: "2b291c26-0ec8-431a-8c98-1b33c9abc600") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:23:45.581391 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:45.581351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:45.581563 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.581529    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:23:45.581563 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.581548    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:23:45.581563 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.581558    2580 projected.go:196] Error preparing data for projected volume kube-api-access-msjhm for pod openshift-network-diagnostics/network-check-target-f54g7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:45.581675 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.581607    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm podName:c8650cb0-2de2-42f9-88b8-ad59830db009 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:01.581593332 +0000 UTC m=+34.244240571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-msjhm" (UniqueName: "kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm") pod "network-check-target-f54g7" (UID: "c8650cb0-2de2-42f9-88b8-ad59830db009") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:23:45.731061 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:45.730962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:45.731061 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:45.731017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:45.731262 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.731137    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:45.731262 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:45.731250    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:46.731273 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:46.731229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:46.731711 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:46.731379    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:47.732464 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:47.732426    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:47.733155 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:47.733115    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:47.734042 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:47.733998    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:47.734412 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:47.734379    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:48.731436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:48.731403    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:48.731599 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:48.731527    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:49.730846 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:49.730804    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:49.731240 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:49.730936    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:49.731306 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:49.730802    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:49.731462 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:49.731403    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:50.731550 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.731247    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:50.732319 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:50.731621    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:50.791969 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.791884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kzkkd" event={"ID":"7b5ea956-771e-45fc-a2ae-ca3f0148b65f","Type":"ContainerStarted","Data":"fe32d48a38dcd8f9d7bddfbe7e080aa659af727a92fac77c525e18bf33c3763d"}
Jul 22 11:23:50.793319 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.793294    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zhkjq" event={"ID":"2fec41ce-df88-44bf-aba8-44fe5418182c","Type":"ContainerStarted","Data":"2e75697c3d62465e6a661edbf1ca04ea907207ffd99dbd094ac5d49884025214"}
Jul 22 11:23:50.794671 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.794646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qxssw" event={"ID":"3020fce0-be50-4058-9ef6-56113e710a41","Type":"ContainerStarted","Data":"551285dcf4bc7d75547f64c3757a0cb4367e4a450fe534eba3ad9d9473ceb1c2"}
Jul 22 11:23:50.797380 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.797360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"ad6fa0c13fadd8dca318837cf0ebfc7abe94e21518b0df7eae1f2db7359a987a"}
Jul 22 11:23:50.797460 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.797424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"6a0ff42b9d870e0fb35aad0a0a89c382e5ee399a66aa975c35dc98f2b6477271"}
Jul 22 11:23:50.797505 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.797469    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"82aa3e31ffa497f65d8d5eb7404a09f0280e925c623ebefb483ca04e7725bde9"}
Jul 22 11:23:50.797543 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.797518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"6b9895c05bd19b6411e5cb987b8b0734d9b1562fbc3ecf21ce72d59ea1089f2a"}
Jul 22 11:23:50.797584 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.797560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"7cbfbd829ffc1b073ffa1e54f8807eeaea0d01fec699c7ecbb421174b230287e"}
Jul 22 11:23:50.797617 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.797607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"a5ecd8c680db4bbd8c9a190c7e20fdeb07b63fda0ff50fa3f342f3eaa4447bd4"}
Jul 22 11:23:50.798721 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.798704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal" event={"ID":"5c6296955c2fb4ca1bbfcf5b3caef41f","Type":"ContainerStarted","Data":"a8d655e25a438b032babc4b79e8bb64dcb3c3f8eeeb4dc269a756718041b5484"}
Jul 22 11:23:50.799954 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.799934    2580 generic.go:356] "Generic (PLEG): container finished" podID="4b1945498e9855749cc238a2c280176b" containerID="a9a839053a10ede0d8752f7188b1d7170001aa7d33c8c0716dae4b54334ed437" exitCode=0
Jul 22 11:23:50.800067 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.800030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal" event={"ID":"4b1945498e9855749cc238a2c280176b","Type":"ContainerDied","Data":"a9a839053a10ede0d8752f7188b1d7170001aa7d33c8c0716dae4b54334ed437"}
Jul 22 11:23:50.801292 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.801272    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lgcn4" event={"ID":"8edc813e-e977-410e-82d2-647dd46ab2dd","Type":"ContainerStarted","Data":"6e1f85e4d831da1f869e56bd016b72e90c2553bc17ef6399128e839550f62f31"}
Jul 22 11:23:50.802624 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.802601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw" event={"ID":"7704f48b-e8f2-4e31-8157-9b26a19cbde2","Type":"ContainerStarted","Data":"141d039d6dcb76625ad6eee57ab62d78fe6b3e207be57c69af895a224e131ba4"}
Jul 22 11:23:50.803786 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.803768    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z25mq" event={"ID":"04424bd6-9ee4-41be-b934-f966eb467d50","Type":"ContainerStarted","Data":"3ee1bcc5798877163c8ceaab941b31be72cac10a86921d8649160b0adef09fed"}
Jul 22 11:23:50.805122 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.805101    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd8faaa1-4d59-4dd1-98ef-68260f00d37e" containerID="61b6e96c03a9f4a8a3805c648aba4c54fa52d968e6db8d52bd4aef2d6337fafc" exitCode=0
Jul 22 11:23:50.805211 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.805130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" event={"ID":"bd8faaa1-4d59-4dd1-98ef-68260f00d37e","Type":"ContainerDied","Data":"61b6e96c03a9f4a8a3805c648aba4c54fa52d968e6db8d52bd4aef2d6337fafc"}
Jul 22 11:23:50.814231 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.814186    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kzkkd" podStartSLOduration=3.096077735 podStartE2EDuration="22.814173796s" totalImagesPullingTime="19.718096061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:50.813525341 +0000 UTC m=+23.476172625" watchObservedRunningTime="2026-07-22 11:23:50.814173796 +0000 UTC m=+23.476821059"
Jul 22 11:23:50.830767 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.830723    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lgcn4" podStartSLOduration=3.123476926 podStartE2EDuration="22.830707101s" totalImagesPullingTime="19.707230175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:50.830405914 +0000 UTC m=+23.493053172" watchObservedRunningTime="2026-07-22 11:23:50.830707101 +0000 UTC m=+23.493354361"
Jul 22 11:23:50.913506 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.913450    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z25mq" podStartSLOduration=11.676373321 podStartE2EDuration="22.913429573s" totalImagesPullingTime="11.237056252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:50.905058465 +0000 UTC m=+23.567705754" watchObservedRunningTime="2026-07-22 11:23:50.913429573 +0000 UTC m=+23.576076833"
Jul 22 11:23:50.921237 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.920982    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-126.ec2.internal" podStartSLOduration=21.920963791 podStartE2EDuration="21.920963791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:50.920307893 +0000 UTC m=+23.582955173" watchObservedRunningTime="2026-07-22 11:23:50.920963791 +0000 UTC m=+23.583611050"
Jul 22 11:23:50.936856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.936809    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qxssw" podStartSLOduration=14.595492888 podStartE2EDuration="22.936792682s" totalImagesPullingTime="8.341299794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:50.936348826 +0000 UTC m=+23.598996098" watchObservedRunningTime="2026-07-22 11:23:50.936792682 +0000 UTC m=+23.599439940"
Jul 22 11:23:50.959019 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:50.958955    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zhkjq" podStartSLOduration=3.211516726 podStartE2EDuration="22.958941077s" totalImagesPullingTime="19.747424351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:50.958774622 +0000 UTC m=+23.621421880" watchObservedRunningTime="2026-07-22 11:23:50.958941077 +0000 UTC m=+23.621588334"
Jul 22 11:23:51.732034 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:51.731714    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:51.732034 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:51.731847    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:51.732633 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:51.732111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:51.732633 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:51.732233    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:51.810155 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:51.810115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal" event={"ID":"4b1945498e9855749cc238a2c280176b","Type":"ContainerStarted","Data":"c076dcbc3f430a695ca66a9d90badb164e13d11e2ac1db18f7aef35045b4b805"}
Jul 22 11:23:51.811975 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:51.811943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jz2hf" event={"ID":"37aca7e8-9c33-4241-a638-30deb9805233","Type":"ContainerStarted","Data":"7611883f32133cbb5aacc31ea715306f1ab49131d6704e6966b47a3f158162b4"}
Jul 22 11:23:51.849249 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:51.849197    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-126.ec2.internal" podStartSLOduration=22.849181055 podStartE2EDuration="22.849181055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:51.830181761 +0000 UTC m=+24.492829018" watchObservedRunningTime="2026-07-22 11:23:51.849181055 +0000 UTC m=+24.511828313"
Jul 22 11:23:51.849622 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:51.849582    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jz2hf" podStartSLOduration=4.106560025 podStartE2EDuration="23.849563258s" totalImagesPullingTime="19.743003233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:51.848940606 +0000 UTC m=+24.511587865" watchObservedRunningTime="2026-07-22 11:23:51.849563258 +0000 UTC m=+24.512210517"
Jul 22 11:23:52.731731 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:52.731698    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:52.731923 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:52.731830    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:53.141838 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:53.141811    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 11:23:53.711666 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:53.711492    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T11:23:53.141832283Z","UUID":"96712710-966e-4288-bf9f-e147ba5e368b","Handler":null,"Name":"","Endpoint":""}
Jul 22 11:23:53.713331 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:53.713304    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 11:23:53.713468 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:53.713339    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 11:23:53.734924 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:53.734897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:53.735093 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:53.734897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:53.735093 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:53.735034    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:53.735196 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:53.735113    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:53.818526 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:53.818483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw" event={"ID":"7704f48b-e8f2-4e31-8157-9b26a19cbde2","Type":"ContainerStarted","Data":"3e57e29b91d036fd12fcb71e9b0af069aea50bbf02d94220ec3b956a7afd8f74"}
Jul 22 11:23:53.822820 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:53.822795    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"2ab0b431d11ee47dee96d26ba80d97195679d9b3a6d7005aaae63e8c581c9388"}
Jul 22 11:23:54.731260 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:54.731222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:54.731720 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:54.731345    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:54.990261 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:54.990187    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:54.990841 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:54.990821    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:55.731401 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.731163    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:55.731889 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.731166    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:55.731889 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:55.731537    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:55.731889 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:55.731649    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:55.830717 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.830684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" event={"ID":"0055fbaa-71ad-40d1-a04d-dc8e436f4402","Type":"ContainerStarted","Data":"396e5c99c6bc0851909f88137816e41674c66d33edbfb7a812b979ba01625a1a"}
Jul 22 11:23:55.830921 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.830896    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:55.835029 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.834974    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw" event={"ID":"7704f48b-e8f2-4e31-8157-9b26a19cbde2","Type":"ContainerStarted","Data":"b30206213db01264992bb35365eedffbb77b119e10429eb3f2eb50f3572a23b9"}
Jul 22 11:23:55.836825 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.836798    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd8faaa1-4d59-4dd1-98ef-68260f00d37e" containerID="a6b7112f3eb75c48e423f184b28885a847ef56991098b4e0603e6fb24ff3c92a" exitCode=0
Jul 22 11:23:55.836973 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.836876    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" event={"ID":"bd8faaa1-4d59-4dd1-98ef-68260f00d37e","Type":"ContainerDied","Data":"a6b7112f3eb75c48e423f184b28885a847ef56991098b4e0603e6fb24ff3c92a"}
Jul 22 11:23:55.837111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.837089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:55.837765 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.837640    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:23:55.850034 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.849990    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:55.863583 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.863538    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt" podStartSLOduration=8.002763373 podStartE2EDuration="27.86352399s" totalImagesPullingTime="19.860760617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:55.862842459 +0000 UTC m=+28.525489717" watchObservedRunningTime="2026-07-22 11:23:55.86352399 +0000 UTC m=+28.526171248"
Jul 22 11:23:55.957805 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:55.957713    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-89fgw" podStartSLOduration=11.708579362 podStartE2EDuration="27.957698372s" totalImagesPullingTime="16.24911901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:23:55.956875913 +0000 UTC m=+28.619523171" watchObservedRunningTime="2026-07-22 11:23:55.957698372 +0000 UTC m=+28.620345631"
Jul 22 11:23:56.730947 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:56.730908    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:56.731189 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:56.731039    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:56.839246 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:56.839208    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:56.839770 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:56.839300    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:56.853987 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:56.853956    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:23:57.446820 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:57.446792    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrgrw"]
Jul 22 11:23:57.447000 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:57.446957    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:57.447140 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:57.447097    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:57.449564 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:57.449538    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f54g7"]
Jul 22 11:23:57.449671 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:57.449641    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:57.449744 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:57.449727    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:57.450237 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:57.450214    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l7hd2"]
Jul 22 11:23:57.450387 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:57.450372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:57.450505 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:57.450483    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:58.731677 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:58.731645    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:23:58.731677 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:58.731666    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:23:58.732268 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:58.731694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:23:58.732268 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:58.731787    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:23:58.732268 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:58.731810    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:23:58.732268 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:23:58.731892    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:23:58.845732 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:58.845701    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd8faaa1-4d59-4dd1-98ef-68260f00d37e" containerID="553d4f9a7566606769772273a8f98281a7f6a73aa9a46daa45ccd61bfe0ad7a3" exitCode=0
Jul 22 11:23:58.845901 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:58.845786    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" event={"ID":"bd8faaa1-4d59-4dd1-98ef-68260f00d37e","Type":"ContainerDied","Data":"553d4f9a7566606769772273a8f98281a7f6a73aa9a46daa45ccd61bfe0ad7a3"}
Jul 22 11:23:59.850753 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:59.850557    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd8faaa1-4d59-4dd1-98ef-68260f00d37e" containerID="c76a00aab28373622ac6582a9164e58f529d3eb258bb5426708cfbada0fa2633" exitCode=0
Jul 22 11:23:59.851204 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:23:59.850638    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" event={"ID":"bd8faaa1-4d59-4dd1-98ef-68260f00d37e","Type":"ContainerDied","Data":"c76a00aab28373622ac6582a9164e58f529d3eb258bb5426708cfbada0fa2633"}
Jul 22 11:24:00.731659 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:00.731619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:24:00.731841 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:00.731735    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:24:00.731841 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:00.731741    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f54g7" podUID="c8650cb0-2de2-42f9-88b8-ad59830db009"
Jul 22 11:24:00.731954 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:00.731745    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:24:00.731954 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:00.731880    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lrgrw" podUID="2b291c26-0ec8-431a-8c98-1b33c9abc600"
Jul 22 11:24:00.732081 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:00.732022    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l7hd2" podUID="82c42f71-e5b9-4246-842e-fba169484ef9"
Jul 22 11:24:01.500549 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:01.500510    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:24:01.500973 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:01.500574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:24:01.500973 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:01.500678    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:24:01.500973 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:01.500692    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 11:24:01.500973 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:01.500745    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs podName:82c42f71-e5b9-4246-842e-fba169484ef9 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:33.500728906 +0000 UTC m=+66.163376145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs") pod "network-metrics-daemon-l7hd2" (UID: "82c42f71-e5b9-4246-842e-fba169484ef9") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 11:24:01.500973 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:01.500767    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret podName:2b291c26-0ec8-431a-8c98-1b33c9abc600 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:33.500757419 +0000 UTC m=+66.163404654 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret") pod "global-pull-secret-syncer-lrgrw" (UID: "2b291c26-0ec8-431a-8c98-1b33c9abc600") : object "kube-system"/"original-pull-secret" not registered
Jul 22 11:24:01.601324 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:01.601282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:24:01.601497 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:01.601453    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 11:24:01.601497 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:01.601477    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 11:24:01.601497 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:01.601491    2580 projected.go:196] Error preparing data for projected volume kube-api-access-msjhm for pod openshift-network-diagnostics/network-check-target-f54g7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:24:01.601627 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:01.601560    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm podName:c8650cb0-2de2-42f9-88b8-ad59830db009 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:33.601537182 +0000 UTC m=+66.264184420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-msjhm" (UniqueName: "kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm") pod "network-check-target-f54g7" (UID: "c8650cb0-2de2-42f9-88b8-ad59830db009") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 11:24:02.646833 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.646765    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-126.ec2.internal" event="NodeReady"
Jul 22 11:24:02.647253 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.646925    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 11:24:02.693600 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.693569    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dc95bfbff-dbnml"]
Jul 22 11:24:02.712727 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.712697    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.715887 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.715858    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 11:24:02.716123 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.716096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 11:24:02.716430 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.716415    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 11:24:02.716585 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.716563    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7bmns\""
Jul 22 11:24:02.720441 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.720417    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc95bfbff-dbnml"]
Jul 22 11:24:02.723522 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.723328    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 11:24:02.725033 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.724995    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ql9tn"]
Jul 22 11:24:02.740686 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.740654    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8wvnx"]
Jul 22 11:24:02.740873 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.740810    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ql9tn"
Jul 22 11:24:02.744833 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.744810    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dccn9\""
Jul 22 11:24:02.745124 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.745104    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 11:24:02.745259 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.745193    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 11:24:02.745491 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.745474    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 11:24:02.754774 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.754751    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ql9tn"]
Jul 22 11:24:02.754886 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.754789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8wvnx"]
Jul 22 11:24:02.754886 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.754872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:02.754994 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.754928    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:24:02.754994 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.754939    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:24:02.754994 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.754984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:24:02.757643 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.757625    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 11:24:02.758167 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.758149    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cs9j5\""
Jul 22 11:24:02.758257 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.758249    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 11:24:02.758326 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.758278    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bqh28\""
Jul 22 11:24:02.758326 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.758250    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 11:24:02.758433 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.758368    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 11:24:02.758549 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.758531    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7fc2b\""
Jul 22 11:24:02.758610 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.758602    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 11:24:02.758663 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.758612    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 11:24:02.809061 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809023    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3493414e-2373-4eb3-a79c-97377bb82d94-cert\") pod \"ingress-canary-ql9tn\" (UID: \"3493414e-2373-4eb3-a79c-97377bb82d94\") " pod="openshift-ingress-canary/ingress-canary-ql9tn"
Jul 22 11:24:02.809061 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cab89c1-14b4-4e8a-b958-1a62176c9adf-ca-trust-extracted\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.809284 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809082    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-trusted-ca\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.809284 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-272jz\" (UniqueName: \"kubernetes.io/projected/3493414e-2373-4eb3-a79c-97377bb82d94-kube-api-access-272jz\") pod \"ingress-canary-ql9tn\" (UID: \"3493414e-2373-4eb3-a79c-97377bb82d94\") " pod="openshift-ingress-canary/ingress-canary-ql9tn"
Jul 22 11:24:02.809284 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809116    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.809284 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809242    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-image-registry-private-configuration\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.809474 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809295    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-installation-pull-secrets\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.809474 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f8mq\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-kube-api-access-4f8mq\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.809474 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-certificates\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.809474 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.809435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-bound-sa-token\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910136 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-image-registry-private-configuration\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910136 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-installation-pull-secrets\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910136 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f8mq\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-kube-api-access-4f8mq\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910171    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910209    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-certificates\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910247    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4229844a-3cd0-48a0-9008-d0c66b82ca19-config-volume\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-bound-sa-token\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910319    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3493414e-2373-4eb3-a79c-97377bb82d94-cert\") pod \"ingress-canary-ql9tn\" (UID: \"3493414e-2373-4eb3-a79c-97377bb82d94\") " pod="openshift-ingress-canary/ingress-canary-ql9tn"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cab89c1-14b4-4e8a-b958-1a62176c9adf-ca-trust-extracted\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4229844a-3cd0-48a0-9008-d0c66b82ca19-tmp-dir\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-trusted-ca\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmmdq\" (UniqueName: \"kubernetes.io/projected/4229844a-3cd0-48a0-9008-d0c66b82ca19-kube-api-access-jmmdq\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:02.910469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910457    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-272jz\" (UniqueName: \"kubernetes.io/projected/3493414e-2373-4eb3-a79c-97377bb82d94-kube-api-access-272jz\") pod \"ingress-canary-ql9tn\" (UID: \"3493414e-2373-4eb3-a79c-97377bb82d94\") " pod="openshift-ingress-canary/ingress-canary-ql9tn"
Jul 22 11:24:02.910937 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910480    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.910937 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:02.910671    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 11:24:02.910937 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:02.910687    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc95bfbff-dbnml: secret "image-registry-tls" not found
Jul 22 11:24:02.910937 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:02.910751    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls podName:0cab89c1-14b4-4e8a-b958-1a62176c9adf nodeName:}" failed. No retries permitted until 2026-07-22 11:24:03.41073198 +0000 UTC m=+36.073379231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls") pod "image-registry-7dc95bfbff-dbnml" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf") : secret "image-registry-tls" not found
Jul 22 11:24:02.910937 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.910905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-certificates\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.911192 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.911178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cab89c1-14b4-4e8a-b958-1a62176c9adf-ca-trust-extracted\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.912506 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.912460    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-trusted-ca\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.914924 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.914903    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-image-registry-private-configuration\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.915050 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.914922    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-installation-pull-secrets\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.915050 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.914963    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3493414e-2373-4eb3-a79c-97377bb82d94-cert\") pod \"ingress-canary-ql9tn\" (UID: \"3493414e-2373-4eb3-a79c-97377bb82d94\") " pod="openshift-ingress-canary/ingress-canary-ql9tn"
Jul 22 11:24:02.931559 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.931531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-272jz\" (UniqueName: \"kubernetes.io/projected/3493414e-2373-4eb3-a79c-97377bb82d94-kube-api-access-272jz\") pod \"ingress-canary-ql9tn\" (UID: \"3493414e-2373-4eb3-a79c-97377bb82d94\") " pod="openshift-ingress-canary/ingress-canary-ql9tn"
Jul 22 11:24:02.931704 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.931580    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-bound-sa-token\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:02.931704 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:02.931685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f8mq\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-kube-api-access-4f8mq\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:03.011714 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.011673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:03.011714 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.011721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4229844a-3cd0-48a0-9008-d0c66b82ca19-config-volume\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:03.011962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.011771    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4229844a-3cd0-48a0-9008-d0c66b82ca19-tmp-dir\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:03.011962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.011797    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmmdq\" (UniqueName: \"kubernetes.io/projected/4229844a-3cd0-48a0-9008-d0c66b82ca19-kube-api-access-jmmdq\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:03.011962 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:03.011853    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 11:24:03.011962 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:03.011927    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls podName:4229844a-3cd0-48a0-9008-d0c66b82ca19 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:03.511907194 +0000 UTC m=+36.174554449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls") pod "dns-default-8wvnx" (UID: "4229844a-3cd0-48a0-9008-d0c66b82ca19") : secret "dns-default-metrics-tls" not found
Jul 22 11:24:03.012232 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.012206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4229844a-3cd0-48a0-9008-d0c66b82ca19-tmp-dir\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:03.012499 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.012479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4229844a-3cd0-48a0-9008-d0c66b82ca19-config-volume\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:03.024134 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.024107    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmmdq\" (UniqueName: \"kubernetes.io/projected/4229844a-3cd0-48a0-9008-d0c66b82ca19-kube-api-access-jmmdq\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:03.053229 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.053195    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ql9tn"
Jul 22 11:24:03.415802 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.415758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:03.415990 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:03.415909    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 11:24:03.415990 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:03.415926    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc95bfbff-dbnml: secret "image-registry-tls" not found
Jul 22 11:24:03.415990 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:03.415981    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls podName:0cab89c1-14b4-4e8a-b958-1a62176c9adf nodeName:}" failed. No retries permitted until 2026-07-22 11:24:04.415964224 +0000 UTC m=+37.078611480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls") pod "image-registry-7dc95bfbff-dbnml" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf") : secret "image-registry-tls" not found
Jul 22 11:24:03.516863 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:03.516831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:03.517069 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:03.517000    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 11:24:03.517141 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:03.517076    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls podName:4229844a-3cd0-48a0-9008-d0c66b82ca19 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:04.517061224 +0000 UTC m=+37.179708465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls") pod "dns-default-8wvnx" (UID: "4229844a-3cd0-48a0-9008-d0c66b82ca19") : secret "dns-default-metrics-tls" not found
Jul 22 11:24:04.357841 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:04.357671    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ql9tn"]
Jul 22 11:24:04.424218 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:04.424182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:04.424391 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:04.424330    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 11:24:04.424391 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:04.424344    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc95bfbff-dbnml: secret "image-registry-tls" not found
Jul 22 11:24:04.424474 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:04.424399    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls podName:0cab89c1-14b4-4e8a-b958-1a62176c9adf nodeName:}" failed. No retries permitted until 2026-07-22 11:24:06.424382133 +0000 UTC m=+39.087029372 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls") pod "image-registry-7dc95bfbff-dbnml" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf") : secret "image-registry-tls" not found
Jul 22 11:24:04.428105 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:24:04.428071    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3493414e_2373_4eb3_a79c_97377bb82d94.slice/crio-e6fe947133834cac28ae38f2b719f4374f7d60453a5ce51904062f2b01c35088 WatchSource:0}: Error finding container e6fe947133834cac28ae38f2b719f4374f7d60453a5ce51904062f2b01c35088: Status 404 returned error can't find the container with id e6fe947133834cac28ae38f2b719f4374f7d60453a5ce51904062f2b01c35088
Jul 22 11:24:04.524698 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:04.524673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:04.524842 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:04.524820    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 11:24:04.524967 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:04.524884    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls podName:4229844a-3cd0-48a0-9008-d0c66b82ca19 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:06.524867423 +0000 UTC m=+39.187514661 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls") pod "dns-default-8wvnx" (UID: "4229844a-3cd0-48a0-9008-d0c66b82ca19") : secret "dns-default-metrics-tls" not found
Jul 22 11:24:04.866095 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:04.866057    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd8faaa1-4d59-4dd1-98ef-68260f00d37e" containerID="b7b4ddbcef71d6091377ee06edc01a436a95cda1def3f6c95c3d878f690d78ad" exitCode=0
Jul 22 11:24:04.866284 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:04.866146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" event={"ID":"bd8faaa1-4d59-4dd1-98ef-68260f00d37e","Type":"ContainerDied","Data":"b7b4ddbcef71d6091377ee06edc01a436a95cda1def3f6c95c3d878f690d78ad"}
Jul 22 11:24:04.867107 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:04.867085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ql9tn" event={"ID":"3493414e-2373-4eb3-a79c-97377bb82d94","Type":"ContainerStarted","Data":"e6fe947133834cac28ae38f2b719f4374f7d60453a5ce51904062f2b01c35088"}
Jul 22 11:24:05.875285 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:05.875243    2580 generic.go:356] "Generic (PLEG): container finished" podID="bd8faaa1-4d59-4dd1-98ef-68260f00d37e" containerID="932a9fa4cba93b36685b50fd1f48a8bd962ab451bdc180ab3cd6de3ae583bda6" exitCode=0
Jul 22 11:24:05.876075 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:05.875300    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" event={"ID":"bd8faaa1-4d59-4dd1-98ef-68260f00d37e","Type":"ContainerDied","Data":"932a9fa4cba93b36685b50fd1f48a8bd962ab451bdc180ab3cd6de3ae583bda6"}
Jul 22 11:24:06.441430 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:06.441386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:06.441614 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:06.441513    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 11:24:06.441614 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:06.441526    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc95bfbff-dbnml: secret "image-registry-tls" not found
Jul 22 11:24:06.441614 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:06.441585    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls podName:0cab89c1-14b4-4e8a-b958-1a62176c9adf nodeName:}" failed. No retries permitted until 2026-07-22 11:24:10.441568287 +0000 UTC m=+43.104215522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls") pod "image-registry-7dc95bfbff-dbnml" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf") : secret "image-registry-tls" not found
Jul 22 11:24:06.542616 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:06.542582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:06.542788 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:06.542749    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 11:24:06.542847 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:06.542812    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls podName:4229844a-3cd0-48a0-9008-d0c66b82ca19 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:10.542794903 +0000 UTC m=+43.205442139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls") pod "dns-default-8wvnx" (UID: "4229844a-3cd0-48a0-9008-d0c66b82ca19") : secret "dns-default-metrics-tls" not found
Jul 22 11:24:06.883031 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:06.882755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" event={"ID":"bd8faaa1-4d59-4dd1-98ef-68260f00d37e","Type":"ContainerStarted","Data":"9c8e693e2437b238b35fa4f074e56497deb0ff2cd09b8cf9f9b5c214ca610abe"}
Jul 22 11:24:06.910437 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:06.910370    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4ljqz" podStartSLOduration=7.173157038 podStartE2EDuration="38.910349089s" totalImagesPullingTime="31.737192051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:24:06.908807922 +0000 UTC m=+39.571455207" watchObservedRunningTime="2026-07-22 11:24:06.910349089 +0000 UTC m=+39.572996349"
Jul 22 11:24:07.071742 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:07.071699    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z25mq_04424bd6-9ee4-41be-b934-f966eb467d50/konnectivity-agent/0.log" limit=1024
Jul 22 11:24:07.169886 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:07.169809    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z25mq_04424bd6-9ee4-41be-b934-f966eb467d50/konnectivity-agent/0.log" limit=1024
Jul 22 11:24:07.886743 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:07.886704    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ql9tn" event={"ID":"3493414e-2373-4eb3-a79c-97377bb82d94","Type":"ContainerStarted","Data":"fd16c1eb6299458ef50019348dc263b560c450a0092ee310fb68e36b12292b68"}
Jul 22 11:24:07.907749 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:07.907695    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ql9tn" podStartSLOduration=3.076660361 podStartE2EDuration="5.907678494s" totalImagesPullingTime="2.831018133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:24:07.907055041 +0000 UTC m=+40.569702327" watchObservedRunningTime="2026-07-22 11:24:07.907678494 +0000 UTC m=+40.570325731"
Jul 22 11:24:08.006883 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:08.006850    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z25mq_04424bd6-9ee4-41be-b934-f966eb467d50/konnectivity-agent/0.log" limit=1024
Jul 22 11:24:08.107613 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:08.107573    2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z25mq_04424bd6-9ee4-41be-b934-f966eb467d50/konnectivity-agent/0.log" limit=1024
Jul 22 11:24:10.471736 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:10.471697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:10.472252 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:10.471885    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 11:24:10.472252 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:10.471913    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc95bfbff-dbnml: secret "image-registry-tls" not found
Jul 22 11:24:10.472252 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:10.471985    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls podName:0cab89c1-14b4-4e8a-b958-1a62176c9adf nodeName:}" failed. No retries permitted until 2026-07-22 11:24:18.471963228 +0000 UTC m=+51.134610477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls") pod "image-registry-7dc95bfbff-dbnml" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf") : secret "image-registry-tls" not found
Jul 22 11:24:10.572749 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:10.572715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:10.572915 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:10.572881    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 11:24:10.572985 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:10.572956    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls podName:4229844a-3cd0-48a0-9008-d0c66b82ca19 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:18.572936537 +0000 UTC m=+51.235583792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls") pod "dns-default-8wvnx" (UID: "4229844a-3cd0-48a0-9008-d0c66b82ca19") : secret "dns-default-metrics-tls" not found
Jul 22 11:24:18.537336 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:18.537295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:18.537805 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:18.537418    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 11:24:18.537805 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:18.537430    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc95bfbff-dbnml: secret "image-registry-tls" not found
Jul 22 11:24:18.537805 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:18.537479    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls podName:0cab89c1-14b4-4e8a-b958-1a62176c9adf nodeName:}" failed. No retries permitted until 2026-07-22 11:24:34.53746542 +0000 UTC m=+67.200112656 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls") pod "image-registry-7dc95bfbff-dbnml" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf") : secret "image-registry-tls" not found
Jul 22 11:24:18.638196 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:18.638165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:18.638358 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:18.638296    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 11:24:18.638358 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:18.638354    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls podName:4229844a-3cd0-48a0-9008-d0c66b82ca19 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:34.638337757 +0000 UTC m=+67.300984993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls") pod "dns-default-8wvnx" (UID: "4229844a-3cd0-48a0-9008-d0c66b82ca19") : secret "dns-default-metrics-tls" not found
Jul 22 11:24:28.856576 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:28.856545    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dfvpt"
Jul 22 11:24:32.873417 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.873383    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8hrmm"]
Jul 22 11:24:32.878934 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.878909    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:32.882250 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.882229    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 11:24:32.883528 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.883508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5pxx7\""
Jul 22 11:24:32.883528 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.883511    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 11:24:32.883688 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.883550    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 11:24:32.883688 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.883569    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 11:24:32.906192 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.906155    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8hrmm"]
Jul 22 11:24:32.939639 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.939602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a6dde2-73c1-4b9f-a3f7-d121949aa201-data-volume\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:32.939639 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.939643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:32.939874 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.939669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:32.939874 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.939755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a6dde2-73c1-4b9f-a3f7-d121949aa201-crio-socket\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:32.939874 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:32.939816    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt4sr\" (UniqueName: \"kubernetes.io/projected/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-api-access-tt4sr\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.040511 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.040471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt4sr\" (UniqueName: \"kubernetes.io/projected/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-api-access-tt4sr\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.040678 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.040593    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a6dde2-73c1-4b9f-a3f7-d121949aa201-data-volume\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.040678 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.040637    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.040678 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.040659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.040789 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.040736    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 11:24:33.040826 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.040798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a6dde2-73c1-4b9f-a3f7-d121949aa201-crio-socket\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.040826 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.040815    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:33.540793869 +0000 UTC m=+66.203441135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : configmap "kube-rbac-proxy" not found
Jul 22 11:24:33.040924 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.040740    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:33.040924 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.040861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54a6dde2-73c1-4b9f-a3f7-d121949aa201-crio-socket\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.040924 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.040895    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:33.540878211 +0000 UTC m=+66.203525451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:33.041105 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.040970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54a6dde2-73c1-4b9f-a3f7-d121949aa201-data-volume\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.051561 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.051536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt4sr\" (UniqueName: \"kubernetes.io/projected/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-api-access-tt4sr\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.543955 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.543913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:24:33.544159 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.543963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:24:33.544159 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.544088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.544159 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.544123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:33.544279 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.544173    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 11:24:33.544279 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.544225    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:33.544279 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.544236    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:34.544222289 +0000 UTC m=+67.206869525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : configmap "kube-rbac-proxy" not found
Jul 22 11:24:33.544279 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.544272    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:34.544261639 +0000 UTC m=+67.206908875 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:33.547045 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.547030    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 11:24:33.547113 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.547099    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 11:24:33.554499 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.554480    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 22 11:24:33.554563 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:33.554525    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs podName:82c42f71-e5b9-4246-842e-fba169484ef9 nodeName:}" failed. No retries permitted until 2026-07-22 11:25:37.554512027 +0000 UTC m=+130.217159263 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs") pod "network-metrics-daemon-l7hd2" (UID: "82c42f71-e5b9-4246-842e-fba169484ef9") : secret "metrics-daemon-secret" not found
Jul 22 11:24:33.556763 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.556732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2b291c26-0ec8-431a-8c98-1b33c9abc600-original-pull-secret\") pod \"global-pull-secret-syncer-lrgrw\" (UID: \"2b291c26-0ec8-431a-8c98-1b33c9abc600\") " pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:24:33.645282 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.645250    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:24:33.648128 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.648108    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 11:24:33.658891 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.658869    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 11:24:33.670027 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.669980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msjhm\" (UniqueName: \"kubernetes.io/projected/c8650cb0-2de2-42f9-88b8-ad59830db009-kube-api-access-msjhm\") pod \"network-check-target-f54g7\" (UID: \"c8650cb0-2de2-42f9-88b8-ad59830db009\") " pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:24:33.680710 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.680686    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7fc2b\""
Jul 22 11:24:33.684108 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.684092    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lrgrw"
Jul 22 11:24:33.687939 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.687919    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:24:33.817132 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.817104    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lrgrw"]
Jul 22 11:24:33.820324 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:24:33.820298    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b291c26_0ec8_431a_8c98_1b33c9abc600.slice/crio-cfa19d800600f9f42d86f6836ec5c5e005ee1c41d414c7eced1026d681f7990c WatchSource:0}: Error finding container cfa19d800600f9f42d86f6836ec5c5e005ee1c41d414c7eced1026d681f7990c: Status 404 returned error can't find the container with id cfa19d800600f9f42d86f6836ec5c5e005ee1c41d414c7eced1026d681f7990c
Jul 22 11:24:33.841168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.841141    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f54g7"]
Jul 22 11:24:33.843952 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:24:33.843926    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8650cb0_2de2_42f9_88b8_ad59830db009.slice/crio-5b8f095a33482b1a947290d1431603903ceef8fcaf20db1d0f9d5b6324ca956f WatchSource:0}: Error finding container 5b8f095a33482b1a947290d1431603903ceef8fcaf20db1d0f9d5b6324ca956f: Status 404 returned error can't find the container with id 5b8f095a33482b1a947290d1431603903ceef8fcaf20db1d0f9d5b6324ca956f
Jul 22 11:24:33.948604 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.948568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f54g7" event={"ID":"c8650cb0-2de2-42f9-88b8-ad59830db009","Type":"ContainerStarted","Data":"5b8f095a33482b1a947290d1431603903ceef8fcaf20db1d0f9d5b6324ca956f"}
Jul 22 11:24:33.949657 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:33.949634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrgrw" event={"ID":"2b291c26-0ec8-431a-8c98-1b33c9abc600","Type":"ContainerStarted","Data":"cfa19d800600f9f42d86f6836ec5c5e005ee1c41d414c7eced1026d681f7990c"}
Jul 22 11:24:34.550433 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:34.550395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:34.550433 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:34.550439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:34.550786 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:34.550468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:24:34.550786 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.550544    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 11:24:34.550786 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.550590    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:34.550786 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.550630    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:36.550604897 +0000 UTC m=+69.213252156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : configmap "kube-rbac-proxy" not found
Jul 22 11:24:34.550786 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.550650    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:36.550639941 +0000 UTC m=+69.213287179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:34.550786 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.550670    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 22 11:24:34.550786 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.550678    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc95bfbff-dbnml: secret "image-registry-tls" not found
Jul 22 11:24:34.550786 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.550706    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls podName:0cab89c1-14b4-4e8a-b958-1a62176c9adf nodeName:}" failed. No retries permitted until 2026-07-22 11:25:06.550692576 +0000 UTC m=+99.213339812 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls") pod "image-registry-7dc95bfbff-dbnml" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf") : secret "image-registry-tls" not found
Jul 22 11:24:34.651406 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:34.651366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:24:34.651607 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.651509    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 11:24:34.651703 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:34.651681    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls podName:4229844a-3cd0-48a0-9008-d0c66b82ca19 nodeName:}" failed. No retries permitted until 2026-07-22 11:25:06.651658176 +0000 UTC m=+99.314305424 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls") pod "dns-default-8wvnx" (UID: "4229844a-3cd0-48a0-9008-d0c66b82ca19") : secret "dns-default-metrics-tls" not found
Jul 22 11:24:35.068504 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:35.068477    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lgcn4_8edc813e-e977-410e-82d2-647dd46ab2dd/dns-node-resolver/0.log"
Jul 22 11:24:35.668658 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:35.668544    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qxssw_3020fce0-be50-4058-9ef6-56113e710a41/node-ca/0.log"
Jul 22 11:24:36.567735 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:36.567693    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:36.567735 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:36.567736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:36.568240 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:36.567837    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 11:24:36.568240 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:36.567863    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:36.568240 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:36.567910    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:40.567892823 +0000 UTC m=+73.230540060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : configmap "kube-rbac-proxy" not found
Jul 22 11:24:36.568240 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:36.567978    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:40.567960506 +0000 UTC m=+73.230607746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:36.670773 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:36.670732    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ql9tn_3493414e-2373-4eb3-a79c-97377bb82d94/serve-healthcheck-canary/0.log"
Jul 22 11:24:38.965869 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:38.965837    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f54g7" event={"ID":"c8650cb0-2de2-42f9-88b8-ad59830db009","Type":"ContainerStarted","Data":"d4d0cd3386baa0ba077602ded2fcdc39ea697b81eacba07aeb2fe42e01a36029"}
Jul 22 11:24:38.966313 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:38.965965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:24:38.967350 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:38.967329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lrgrw" event={"ID":"2b291c26-0ec8-431a-8c98-1b33c9abc600","Type":"ContainerStarted","Data":"6f95d262e30d1cf31f8de5751da029e64a9aea5a453ef079f92725545ee90b98"}
Jul 22 11:24:38.987571 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:38.987515    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f54g7" podStartSLOduration=66.409141397 podStartE2EDuration="1m10.987500632s" totalImagesPullingTime="4.578359235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:24:38.985610559 +0000 UTC m=+71.648257814" watchObservedRunningTime="2026-07-22 11:24:38.987500632 +0000 UTC m=+71.650147868"
Jul 22 11:24:39.003846 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:39.003741    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lrgrw" podStartSLOduration=66.396532834 podStartE2EDuration="1m11.003719894s" totalImagesPullingTime="4.60718706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:24:39.0034991 +0000 UTC m=+71.666146360" watchObservedRunningTime="2026-07-22 11:24:39.003719894 +0000 UTC m=+71.666367153"
Jul 22 11:24:40.600277 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:40.600231    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:40.600277 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:40.600276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:40.600684 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:40.600358    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 11:24:40.600684 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:40.600403    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:40.600684 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:40.600425    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:48.600408971 +0000 UTC m=+81.263056206 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : configmap "kube-rbac-proxy" not found
Jul 22 11:24:40.600684 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:40.600449    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:24:48.60043764 +0000 UTC m=+81.263084879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:43.954091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:43.954055    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6"]
Jul 22 11:24:43.957702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:43.957687    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6"
Jul 22 11:24:43.960570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:43.960544    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 11:24:43.960706 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:43.960604    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 11:24:43.961689 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:43.961672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rn2k9\""
Jul 22 11:24:43.966436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:43.966415    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6"]
Jul 22 11:24:44.022710 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:44.022669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc6kh\" (UniqueName: \"kubernetes.io/projected/23269cf9-5626-4375-b784-2084c32074b7-kube-api-access-tc6kh\") pod \"migrator-7cc9c7ffd7-mr7n6\" (UID: \"23269cf9-5626-4375-b784-2084c32074b7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6"
Jul 22 11:24:44.123756 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:44.123718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc6kh\" (UniqueName: \"kubernetes.io/projected/23269cf9-5626-4375-b784-2084c32074b7-kube-api-access-tc6kh\") pod \"migrator-7cc9c7ffd7-mr7n6\" (UID: \"23269cf9-5626-4375-b784-2084c32074b7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6"
Jul 22 11:24:44.134694 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:44.134660    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc6kh\" (UniqueName: \"kubernetes.io/projected/23269cf9-5626-4375-b784-2084c32074b7-kube-api-access-tc6kh\") pod \"migrator-7cc9c7ffd7-mr7n6\" (UID: \"23269cf9-5626-4375-b784-2084c32074b7\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6"
Jul 22 11:24:44.267107 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:44.266991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6"
Jul 22 11:24:44.394779 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:44.394746    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6"]
Jul 22 11:24:44.397615 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:24:44.397585    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23269cf9_5626_4375_b784_2084c32074b7.slice/crio-0fd55c4d4138271c17fd215d34522f775878c4ca5651ad0be67b9f1568f6ada8 WatchSource:0}: Error finding container 0fd55c4d4138271c17fd215d34522f775878c4ca5651ad0be67b9f1568f6ada8: Status 404 returned error can't find the container with id 0fd55c4d4138271c17fd215d34522f775878c4ca5651ad0be67b9f1568f6ada8
Jul 22 11:24:44.982482 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:44.982446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6" event={"ID":"23269cf9-5626-4375-b784-2084c32074b7","Type":"ContainerStarted","Data":"0fd55c4d4138271c17fd215d34522f775878c4ca5651ad0be67b9f1568f6ada8"}
Jul 22 11:24:45.986228 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:45.986187    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6" event={"ID":"23269cf9-5626-4375-b784-2084c32074b7","Type":"ContainerStarted","Data":"3fce033f44e02fbf082b279c0b02b21bbfd8d461df9f07e110b14d66ef1f92d8"}
Jul 22 11:24:45.986695 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:45.986241    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6" event={"ID":"23269cf9-5626-4375-b784-2084c32074b7","Type":"ContainerStarted","Data":"970326aaf54f84dcddeeae01260a6d66762883a9976ef2dea0f5fe274ae0a8d5"}
Jul 22 11:24:46.004797 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:46.004748    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-mr7n6" podStartSLOduration=1.903923297 podStartE2EDuration="3.004734696s" totalImagesPullingTime="1.100811399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:24:46.004073863 +0000 UTC m=+78.666721142" watchObservedRunningTime="2026-07-22 11:24:46.004734696 +0000 UTC m=+78.667381954"
Jul 22 11:24:48.659266 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:48.659233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:48.659266 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:48.659270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:24:48.659664 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:48.659378    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:48.659664 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:24:48.659429    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls podName:54a6dde2-73c1-4b9f-a3f7-d121949aa201 nodeName:}" failed. No retries permitted until 2026-07-22 11:25:04.659415359 +0000 UTC m=+97.322062595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8hrmm" (UID: "54a6dde2-73c1-4b9f-a3f7-d121949aa201") : secret "insights-runtime-extractor-tls" not found
Jul 22 11:24:48.659744 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:24:48.659702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54a6dde2-73c1-4b9f-a3f7-d121949aa201-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:25:04.676433 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:04.676372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:25:04.678847 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:04.678810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54a6dde2-73c1-4b9f-a3f7-d121949aa201-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8hrmm\" (UID: \"54a6dde2-73c1-4b9f-a3f7-d121949aa201\") " pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:25:04.687727 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:04.687699    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8hrmm"
Jul 22 11:25:04.819969 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:04.819940    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8hrmm"]
Jul 22 11:25:04.822852 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:04.822822    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a6dde2_73c1_4b9f_a3f7_d121949aa201.slice/crio-5b90fc7a30dc95aef84ca08a344c0f3fade67f85baea456d57104cd30fc739b7 WatchSource:0}: Error finding container 5b90fc7a30dc95aef84ca08a344c0f3fade67f85baea456d57104cd30fc739b7: Status 404 returned error can't find the container with id 5b90fc7a30dc95aef84ca08a344c0f3fade67f85baea456d57104cd30fc739b7
Jul 22 11:25:05.037521 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:05.037425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8hrmm" event={"ID":"54a6dde2-73c1-4b9f-a3f7-d121949aa201","Type":"ContainerStarted","Data":"5b90fc7a30dc95aef84ca08a344c0f3fade67f85baea456d57104cd30fc739b7"}
Jul 22 11:25:06.592047 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.592000    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"]
Jul 22 11:25:06.594304 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.594275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:25:06.596358 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.596341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"
Jul 22 11:25:06.597202 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.597180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"image-registry-7dc95bfbff-dbnml\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") " pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:25:06.600832 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.600617    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 22 11:25:06.600832 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.600692    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 22 11:25:06.600832 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.600707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9b8mn\""
Jul 22 11:25:06.610830 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.610805    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f"]
Jul 22 11:25:06.613926 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.613901    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"]
Jul 22 11:25:06.614050 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.613992    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f"
Jul 22 11:25:06.617217 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.617197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.617480 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.617465    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-sm5sx\""
Jul 22 11:25:06.620556 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.620536    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 11:25:06.620846 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.620827    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 22 11:25:06.621748 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.621511    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"]
Jul 22 11:25:06.621820 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.621762    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 11:25:06.622810 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.622641    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 11:25:06.627651 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.627631    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7bmns\""
Jul 22 11:25:06.635221 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.635196    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:25:06.637473 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.637453    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"]
Jul 22 11:25:06.638510 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.638492    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f"]
Jul 22 11:25:06.694728 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.694700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ce1bf473-2f10-4954-b405-7122304f4ad0-klusterlet-config\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.694986 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.694759    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:25:06.694986 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.694799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db409ef1-f73e-4255-95ba-5db0fa69ca89-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-h656p\" (UID: \"db409ef1-f73e-4255-95ba-5db0fa69ca89\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"
Jul 22 11:25:06.694986 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.694823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqwvf\" (UniqueName: \"kubernetes.io/projected/00407b0a-b6b6-4a2e-a491-0a5e34a36e52-kube-api-access-tqwvf\") pod \"network-check-source-7bc5b6bf85-nhh8f\" (UID: \"00407b0a-b6b6-4a2e-a491-0a5e34a36e52\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f"
Jul 22 11:25:06.694986 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.694852    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzdwj\" (UniqueName: \"kubernetes.io/projected/ce1bf473-2f10-4954-b405-7122304f4ad0-kube-api-access-bzdwj\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.694986 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.694893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce1bf473-2f10-4954-b405-7122304f4ad0-tmp\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.694986 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.694956    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db409ef1-f73e-4255-95ba-5db0fa69ca89-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-h656p\" (UID: \"db409ef1-f73e-4255-95ba-5db0fa69ca89\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"
Jul 22 11:25:06.700171 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.700105    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"]
Jul 22 11:25:06.700743 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.700716    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4229844a-3cd0-48a0-9008-d0c66b82ca19-metrics-tls\") pod \"dns-default-8wvnx\" (UID: \"4229844a-3cd0-48a0-9008-d0c66b82ca19\") " pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:25:06.707146 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.707118    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"
Jul 22 11:25:06.710450 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.710401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-c8nxc\""
Jul 22 11:25:06.710592 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.710475    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 22 11:25:06.718687 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.718659    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"]
Jul 22 11:25:06.795436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.795404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db409ef1-f73e-4255-95ba-5db0fa69ca89-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-h656p\" (UID: \"db409ef1-f73e-4255-95ba-5db0fa69ca89\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"
Jul 22 11:25:06.795436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.795447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db409ef1-f73e-4255-95ba-5db0fa69ca89-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-h656p\" (UID: \"db409ef1-f73e-4255-95ba-5db0fa69ca89\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"
Jul 22 11:25:06.795685 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.795500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e447bdfe-3160-44ae-94a5-9e16846e5baf-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jrvwm\" (UID: \"e447bdfe-3160-44ae-94a5-9e16846e5baf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"
Jul 22 11:25:06.795685 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.795518    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce1bf473-2f10-4954-b405-7122304f4ad0-tmp\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.795685 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.795546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqwvf\" (UniqueName: \"kubernetes.io/projected/00407b0a-b6b6-4a2e-a491-0a5e34a36e52-kube-api-access-tqwvf\") pod \"network-check-source-7bc5b6bf85-nhh8f\" (UID: \"00407b0a-b6b6-4a2e-a491-0a5e34a36e52\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f"
Jul 22 11:25:06.795685 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.795595    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ce1bf473-2f10-4954-b405-7122304f4ad0-klusterlet-config\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.795685 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.795631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzdwj\" (UniqueName: \"kubernetes.io/projected/ce1bf473-2f10-4954-b405-7122304f4ad0-kube-api-access-bzdwj\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.797863 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.797809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce1bf473-2f10-4954-b405-7122304f4ad0-tmp\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.798675 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.798282    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/db409ef1-f73e-4255-95ba-5db0fa69ca89-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-h656p\" (UID: \"db409ef1-f73e-4255-95ba-5db0fa69ca89\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"
Jul 22 11:25:06.799704 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.799674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/db409ef1-f73e-4255-95ba-5db0fa69ca89-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-h656p\" (UID: \"db409ef1-f73e-4255-95ba-5db0fa69ca89\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"
Jul 22 11:25:06.804695 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.804673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc95bfbff-dbnml"]
Jul 22 11:25:06.804991 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.804945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ce1bf473-2f10-4954-b405-7122304f4ad0-klusterlet-config\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.807497 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:06.807471    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cab89c1_14b4_4e8a_b958_1a62176c9adf.slice/crio-bf08f9bff64d03cf95266d9ae54354946ccf5d87667e2c5fed48f0591ec8e85b WatchSource:0}: Error finding container bf08f9bff64d03cf95266d9ae54354946ccf5d87667e2c5fed48f0591ec8e85b: Status 404 returned error can't find the container with id bf08f9bff64d03cf95266d9ae54354946ccf5d87667e2c5fed48f0591ec8e85b
Jul 22 11:25:06.811853 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.811824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqwvf\" (UniqueName: \"kubernetes.io/projected/00407b0a-b6b6-4a2e-a491-0a5e34a36e52-kube-api-access-tqwvf\") pod \"network-check-source-7bc5b6bf85-nhh8f\" (UID: \"00407b0a-b6b6-4a2e-a491-0a5e34a36e52\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f"
Jul 22 11:25:06.814754 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.814733    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzdwj\" (UniqueName: \"kubernetes.io/projected/ce1bf473-2f10-4954-b405-7122304f4ad0-kube-api-access-bzdwj\") pod \"klusterlet-addon-workmgr-f496cb49d-txtnl\" (UID: \"ce1bf473-2f10-4954-b405-7122304f4ad0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.896291 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.896255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e447bdfe-3160-44ae-94a5-9e16846e5baf-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jrvwm\" (UID: \"e447bdfe-3160-44ae-94a5-9e16846e5baf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"
Jul 22 11:25:06.898984 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.898958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e447bdfe-3160-44ae-94a5-9e16846e5baf-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jrvwm\" (UID: \"e447bdfe-3160-44ae-94a5-9e16846e5baf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"
Jul 22 11:25:06.912800 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.912766    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"
Jul 22 11:25:06.926261 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.926228    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f"
Jul 22 11:25:06.932840 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.932815    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:06.967823 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.967762    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bqh28\""
Jul 22 11:25:06.975775 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:06.975747    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:25:07.023686 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.023461    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"
Jul 22 11:25:07.053535 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.051568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml" event={"ID":"0cab89c1-14b4-4e8a-b958-1a62176c9adf","Type":"ContainerStarted","Data":"94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25"}
Jul 22 11:25:07.053535 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.051634    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml" event={"ID":"0cab89c1-14b4-4e8a-b958-1a62176c9adf","Type":"ContainerStarted","Data":"bf08f9bff64d03cf95266d9ae54354946ccf5d87667e2c5fed48f0591ec8e85b"}
Jul 22 11:25:07.053535 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.052422    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:25:07.079731 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.077904    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml" podStartSLOduration=99.077879109 podStartE2EDuration="1m39.077879109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:07.076937473 +0000 UTC m=+99.739584733" watchObservedRunningTime="2026-07-22 11:25:07.077879109 +0000 UTC m=+99.740526368"
Jul 22 11:25:07.122343 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.122223    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-h656p"]
Jul 22 11:25:07.128830 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:07.128785    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb409ef1_f73e_4255_95ba_5db0fa69ca89.slice/crio-2fcfc93850f799793307c68b7a76ba37ae18bac6d1f3ee7471df14a72eab3df5 WatchSource:0}: Error finding container 2fcfc93850f799793307c68b7a76ba37ae18bac6d1f3ee7471df14a72eab3df5: Status 404 returned error can't find the container with id 2fcfc93850f799793307c68b7a76ba37ae18bac6d1f3ee7471df14a72eab3df5
Jul 22 11:25:07.139562 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.139520    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f"]
Jul 22 11:25:07.151231 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:07.150791    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00407b0a_b6b6_4a2e_a491_0a5e34a36e52.slice/crio-73b58f6e7785ab07dad9e5e2e2ecd179f389087ab93374f0f415ab9b697e3387 WatchSource:0}: Error finding container 73b58f6e7785ab07dad9e5e2e2ecd179f389087ab93374f0f415ab9b697e3387: Status 404 returned error can't find the container with id 73b58f6e7785ab07dad9e5e2e2ecd179f389087ab93374f0f415ab9b697e3387
Jul 22 11:25:07.155728 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.155701    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"]
Jul 22 11:25:07.160466 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:07.160433    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1bf473_2f10_4954_b405_7122304f4ad0.slice/crio-514f230b7fb5ad7cc3c8b8c160efa8dfa93a45655ee538d9fcfbb2be50e2bcde WatchSource:0}: Error finding container 514f230b7fb5ad7cc3c8b8c160efa8dfa93a45655ee538d9fcfbb2be50e2bcde: Status 404 returned error can't find the container with id 514f230b7fb5ad7cc3c8b8c160efa8dfa93a45655ee538d9fcfbb2be50e2bcde
Jul 22 11:25:07.211272 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.211196    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8wvnx"]
Jul 22 11:25:07.237790 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.237760    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"]
Jul 22 11:25:07.771456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.771422    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-hlxqk"]
Jul 22 11:25:07.888153 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.888118    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hlxqk"]
Jul 22 11:25:07.888345 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.888223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hlxqk"
Jul 22 11:25:07.891285 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.891260    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 22 11:25:07.891423 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.891304    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 22 11:25:07.891519 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:07.891498    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h8s7r\""
Jul 22 11:25:08.005202 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:08.005163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9gbr\" (UniqueName: \"kubernetes.io/projected/73dc3655-0cca-49d1-98d3-fa797388b04c-kube-api-access-r9gbr\") pod \"downloads-5bc67dcd46-hlxqk\" (UID: \"73dc3655-0cca-49d1-98d3-fa797388b04c\") " pod="openshift-console/downloads-5bc67dcd46-hlxqk"
Jul 22 11:25:08.057111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:08.056997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl" event={"ID":"ce1bf473-2f10-4954-b405-7122304f4ad0","Type":"ContainerStarted","Data":"514f230b7fb5ad7cc3c8b8c160efa8dfa93a45655ee538d9fcfbb2be50e2bcde"}
Jul 22 11:25:08.058452 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:08.058416    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p" event={"ID":"db409ef1-f73e-4255-95ba-5db0fa69ca89","Type":"ContainerStarted","Data":"2fcfc93850f799793307c68b7a76ba37ae18bac6d1f3ee7471df14a72eab3df5"}
Jul 22 11:25:08.060075 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:08.060041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f" event={"ID":"00407b0a-b6b6-4a2e-a491-0a5e34a36e52","Type":"ContainerStarted","Data":"b73283cca84a7465b0a493c114e7042773979adc79dd5f8725d0e3d4ca6290b5"}
Jul 22 11:25:08.060190 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:08.060096    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f" event={"ID":"00407b0a-b6b6-4a2e-a491-0a5e34a36e52","Type":"ContainerStarted","Data":"73b58f6e7785ab07dad9e5e2e2ecd179f389087ab93374f0f415ab9b697e3387"}
Jul 22 11:25:08.105920 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:08.105875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9gbr\" (UniqueName: \"kubernetes.io/projected/73dc3655-0cca-49d1-98d3-fa797388b04c-kube-api-access-r9gbr\") pod \"downloads-5bc67dcd46-hlxqk\" (UID: \"73dc3655-0cca-49d1-98d3-fa797388b04c\") " pod="openshift-console/downloads-5bc67dcd46-hlxqk"
Jul 22 11:25:08.117658 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:08.117631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9gbr\" (UniqueName: \"kubernetes.io/projected/73dc3655-0cca-49d1-98d3-fa797388b04c-kube-api-access-r9gbr\") pod \"downloads-5bc67dcd46-hlxqk\" (UID: \"73dc3655-0cca-49d1-98d3-fa797388b04c\") " pod="openshift-console/downloads-5bc67dcd46-hlxqk"
Jul 22 11:25:08.202341 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:08.202303    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hlxqk"
Jul 22 11:25:09.603215 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:09.603180    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode447bdfe_3160_44ae_94a5_9e16846e5baf.slice/crio-8c7e068007f51a106c1e9a04d970cecf2356fc43c75ad5a4c3149a3804d7411d WatchSource:0}: Error finding container 8c7e068007f51a106c1e9a04d970cecf2356fc43c75ad5a4c3149a3804d7411d: Status 404 returned error can't find the container with id 8c7e068007f51a106c1e9a04d970cecf2356fc43c75ad5a4c3149a3804d7411d
Jul 22 11:25:09.603601 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:09.603579    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4229844a_3cd0_48a0_9008_d0c66b82ca19.slice/crio-4ef996ed84f2fdc9d0776da07574f0ddca460bd52de3578ae16e79658f05c486 WatchSource:0}: Error finding container 4ef996ed84f2fdc9d0776da07574f0ddca460bd52de3578ae16e79658f05c486: Status 404 returned error can't find the container with id 4ef996ed84f2fdc9d0776da07574f0ddca460bd52de3578ae16e79658f05c486
Jul 22 11:25:09.972654 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:09.972578    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f54g7"
Jul 22 11:25:09.993222 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:09.992845    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-nhh8f" podStartSLOduration=3.992824247 podStartE2EDuration="3.992824247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:08.077416614 +0000 UTC m=+100.740063872" watchObservedRunningTime="2026-07-22 11:25:09.992824247 +0000 UTC m=+102.655471506"
Jul 22 11:25:10.071494 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:10.071453    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm" event={"ID":"e447bdfe-3160-44ae-94a5-9e16846e5baf","Type":"ContainerStarted","Data":"8c7e068007f51a106c1e9a04d970cecf2356fc43c75ad5a4c3149a3804d7411d"}
Jul 22 11:25:10.075333 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:10.075298    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wvnx" event={"ID":"4229844a-3cd0-48a0-9008-d0c66b82ca19","Type":"ContainerStarted","Data":"4ef996ed84f2fdc9d0776da07574f0ddca460bd52de3578ae16e79658f05c486"}
Jul 22 11:25:11.073195 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:11.071712    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hlxqk"]
Jul 22 11:25:11.795352 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:11.795318    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dc3655_0cca_49d1_98d3_fa797388b04c.slice/crio-a062da5d985068d596020c46ef5acd2259559aa96ffc86d1d17cae1cf8a3a83d WatchSource:0}: Error finding container a062da5d985068d596020c46ef5acd2259559aa96ffc86d1d17cae1cf8a3a83d: Status 404 returned error can't find the container with id a062da5d985068d596020c46ef5acd2259559aa96ffc86d1d17cae1cf8a3a83d
Jul 22 11:25:12.085358 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:12.085321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hlxqk" event={"ID":"73dc3655-0cca-49d1-98d3-fa797388b04c","Type":"ContainerStarted","Data":"a062da5d985068d596020c46ef5acd2259559aa96ffc86d1d17cae1cf8a3a83d"}
Jul 22 11:25:14.100994 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:14.100956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8hrmm" event={"ID":"54a6dde2-73c1-4b9f-a3f7-d121949aa201","Type":"ContainerStarted","Data":"bf03673b676c33b5628d0841f5fab3fd26ede10f71dfe1b5290011f43b6d43ac"}
Jul 22 11:25:15.110904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.110860    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm" event={"ID":"e447bdfe-3160-44ae-94a5-9e16846e5baf","Type":"ContainerStarted","Data":"aaef083cc737ddc79e409e2396fdb2fdfd82666529005eee397503d6d82d4b43"}
Jul 22 11:25:15.112070 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.112019    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"
Jul 22 11:25:15.117018 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.116969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl" event={"ID":"ce1bf473-2f10-4954-b405-7122304f4ad0","Type":"ContainerStarted","Data":"76a0163445f86c026e6b8cbccbc0c457f5851520608b1c2229df06dcc9bfa88a"}
Jul 22 11:25:15.119032 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.118861    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:15.119607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.119498    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl"
Jul 22 11:25:15.119607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.119581    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm"
Jul 22 11:25:15.120868 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.120635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p" event={"ID":"db409ef1-f73e-4255-95ba-5db0fa69ca89","Type":"ContainerStarted","Data":"cc7ebacc8bf76973e72729e9790aa47f33a75b529ef34407b6832aa32ae393e9"}
Jul 22 11:25:15.124547 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.124197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wvnx" event={"ID":"4229844a-3cd0-48a0-9008-d0c66b82ca19","Type":"ContainerStarted","Data":"dfcd82086f476828e0393bbbd825651f0587e42f1a77e03e8b6a58c4afa6c64c"}
Jul 22 11:25:15.124547 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.124242    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8wvnx" event={"ID":"4229844a-3cd0-48a0-9008-d0c66b82ca19","Type":"ContainerStarted","Data":"d0a520d5021cdfd672c447b44f1397acb23adbadbdd79eedc8bf2c1af0202a5c"}
Jul 22 11:25:15.124723 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.124703    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:25:15.146907 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.146446    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jrvwm" podStartSLOduration=4.694825183 podStartE2EDuration="9.146424859s" totalImagesPullingTime="4.451599676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:15.14526178 +0000 UTC m=+107.807909063" watchObservedRunningTime="2026-07-22 11:25:15.146424859 +0000 UTC m=+107.809072098"
Jul 22 11:25:15.188360 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.188074    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8wvnx" podStartSLOduration=68.78244974 podStartE2EDuration="1m13.188053464s" totalImagesPullingTime="4.405603724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:15.167572702 +0000 UTC m=+107.830219964" watchObservedRunningTime="2026-07-22 11:25:15.188053464 +0000 UTC m=+107.850700724"
Jul 22 11:25:15.210392 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:15.210334    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f496cb49d-txtnl" podStartSLOduration=2.362826416 podStartE2EDuration="9.210317102s" totalImagesPullingTime="6.847490686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:15.188146075 +0000 UTC m=+107.850793334" watchObservedRunningTime="2026-07-22 11:25:15.210317102 +0000 UTC m=+107.872964360"
Jul 22 11:25:18.138604 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:18.138562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8hrmm" event={"ID":"54a6dde2-73c1-4b9f-a3f7-d121949aa201","Type":"ContainerStarted","Data":"49b8c71b81210c4c6977c74490f32b4c7c58cca741a1921c7a29439c066b93dd"}
Jul 22 11:25:20.661094 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.660955    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-h656p" podStartSLOduration=7.781304424 podStartE2EDuration="14.660895664s" totalImagesPullingTime="6.87959124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:15.239301434 +0000 UTC m=+107.901948719" watchObservedRunningTime="2026-07-22 11:25:20.660895664 +0000 UTC m=+113.323542915"
Jul 22 11:25:20.661832 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.661759    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"]
Jul 22 11:25:20.667079 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.667050    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xph6l"]
Jul 22 11:25:20.667209 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.667123    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.673885 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.673855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.675403 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.675373    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 22 11:25:20.675403 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.675396    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 11:25:20.675591 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.675525    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 22 11:25:20.675591 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.675544    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 11:25:20.675700 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.675643    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 11:25:20.677124 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.676163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zc49m\""
Jul 22 11:25:20.677737 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.677719    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 11:25:20.677963 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.677947    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 11:25:20.678676 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.678490    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 11:25:20.680387 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.680339    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nfv49\""
Jul 22 11:25:20.683588 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.683557    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"]
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a24ecd4-d305-411f-b243-ff5bb2018aaf-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-sys\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-textfile\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826466    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be638fa3-99e4-46a7-9efc-beba657e4850-metrics-client-ca\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw6d6\" (UniqueName: \"kubernetes.io/projected/be638fa3-99e4-46a7-9efc-beba657e4850-kube-api-access-sw6d6\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-wtmp\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdjf6\" (UniqueName: \"kubernetes.io/projected/4a24ecd4-d305-411f-b243-ff5bb2018aaf-kube-api-access-fdjf6\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-accelerators-collector-config\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826665    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-tls\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.826828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.826688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-root\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928066 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.927970    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928066 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a24ecd4-d305-411f-b243-ff5bb2018aaf-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.928296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928068    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-sys\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928107    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-textfile\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be638fa3-99e4-46a7-9efc-beba657e4850-metrics-client-ca\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6d6\" (UniqueName: \"kubernetes.io/projected/be638fa3-99e4-46a7-9efc-beba657e4850-kube-api-access-sw6d6\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-wtmp\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.928296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928261    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.928616 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928280    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdjf6\" (UniqueName: \"kubernetes.io/projected/4a24ecd4-d305-411f-b243-ff5bb2018aaf-kube-api-access-fdjf6\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.928616 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-accelerators-collector-config\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928616 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928368    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-tls\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928616 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928383    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-root\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928616 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-root\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.928970 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.928945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-wtmp\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.929256 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:25:20.929230    2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 22 11:25:20.929328 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:25:20.929297    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-tls podName:4a24ecd4-d305-411f-b243-ff5bb2018aaf nodeName:}" failed. No retries permitted until 2026-07-22 11:25:21.429278823 +0000 UTC m=+114.091926059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-vfk7w" (UID: "4a24ecd4-d305-411f-b243-ff5bb2018aaf") : secret "openshift-state-metrics-tls" not found
Jul 22 11:25:20.929715 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.929692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a24ecd4-d305-411f-b243-ff5bb2018aaf-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.929780 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.929763    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/be638fa3-99e4-46a7-9efc-beba657e4850-sys\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.930741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.930024    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-textfile\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.930741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.930352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-accelerators-collector-config\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.930741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.930464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be638fa3-99e4-46a7-9efc-beba657e4850-metrics-client-ca\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.932207 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.932184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.932330 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.932309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.933839 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.933815    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/be638fa3-99e4-46a7-9efc-beba657e4850-node-exporter-tls\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.939915 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.939871    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdjf6\" (UniqueName: \"kubernetes.io/projected/4a24ecd4-d305-411f-b243-ff5bb2018aaf-kube-api-access-fdjf6\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:20.941992 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.941819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6d6\" (UniqueName: \"kubernetes.io/projected/be638fa3-99e4-46a7-9efc-beba657e4850-kube-api-access-sw6d6\") pod \"node-exporter-xph6l\" (UID: \"be638fa3-99e4-46a7-9efc-beba657e4850\") " pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:20.995899 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:20.995861    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xph6l"
Jul 22 11:25:21.432767 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.432725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:21.435611 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.435587    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4a24ecd4-d305-411f-b243-ff5bb2018aaf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-vfk7w\" (UID: \"4a24ecd4-d305-411f-b243-ff5bb2018aaf\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:21.582849 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.582811    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:25:21.588711 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.588679    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"
Jul 22 11:25:21.594238 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.594198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.597932 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.597908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 11:25:21.598069 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.597971    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 11:25:21.598452 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.597908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 11:25:21.598452 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.598311    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 11:25:21.598452 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.598350    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 11:25:21.598661 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.598607    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zllpw\""
Jul 22 11:25:21.598716 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.598696    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 11:25:21.598834 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.598818    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 11:25:21.598898 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.598884    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 11:25:21.598985 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.598974    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 11:25:21.606857 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.606830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:25:21.734959 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.734874    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.734959 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.734917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.734959 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.734943    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfmmx\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-kube-api-access-sfmmx\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735153    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-web-config\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735271    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735300    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-config-out\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-config-volume\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.735589 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.735347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.835936 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.835895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-web-config\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.835936 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.835940    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.835966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-config-out\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836042    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-config-volume\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836099    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836122    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836143    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836194    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfmmx\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-kube-api-access-sfmmx\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836748 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836748 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.836748 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.836380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.837447 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.837418    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.838506 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.838476    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.840713 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.840689    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.840822 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.840749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.840979 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.840956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-config-out\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.841403 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.841383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-web-config\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.842289 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.842244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.842395 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.842296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.842395 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.842343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.843676 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.843649    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.844845 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.844823    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-config-volume\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.847112 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.847093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfmmx\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-kube-api-access-sfmmx\") pod \"alertmanager-main-0\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:21.907700 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:21.907660    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:25:22.150935 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:22.150901    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe638fa3_99e4_46a7_9efc_beba657e4850.slice/crio-4aa95b038095794181427bf43fa3407f1f190072eae3a896bdfc2953d6964736 WatchSource:0}: Error finding container 4aa95b038095794181427bf43fa3407f1f190072eae3a896bdfc2953d6964736: Status 404 returned error can't find the container with id 4aa95b038095794181427bf43fa3407f1f190072eae3a896bdfc2953d6964736
Jul 22 11:25:22.157579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.157545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xph6l" event={"ID":"be638fa3-99e4-46a7-9efc-beba657e4850","Type":"ContainerStarted","Data":"4aa95b038095794181427bf43fa3407f1f190072eae3a896bdfc2953d6964736"}
Jul 22 11:25:22.319436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.319410    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:25:22.322183 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:22.322150    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b68083_d377_41a2_b459_1257b3b8f57d.slice/crio-91adc2ed9ca7c115ed209029f60c6d6b50a210acca90caa5761f50e26bf3e65d WatchSource:0}: Error finding container 91adc2ed9ca7c115ed209029f60c6d6b50a210acca90caa5761f50e26bf3e65d: Status 404 returned error can't find the container with id 91adc2ed9ca7c115ed209029f60c6d6b50a210acca90caa5761f50e26bf3e65d
Jul 22 11:25:22.333467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.333435    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w"]
Jul 22 11:25:22.337158 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:22.337127    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a24ecd4_d305_411f_b243_ff5bb2018aaf.slice/crio-3ea398be403463d5f58295be37d9412c4f8b74a23654429f099d11c9ee830444 WatchSource:0}: Error finding container 3ea398be403463d5f58295be37d9412c4f8b74a23654429f099d11c9ee830444: Status 404 returned error can't find the container with id 3ea398be403463d5f58295be37d9412c4f8b74a23654429f099d11c9ee830444
Jul 22 11:25:22.587119 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.587079    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-89fd88777-zgt7v"]
Jul 22 11:25:22.590983 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.590962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.594386 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.594360    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-64spn\""
Jul 22 11:25:22.594386 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.594376    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-39b2tiou36ahg\""
Jul 22 11:25:22.594556 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.594446    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 11:25:22.594714 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.594686    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 11:25:22.594780 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.594686    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 11:25:22.595054 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.595034    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 11:25:22.595154 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.595064    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 11:25:22.605579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.605558    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-89fd88777-zgt7v"]
Jul 22 11:25:22.744420 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.744346    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-grpc-tls\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.744420 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.744397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.744904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.744436    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-metrics-client-ca\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.744904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.744476    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnbb6\" (UniqueName: \"kubernetes.io/projected/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-kube-api-access-mnbb6\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.744904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.744536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-tls\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.744904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.744563    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.744904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.744609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.744904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.744633    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.846000 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.845958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.846206 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.846027    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.846206 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.846098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-grpc-tls\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.846206 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.846149    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.846206 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.846183    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-metrics-client-ca\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.846206 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.846205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnbb6\" (UniqueName: \"kubernetes.io/projected/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-kube-api-access-mnbb6\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.846437 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.846247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-tls\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.846437 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.846274    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.848144 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.847869    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-metrics-client-ca\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.850716 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.850684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.851024 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.850777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.851024 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.850930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-grpc-tls\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.851618 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.851597    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-tls\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.851715 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.851682    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.852171 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.852153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.860989 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.860940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnbb6\" (UniqueName: \"kubernetes.io/projected/5c479ef6-8bcb-45fe-9a0d-9594e90c73c2-kube-api-access-mnbb6\") pod \"thanos-querier-89fd88777-zgt7v\" (UID: \"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2\") " pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:22.901948 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:22.901902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:23.100900 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:23.100856    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-89fd88777-zgt7v"]
Jul 22 11:25:23.103163 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:23.103132    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c479ef6_8bcb_45fe_9a0d_9594e90c73c2.slice/crio-38236699311f84736dd0120464d3a015d2c90005003b8b850f63fc80852e099e WatchSource:0}: Error finding container 38236699311f84736dd0120464d3a015d2c90005003b8b850f63fc80852e099e: Status 404 returned error can't find the container with id 38236699311f84736dd0120464d3a015d2c90005003b8b850f63fc80852e099e
Jul 22 11:25:23.164703 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:23.164668    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v" event={"ID":"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2","Type":"ContainerStarted","Data":"38236699311f84736dd0120464d3a015d2c90005003b8b850f63fc80852e099e"}
Jul 22 11:25:23.168692 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:23.168547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w" event={"ID":"4a24ecd4-d305-411f-b243-ff5bb2018aaf","Type":"ContainerStarted","Data":"28d0bf6be46b4356b9355903272237b1d3538d27f3cc201711264308b59094c7"}
Jul 22 11:25:23.168692 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:23.168612    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w" event={"ID":"4a24ecd4-d305-411f-b243-ff5bb2018aaf","Type":"ContainerStarted","Data":"4bb16e5a64635ad669ee59c2d91f6451f2ccd1e4fc936c66cbbf0507bc2e86d1"}
Jul 22 11:25:23.168692 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:23.168643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w" event={"ID":"4a24ecd4-d305-411f-b243-ff5bb2018aaf","Type":"ContainerStarted","Data":"3ea398be403463d5f58295be37d9412c4f8b74a23654429f099d11c9ee830444"}
Jul 22 11:25:23.170676 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:23.170591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerStarted","Data":"91adc2ed9ca7c115ed209029f60c6d6b50a210acca90caa5761f50e26bf3e65d"}
Jul 22 11:25:23.173756 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:23.173681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8hrmm" event={"ID":"54a6dde2-73c1-4b9f-a3f7-d121949aa201","Type":"ContainerStarted","Data":"b1a983cc2b7664fc4dbdcbcec5a087278b9740d80b5ee115c67278354d81ad31"}
Jul 22 11:25:23.205463 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:23.205224    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8hrmm" podStartSLOduration=33.958695611 podStartE2EDuration="51.205204335s" totalImagesPullingTime="17.246508724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 11:24:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:23.204819202 +0000 UTC m=+115.867466515" watchObservedRunningTime="2026-07-22 11:25:23.205204335 +0000 UTC m=+115.867851592"
Jul 22 11:25:24.183655 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:24.183616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w" event={"ID":"4a24ecd4-d305-411f-b243-ff5bb2018aaf","Type":"ContainerStarted","Data":"a757d1dcbc333ed61903cf6058210b3c9c43ac385e7469c18af6392600174d91"}
Jul 22 11:25:24.188690 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:24.187860    2580 generic.go:356] "Generic (PLEG): container finished" podID="48b68083-d377-41a2-b459-1257b3b8f57d" containerID="e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04" exitCode=0
Jul 22 11:25:24.188690 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:24.188062    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerDied","Data":"e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04"}
Jul 22 11:25:24.206233 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:24.205317    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-vfk7w" podStartSLOduration=2.949226393 podStartE2EDuration="4.205296718s" totalImagesPullingTime="1.256070325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:24.203525943 +0000 UTC m=+116.866173202" watchObservedRunningTime="2026-07-22 11:25:24.205296718 +0000 UTC m=+116.867943976"
Jul 22 11:25:25.185387 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.185355    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c9c6d94b-qxgd8"]
Jul 22 11:25:25.188866 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.188840    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.192299 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.192132    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 22 11:25:25.193363 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.193334    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 22 11:25:25.193486 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.193445    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 11:25:25.193596 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.193581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-k9nkr\""
Jul 22 11:25:25.193651 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.193345    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 22 11:25:25.193880 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.193862    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3h7vsiap2fpg4\""
Jul 22 11:25:25.196101 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.196045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xph6l" event={"ID":"be638fa3-99e4-46a7-9efc-beba657e4850","Type":"ContainerStarted","Data":"f7c135f1b7a064db1021cf2211be6abc10937de52e79efd1e8211a2eafb0fc4c"}
Jul 22 11:25:25.202966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.202943    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c9c6d94b-qxgd8"]
Jul 22 11:25:25.271373 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.271335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-client-ca-bundle\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.271538 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.271402    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3cc6f5d9-0870-44f6-98da-62fc24b2005c-audit-log\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.271538 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.271459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3cc6f5d9-0870-44f6-98da-62fc24b2005c-metrics-server-audit-profiles\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.271645 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.271592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-secret-metrics-server-client-certs\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.271693 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.271650    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-secret-metrics-server-tls\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.271740 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.271692    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th9zf\" (UniqueName: \"kubernetes.io/projected/3cc6f5d9-0870-44f6-98da-62fc24b2005c-kube-api-access-th9zf\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.272478 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.272454    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cc6f5d9-0870-44f6-98da-62fc24b2005c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.373385 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.373347    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-secret-metrics-server-client-certs\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.373385 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.373393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-secret-metrics-server-tls\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.373638 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.373425    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th9zf\" (UniqueName: \"kubernetes.io/projected/3cc6f5d9-0870-44f6-98da-62fc24b2005c-kube-api-access-th9zf\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.373786 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.373753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cc6f5d9-0870-44f6-98da-62fc24b2005c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.373892 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.373817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-client-ca-bundle\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.373892 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.373846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3cc6f5d9-0870-44f6-98da-62fc24b2005c-audit-log\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.373892 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.373885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3cc6f5d9-0870-44f6-98da-62fc24b2005c-metrics-server-audit-profiles\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.374483 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.374452    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3cc6f5d9-0870-44f6-98da-62fc24b2005c-audit-log\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.374612 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.374504    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cc6f5d9-0870-44f6-98da-62fc24b2005c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.375202 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.375175    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3cc6f5d9-0870-44f6-98da-62fc24b2005c-metrics-server-audit-profiles\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.376519 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.376493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-secret-metrics-server-tls\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.376643 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.376574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-secret-metrics-server-client-certs\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.376643 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.376614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3cc6f5d9-0870-44f6-98da-62fc24b2005c-client-ca-bundle\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.383450 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.383424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th9zf\" (UniqueName: \"kubernetes.io/projected/3cc6f5d9-0870-44f6-98da-62fc24b2005c-kube-api-access-th9zf\") pod \"metrics-server-c9c6d94b-qxgd8\" (UID: \"3cc6f5d9-0870-44f6-98da-62fc24b2005c\") " pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:25.502266 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:25.502176    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:26.135674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.135640    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8wvnx"
Jul 22 11:25:26.900025 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.899977    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:25:26.904163 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.904140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.907401 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.907371    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 11:25:26.907524 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.907371    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c5hvm\""
Jul 22 11:25:26.907592 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.907554    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 11:25:26.907647 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.907633    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 11:25:26.907890 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.907872    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b1kude7nljpfa\""
Jul 22 11:25:26.908032 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.907965    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 11:25:26.908152 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.908047    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 11:25:26.908152 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.908094    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 11:25:26.908672 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.908654    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 11:25:26.909062 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.909044    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 11:25:26.909157 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.909118    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 11:25:26.909157 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.909148    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 11:25:26.909241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.909178    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 11:25:26.909241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.909220    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 11:25:26.909320 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.909254    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 11:25:26.915561 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.915543    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 11:25:26.932455 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.932425    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:25:26.989992 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.989958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990225 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990225 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990043    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhg86\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-kube-api-access-fhg86\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990225 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990094    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990225 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990162    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990225 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990210    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990492 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990492 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990321    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990492 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990492 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990492 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990492 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990483    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990730 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990730 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990730 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990586    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990730 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990730 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990670    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990730 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990711    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990980 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990751    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:26.990980 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:26.990777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091432 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091389    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091473    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091508    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091750    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091778    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhg86\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-kube-api-access-fhg86\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091848    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.091904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.092303 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.092303 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091926    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.092303 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.092303 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.091984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.092303 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.092051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.092303 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.092080    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.094341 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.092665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.094341 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.093458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.094341 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.093508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.094341 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.093750    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.094341 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.093925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.094682 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.094521    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.095092 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.095048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.096386 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.095742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.096771 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.096573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.096892 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.096870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.097677 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.097364    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.097677 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.097439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.097677 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.097493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.097677 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.097618    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.098567 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.098542    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.098659 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.098628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.098834 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.098810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.099088 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.099067    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.108664 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.108610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhg86\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-kube-api-access-fhg86\") pod \"prometheus-k8s-0\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:27.216036 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:27.215932    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:29.070018 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:29.069965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:25:29.535758 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:29.535677    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dc95bfbff-dbnml"]
Jul 22 11:25:32.229437 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:32.229322    2580 generic.go:356] "Generic (PLEG): container finished" podID="be638fa3-99e4-46a7-9efc-beba657e4850" containerID="f7c135f1b7a064db1021cf2211be6abc10937de52e79efd1e8211a2eafb0fc4c" exitCode=0
Jul 22 11:25:32.229437 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:32.229403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xph6l" event={"ID":"be638fa3-99e4-46a7-9efc-beba657e4850","Type":"ContainerDied","Data":"f7c135f1b7a064db1021cf2211be6abc10937de52e79efd1e8211a2eafb0fc4c"}
Jul 22 11:25:33.103578 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.103544    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c9c6d94b-qxgd8"]
Jul 22 11:25:33.135908 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.135844    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:25:33.240925 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.240793    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hlxqk" event={"ID":"73dc3655-0cca-49d1-98d3-fa797388b04c","Type":"ContainerStarted","Data":"5d9e63a9722dc71c2ed29522b191d186f85ce46cd015d0018bf007ae4fd0bfcc"}
Jul 22 11:25:33.243966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.243399    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-hlxqk"
Jul 22 11:25:33.243966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.243510    2580 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-hlxqk container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused" start-of-body=
Jul 22 11:25:33.243966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.243554    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-hlxqk" podUID="73dc3655-0cca-49d1-98d3-fa797388b04c" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.15:8080/\": dial tcp 10.132.0.15:8080: connect: connection refused"
Jul 22 11:25:33.245986 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.245913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xph6l" event={"ID":"be638fa3-99e4-46a7-9efc-beba657e4850","Type":"ContainerStarted","Data":"4d6a0165aa89817093f4ae67a9605e84d9ab04569428acdfda8ed2f4dedee8c6"}
Jul 22 11:25:33.247860 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.247837    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v" event={"ID":"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2","Type":"ContainerStarted","Data":"7f527e33b2720e32d0d6faef2e2bdaf9098bd4dee449206c389048b35c669520"}
Jul 22 11:25:33.281978 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:33.281913    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-hlxqk" podStartSLOduration=5.126165263 podStartE2EDuration="26.281896649s" totalImagesPullingTime="21.155731386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:33.281765541 +0000 UTC m=+125.944412799" watchObservedRunningTime="2026-07-22 11:25:33.281896649 +0000 UTC m=+125.944543907"
Jul 22 11:25:33.516309 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:33.514573    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cc6f5d9_0870_44f6_98da_62fc24b2005c.slice/crio-7efbe8d0f83c7dae8d1bfa07a2f36ad1f4928ac9b7c9c4377877d5f164822cae WatchSource:0}: Error finding container 7efbe8d0f83c7dae8d1bfa07a2f36ad1f4928ac9b7c9c4377877d5f164822cae: Status 404 returned error can't find the container with id 7efbe8d0f83c7dae8d1bfa07a2f36ad1f4928ac9b7c9c4377877d5f164822cae
Jul 22 11:25:33.516309 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:33.515719    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a48a14_b028_45d9_aad3_3444cd4cd8f8.slice/crio-79a62bf621dcca22a625c3be62c6051b4da9601711a8bb73eaa0eff9a9454981 WatchSource:0}: Error finding container 79a62bf621dcca22a625c3be62c6051b4da9601711a8bb73eaa0eff9a9454981: Status 404 returned error can't find the container with id 79a62bf621dcca22a625c3be62c6051b4da9601711a8bb73eaa0eff9a9454981
Jul 22 11:25:34.262371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.261175    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerID="6e1670d19c17ee66c709cdb8c71c30e46dfd3d7fcdf3e3ef6af562ec5f004421" exitCode=0
Jul 22 11:25:34.262371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.261343    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerDied","Data":"6e1670d19c17ee66c709cdb8c71c30e46dfd3d7fcdf3e3ef6af562ec5f004421"}
Jul 22 11:25:34.262371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.261446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerStarted","Data":"79a62bf621dcca22a625c3be62c6051b4da9601711a8bb73eaa0eff9a9454981"}
Jul 22 11:25:34.270368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.270336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerStarted","Data":"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14"}
Jul 22 11:25:34.270512 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.270418    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerStarted","Data":"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404"}
Jul 22 11:25:34.270512 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.270458    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerStarted","Data":"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184"}
Jul 22 11:25:34.270512 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.270500    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerStarted","Data":"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f"}
Jul 22 11:25:34.274396 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.273953    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xph6l" event={"ID":"be638fa3-99e4-46a7-9efc-beba657e4850","Type":"ContainerStarted","Data":"f169ed880609709b4fe820aeb3569e67f3ddfeb0489405f69b0b1d8e29b4eb17"}
Jul 22 11:25:34.276705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.276670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8" event={"ID":"3cc6f5d9-0870-44f6-98da-62fc24b2005c","Type":"ContainerStarted","Data":"7efbe8d0f83c7dae8d1bfa07a2f36ad1f4928ac9b7c9c4377877d5f164822cae"}
Jul 22 11:25:34.282328 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.280799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v" event={"ID":"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2","Type":"ContainerStarted","Data":"cc5d8c34dd669f61425202047cffa0f2786e2e4f8277b646b9179ecf117fc5e5"}
Jul 22 11:25:34.282328 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.280881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v" event={"ID":"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2","Type":"ContainerStarted","Data":"0dd95a7789a4a355d930814cc6c0ae266388f30e0ff48fef4045d00c2b40a80d"}
Jul 22 11:25:34.295717 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.295695    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-hlxqk"
Jul 22 11:25:34.323770 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:34.322791    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xph6l" podStartSLOduration=11.836085665 podStartE2EDuration="14.322769664s" totalImagesPullingTime="2.398342516s" totalInitContainerRuntime="88.341483ms" isStatefulPod=true podCreationTimestamp="2026-07-22 11:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:34.320798086 +0000 UTC m=+126.983445344" watchObservedRunningTime="2026-07-22 11:25:34.322769664 +0000 UTC m=+126.985416923"
Jul 22 11:25:35.294696 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:35.294646    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerStarted","Data":"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f"}
Jul 22 11:25:37.307173 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.307092    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8" event={"ID":"3cc6f5d9-0870-44f6-98da-62fc24b2005c","Type":"ContainerStarted","Data":"b26dcd5d0b2b1517b5f7bdddefa1fb9a332ab90706f58c0cab33d6ba7f26ca44"}
Jul 22 11:25:37.312099 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.312037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v" event={"ID":"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2","Type":"ContainerStarted","Data":"e04a050b23d9b5400d960d718422fd569d936e1ba216135944c3aa431b2170d9"}
Jul 22 11:25:37.312332 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.312230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v" event={"ID":"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2","Type":"ContainerStarted","Data":"c740936720550abaaaa378f456ae2d565ac3fb13e89bbb69966732309a433214"}
Jul 22 11:25:37.312406 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.312388    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:37.312466 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.312444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v" event={"ID":"5c479ef6-8bcb-45fe-9a0d-9594e90c73c2","Type":"ContainerStarted","Data":"4f118453c8bdf5e49a2a28b139f2e1aebf08995fdffbb3853b77d9385a04801e"}
Jul 22 11:25:37.317687 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.317649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerStarted","Data":"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e"}
Jul 22 11:25:37.339165 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.339099    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8" podStartSLOduration=9.500938387 podStartE2EDuration="12.339078712s" totalImagesPullingTime="2.838140325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:37.337776708 +0000 UTC m=+130.000423965" watchObservedRunningTime="2026-07-22 11:25:37.339078712 +0000 UTC m=+130.001725973"
Jul 22 11:25:37.371654 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.371584    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.531231547 podStartE2EDuration="16.371562842s" totalImagesPullingTime="12.824005234s" totalInitContainerRuntime="16.326061ms" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:37.369291598 +0000 UTC m=+130.031938858" watchObservedRunningTime="2026-07-22 11:25:37.371562842 +0000 UTC m=+130.034210101"
Jul 22 11:25:37.600700 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.600520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:25:37.604182 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.604135    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82c42f71-e5b9-4246-842e-fba169484ef9-metrics-certs\") pod \"network-metrics-daemon-l7hd2\" (UID: \"82c42f71-e5b9-4246-842e-fba169484ef9\") " pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:25:37.875765 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.875684    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cs9j5\""
Jul 22 11:25:37.883390 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:37.883357    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l7hd2"
Jul 22 11:25:38.332410 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:38.332382    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v"
Jul 22 11:25:38.367345 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:38.367280    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-89fd88777-zgt7v" podStartSLOduration=3.923820323 podStartE2EDuration="16.367254639s" totalImagesPullingTime="12.443434316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:37.410352126 +0000 UTC m=+130.072999404" watchObservedRunningTime="2026-07-22 11:25:38.367254639 +0000 UTC m=+131.029901899"
Jul 22 11:25:38.710910 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:38.710874    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l7hd2"]
Jul 22 11:25:38.713911 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:25:38.713881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c42f71_e5b9_4246_842e_fba169484ef9.slice/crio-87c370534d76dc8ac0bf80ee8099af323177707d0580f62f52aa401e9156a1a1 WatchSource:0}: Error finding container 87c370534d76dc8ac0bf80ee8099af323177707d0580f62f52aa401e9156a1a1: Status 404 returned error can't find the container with id 87c370534d76dc8ac0bf80ee8099af323177707d0580f62f52aa401e9156a1a1
Jul 22 11:25:39.343996 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:39.342900    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7hd2" event={"ID":"82c42f71-e5b9-4246-842e-fba169484ef9","Type":"ContainerStarted","Data":"87c370534d76dc8ac0bf80ee8099af323177707d0580f62f52aa401e9156a1a1"}
Jul 22 11:25:39.353492 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:39.353452    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerStarted","Data":"f2e6dd30f86e364cfbf67c20f6712827ac5a4668b2786e4c48edb244c9ddd653"}
Jul 22 11:25:39.353645 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:39.353529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerStarted","Data":"8953d2ae852e68de63b4544fc1d2f4e9f827ed3d13c1bb4b67aadea59777913c"}
Jul 22 11:25:40.368526 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:40.368485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerStarted","Data":"c6401c877098946d30e68ad4dd5a6379f9032c1724aa66636b3b3a5a0b274b1c"}
Jul 22 11:25:40.369047 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:40.368613    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerStarted","Data":"cd6ea36e2ad1b7cb480ace5be954b9ed42f4e2da678ec92664243fc871b98fe0"}
Jul 22 11:25:40.369047 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:40.368652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerStarted","Data":"0c4938988c9bef6de55c6a0712beb377cd8efb494c282fd21aaeb0f1c535cea2"}
Jul 22 11:25:40.369047 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:40.368690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerStarted","Data":"6695119d40c436270c08ecc0b0df9dcee17a880b93b54b1a21415eb81ba21818"}
Jul 22 11:25:40.408602 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:40.408512    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=9.659612809 podStartE2EDuration="14.408490537s" totalImagesPullingTime="4.713969516s" totalInitContainerRuntime="34.908212ms" isStatefulPod=false podCreationTimestamp="2026-07-22 11:25:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:40.406628278 +0000 UTC m=+133.069275561" watchObservedRunningTime="2026-07-22 11:25:40.408490537 +0000 UTC m=+133.071137800"
Jul 22 11:25:41.375756 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:41.375707    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7hd2" event={"ID":"82c42f71-e5b9-4246-842e-fba169484ef9","Type":"ContainerStarted","Data":"4f74b0ff75a5033453f055ff0e40a5c5e8de7e4d3e4f516d6f85b679e7d85f7a"}
Jul 22 11:25:41.376362 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:41.375781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l7hd2" event={"ID":"82c42f71-e5b9-4246-842e-fba169484ef9","Type":"ContainerStarted","Data":"bbac077e9c0178f841369b081a0bf8cd3171b32972ff4f464372dc499531da6e"}
Jul 22 11:25:41.396247 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:41.396192    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l7hd2" podStartSLOduration=131.760807436 podStartE2EDuration="2m13.396170942s" totalImagesPullingTime="1.635363506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:25:41.39461131 +0000 UTC m=+134.057258568" watchObservedRunningTime="2026-07-22 11:25:41.396170942 +0000 UTC m=+134.058818201"
Jul 22 11:25:42.216175 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:42.216139    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:25:45.502540 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:45.502492    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:45.502921 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:45.502602    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:25:54.559898 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.559832    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml" podUID="0cab89c1-14b4-4e8a-b958-1a62176c9adf" containerName="registry" containerID="cri-o://94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25" gracePeriod=30
Jul 22 11:25:54.848369 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.848343    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:25:54.958475 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.958437    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f8mq\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-kube-api-access-4f8mq\") pod \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") "
Jul 22 11:25:54.958475 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.958482    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-trusted-ca\") pod \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") "
Jul 22 11:25:54.958716 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.958536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-installation-pull-secrets\") pod \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") "
Jul 22 11:25:54.958716 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.958589    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-certificates\") pod \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") "
Jul 22 11:25:54.958716 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.958633    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-image-registry-private-configuration\") pod \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") "
Jul 22 11:25:54.958716 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.958672    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") pod \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") "
Jul 22 11:25:54.958862 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.958724    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-bound-sa-token\") pod \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") "
Jul 22 11:25:54.959479 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.959123    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cab89c1-14b4-4e8a-b958-1a62176c9adf-ca-trust-extracted\") pod \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\" (UID: \"0cab89c1-14b4-4e8a-b958-1a62176c9adf\") "
Jul 22 11:25:54.959479 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.959269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0cab89c1-14b4-4e8a-b958-1a62176c9adf" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:25:54.959676 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.959529    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0cab89c1-14b4-4e8a-b958-1a62176c9adf" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:25:54.962288 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.961071    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-trusted-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:25:54.962288 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.961103    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-certificates\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:25:54.962288 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.961963    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0cab89c1-14b4-4e8a-b958-1a62176c9adf" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:25:54.963527 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.962676    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0cab89c1-14b4-4e8a-b958-1a62176c9adf" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:25:54.966293 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.966211    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-kube-api-access-4f8mq" (OuterVolumeSpecName: "kube-api-access-4f8mq") pod "0cab89c1-14b4-4e8a-b958-1a62176c9adf" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf"). InnerVolumeSpecName "kube-api-access-4f8mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:25:54.966410 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.966363    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0cab89c1-14b4-4e8a-b958-1a62176c9adf" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:25:54.966565 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.966495    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0cab89c1-14b4-4e8a-b958-1a62176c9adf" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:25:54.977735 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:54.977706    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cab89c1-14b4-4e8a-b958-1a62176c9adf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0cab89c1-14b4-4e8a-b958-1a62176c9adf" (UID: "0cab89c1-14b4-4e8a-b958-1a62176c9adf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:25:55.061684 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.061644    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0cab89c1-14b4-4e8a-b958-1a62176c9adf-ca-trust-extracted\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:25:55.061684 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.061675    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f8mq\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-kube-api-access-4f8mq\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:25:55.061684 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.061685    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-installation-pull-secrets\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:25:55.061901 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.061695    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0cab89c1-14b4-4e8a-b958-1a62176c9adf-image-registry-private-configuration\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:25:55.061901 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.061707    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-registry-tls\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:25:55.061901 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.061715    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0cab89c1-14b4-4e8a-b958-1a62176c9adf-bound-sa-token\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:25:55.434624 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.434591    2580 generic.go:356] "Generic (PLEG): container finished" podID="0cab89c1-14b4-4e8a-b958-1a62176c9adf" containerID="94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25" exitCode=0
Jul 22 11:25:55.434801 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.434656    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml"
Jul 22 11:25:55.434801 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.434677    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml" event={"ID":"0cab89c1-14b4-4e8a-b958-1a62176c9adf","Type":"ContainerDied","Data":"94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25"}
Jul 22 11:25:55.434801 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.434746    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc95bfbff-dbnml" event={"ID":"0cab89c1-14b4-4e8a-b958-1a62176c9adf","Type":"ContainerDied","Data":"bf08f9bff64d03cf95266d9ae54354946ccf5d87667e2c5fed48f0591ec8e85b"}
Jul 22 11:25:55.434801 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.434766    2580 scope.go:117] "RemoveContainer" containerID="94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25"
Jul 22 11:25:55.443372 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.443350    2580 scope.go:117] "RemoveContainer" containerID="94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25"
Jul 22 11:25:55.443621 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:25:55.443604    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25\": container with ID starting with 94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25 not found: ID does not exist" containerID="94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25"
Jul 22 11:25:55.443701 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.443628    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25"} err="failed to get container status \"94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25\": rpc error: code = NotFound desc = could not find container \"94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25\": container with ID starting with 94b352b3632f523e1303d3c21f0b3ba53a0ede6e203f19ae1f9319cb50ac8a25 not found: ID does not exist"
Jul 22 11:25:55.459211 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.459191    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dc95bfbff-dbnml"]
Jul 22 11:25:55.464518 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.464495    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dc95bfbff-dbnml"]
Jul 22 11:25:55.736277 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:25:55.736199    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cab89c1-14b4-4e8a-b958-1a62176c9adf" path="/var/lib/kubelet/pods/0cab89c1-14b4-4e8a-b958-1a62176c9adf/volumes"
Jul 22 11:26:05.507828 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:05.507796    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:26:05.511524 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:05.511502    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c9c6d94b-qxgd8"
Jul 22 11:26:27.217031 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:27.216917    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:27.236454 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:27.236427    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:27.586636 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:27.586607    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:41.001795 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.001699    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:26:41.002346 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.002125    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="alertmanager" containerID="cri-o://1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f" gracePeriod=120
Jul 22 11:26:41.002346 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.002178    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy-metric" containerID="cri-o://38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f" gracePeriod=120
Jul 22 11:26:41.002346 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.002213    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="prom-label-proxy" containerID="cri-o://75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e" gracePeriod=120
Jul 22 11:26:41.002346 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.002239    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy" containerID="cri-o://6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14" gracePeriod=120
Jul 22 11:26:41.002346 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.002232    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="config-reloader" containerID="cri-o://9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184" gracePeriod=120
Jul 22 11:26:41.002346 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.002194    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy-web" containerID="cri-o://131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404" gracePeriod=120
Jul 22 11:26:41.627036 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.626986    2580 generic.go:356] "Generic (PLEG): container finished" podID="48b68083-d377-41a2-b459-1257b3b8f57d" containerID="75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e" exitCode=0
Jul 22 11:26:41.627036 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.627027    2580 generic.go:356] "Generic (PLEG): container finished" podID="48b68083-d377-41a2-b459-1257b3b8f57d" containerID="6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14" exitCode=0
Jul 22 11:26:41.627036 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.627035    2580 generic.go:356] "Generic (PLEG): container finished" podID="48b68083-d377-41a2-b459-1257b3b8f57d" containerID="9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184" exitCode=0
Jul 22 11:26:41.627036 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.627040    2580 generic.go:356] "Generic (PLEG): container finished" podID="48b68083-d377-41a2-b459-1257b3b8f57d" containerID="1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f" exitCode=0
Jul 22 11:26:41.627036 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.627033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerDied","Data":"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e"}
Jul 22 11:26:41.627322 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.627098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerDied","Data":"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14"}
Jul 22 11:26:41.627322 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.627123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerDied","Data":"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184"}
Jul 22 11:26:41.627322 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:41.627149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerDied","Data":"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f"}
Jul 22 11:26:42.248683 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.248660    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.337272 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337241    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-tls-assets\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337454 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337285    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337454 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337305    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-config-out\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337454 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337332    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfmmx\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-kube-api-access-sfmmx\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337454 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337388    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-web-config\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337454 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-trusted-ca-bundle\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337723 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337471    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-cluster-tls-config\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337723 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337504    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-config-volume\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337723 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337530    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-main-tls\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337723 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337567    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-web\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337723 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337618    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-main-db\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337723 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337665    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-metrics-client-ca\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.337723 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337694    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"48b68083-d377-41a2-b459-1257b3b8f57d\" (UID: \"48b68083-d377-41a2-b459-1257b3b8f57d\") "
Jul 22 11:26:42.338243 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.337896    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:42.338243 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.338064    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.338587 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.338551    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:26:42.338815 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.338791    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:42.341283 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.341186    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:26:42.341283 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.341219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-config-out" (OuterVolumeSpecName: "config-out") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:26:42.341464 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.341322    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:42.341529 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.341506    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:42.341636 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.341602    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:42.341698 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.341630    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-kube-api-access-sfmmx" (OuterVolumeSpecName: "kube-api-access-sfmmx") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "kube-api-access-sfmmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:26:42.341978 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.341950    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:42.342687 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.342664    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-config-volume" (OuterVolumeSpecName: "config-volume") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:42.346086 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.345906    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:42.353801 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.353774    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-web-config" (OuterVolumeSpecName: "web-config") pod "48b68083-d377-41a2-b459-1257b3b8f57d" (UID: "48b68083-d377-41a2-b459-1257b3b8f57d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:42.438966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.438916    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-web-config\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.438966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.438961    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-cluster-tls-config\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.438966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.438971    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-config-volume\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.438966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.438981    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-main-tls\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.439258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.438991    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.439258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.439000    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-alertmanager-main-db\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.439258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.439036    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48b68083-d377-41a2-b459-1257b3b8f57d-metrics-client-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.439258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.439048    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.439258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.439064    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-tls-assets\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.439258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.439076    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48b68083-d377-41a2-b459-1257b3b8f57d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.439258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.439087    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48b68083-d377-41a2-b459-1257b3b8f57d-config-out\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.439258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.439097    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfmmx\" (UniqueName: \"kubernetes.io/projected/48b68083-d377-41a2-b459-1257b3b8f57d-kube-api-access-sfmmx\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:42.634570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.634492    2580 generic.go:356] "Generic (PLEG): container finished" podID="48b68083-d377-41a2-b459-1257b3b8f57d" containerID="38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f" exitCode=0
Jul 22 11:26:42.634570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.634516    2580 generic.go:356] "Generic (PLEG): container finished" podID="48b68083-d377-41a2-b459-1257b3b8f57d" containerID="131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404" exitCode=0
Jul 22 11:26:42.634741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.634575    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerDied","Data":"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f"}
Jul 22 11:26:42.634741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.634586    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.634741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.634671    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerDied","Data":"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404"}
Jul 22 11:26:42.634741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.634701    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48b68083-d377-41a2-b459-1257b3b8f57d","Type":"ContainerDied","Data":"91adc2ed9ca7c115ed209029f60c6d6b50a210acca90caa5761f50e26bf3e65d"}
Jul 22 11:26:42.634741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.634736    2580 scope.go:117] "RemoveContainer" containerID="75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e"
Jul 22 11:26:42.643074 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.643059    2580 scope.go:117] "RemoveContainer" containerID="38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f"
Jul 22 11:26:42.650592 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.650574    2580 scope.go:117] "RemoveContainer" containerID="6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14"
Jul 22 11:26:42.657779 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.657761    2580 scope.go:117] "RemoveContainer" containerID="131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404"
Jul 22 11:26:42.661867 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.661844    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:26:42.666729 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.666708    2580 scope.go:117] "RemoveContainer" containerID="9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184"
Jul 22 11:26:42.666918 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.666900    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:26:42.674465 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.674447    2580 scope.go:117] "RemoveContainer" containerID="1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f"
Jul 22 11:26:42.681932 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.681912    2580 scope.go:117] "RemoveContainer" containerID="e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04"
Jul 22 11:26:42.689743 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.689721    2580 scope.go:117] "RemoveContainer" containerID="75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e"
Jul 22 11:26:42.690072 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:26:42.690052    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e\": container with ID starting with 75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e not found: ID does not exist" containerID="75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e"
Jul 22 11:26:42.690267 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.690084    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e"} err="failed to get container status \"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e\": rpc error: code = NotFound desc = could not find container \"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e\": container with ID starting with 75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e not found: ID does not exist"
Jul 22 11:26:42.690267 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.690111    2580 scope.go:117] "RemoveContainer" containerID="38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f"
Jul 22 11:26:42.690403 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:26:42.690384    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f\": container with ID starting with 38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f not found: ID does not exist" containerID="38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f"
Jul 22 11:26:42.690456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.690416    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f"} err="failed to get container status \"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f\": rpc error: code = NotFound desc = could not find container \"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f\": container with ID starting with 38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f not found: ID does not exist"
Jul 22 11:26:42.690456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.690442    2580 scope.go:117] "RemoveContainer" containerID="6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14"
Jul 22 11:26:42.690732 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:26:42.690712    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14\": container with ID starting with 6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14 not found: ID does not exist" containerID="6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14"
Jul 22 11:26:42.690823 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.690735    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14"} err="failed to get container status \"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14\": rpc error: code = NotFound desc = could not find container \"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14\": container with ID starting with 6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14 not found: ID does not exist"
Jul 22 11:26:42.690823 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.690751    2580 scope.go:117] "RemoveContainer" containerID="131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404"
Jul 22 11:26:42.690992 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:26:42.690977    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404\": container with ID starting with 131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404 not found: ID does not exist" containerID="131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404"
Jul 22 11:26:42.691060 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.690996    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404"} err="failed to get container status \"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404\": rpc error: code = NotFound desc = could not find container \"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404\": container with ID starting with 131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404 not found: ID does not exist"
Jul 22 11:26:42.691060 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691032    2580 scope.go:117] "RemoveContainer" containerID="9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184"
Jul 22 11:26:42.691288 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:26:42.691268    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184\": container with ID starting with 9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184 not found: ID does not exist" containerID="9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184"
Jul 22 11:26:42.691337 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691294    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184"} err="failed to get container status \"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184\": rpc error: code = NotFound desc = could not find container \"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184\": container with ID starting with 9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184 not found: ID does not exist"
Jul 22 11:26:42.691337 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691311    2580 scope.go:117] "RemoveContainer" containerID="1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f"
Jul 22 11:26:42.691529 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:26:42.691507    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f\": container with ID starting with 1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f not found: ID does not exist" containerID="1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f"
Jul 22 11:26:42.691614 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691534    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f"} err="failed to get container status \"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f\": rpc error: code = NotFound desc = could not find container \"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f\": container with ID starting with 1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f not found: ID does not exist"
Jul 22 11:26:42.691614 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691548    2580 scope.go:117] "RemoveContainer" containerID="e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04"
Jul 22 11:26:42.691755 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:26:42.691740    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04\": container with ID starting with e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04 not found: ID does not exist" containerID="e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04"
Jul 22 11:26:42.691798 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691759    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04"} err="failed to get container status \"e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04\": rpc error: code = NotFound desc = could not find container \"e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04\": container with ID starting with e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04 not found: ID does not exist"
Jul 22 11:26:42.691798 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691771    2580 scope.go:117] "RemoveContainer" containerID="75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e"
Jul 22 11:26:42.691962 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691942    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e"} err="failed to get container status \"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e\": rpc error: code = NotFound desc = could not find container \"75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e\": container with ID starting with 75960e69376a74c18d2a79b7f33cc3c3bc06c675e69d3e762fee3d8456457f2e not found: ID does not exist"
Jul 22 11:26:42.692052 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.691964    2580 scope.go:117] "RemoveContainer" containerID="38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f"
Jul 22 11:26:42.692181 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.692165    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f"} err="failed to get container status \"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f\": rpc error: code = NotFound desc = could not find container \"38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f\": container with ID starting with 38f6aa81314e3ae0d7deb5fa28c07329d9dd29026eb7057ff9905e824fe7073f not found: ID does not exist"
Jul 22 11:26:42.692242 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.692182    2580 scope.go:117] "RemoveContainer" containerID="6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14"
Jul 22 11:26:42.692443 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.692424    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14"} err="failed to get container status \"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14\": rpc error: code = NotFound desc = could not find container \"6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14\": container with ID starting with 6be6620777cdcb718cc2d263bf70faa7f26ae1af697bdda511a001a66ca6db14 not found: ID does not exist"
Jul 22 11:26:42.692489 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.692444    2580 scope.go:117] "RemoveContainer" containerID="131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404"
Jul 22 11:26:42.692673 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.692653    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404"} err="failed to get container status \"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404\": rpc error: code = NotFound desc = could not find container \"131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404\": container with ID starting with 131df75eb9eb2dde7ee84c55132c984748869f35cc5ffd06d15682ecd75ae404 not found: ID does not exist"
Jul 22 11:26:42.692721 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.692676    2580 scope.go:117] "RemoveContainer" containerID="9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184"
Jul 22 11:26:42.692920 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.692898    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184"} err="failed to get container status \"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184\": rpc error: code = NotFound desc = could not find container \"9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184\": container with ID starting with 9cf8a44e59116cd632455cd78459d07f3d52b1600ea24ef44e6044c3d6b4a184 not found: ID does not exist"
Jul 22 11:26:42.692920 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.692920    2580 scope.go:117] "RemoveContainer" containerID="1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f"
Jul 22 11:26:42.693167 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.693148    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f"} err="failed to get container status \"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f\": rpc error: code = NotFound desc = could not find container \"1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f\": container with ID starting with 1ae7aeea8dfdc5d6e77611f28246eb4f2c5deac7eae27ed6935fbcd43609ac1f not found: ID does not exist"
Jul 22 11:26:42.693223 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.693167    2580 scope.go:117] "RemoveContainer" containerID="e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04"
Jul 22 11:26:42.693400 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.693383    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04"} err="failed to get container status \"e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04\": rpc error: code = NotFound desc = could not find container \"e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04\": container with ID starting with e4aa54563fd0a0458f682c65d9065397f38087e39346395708355342bfb93a04 not found: ID does not exist"
Jul 22 11:26:42.699130 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699108    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:26:42.699413 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699401    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cab89c1-14b4-4e8a-b958-1a62176c9adf" containerName="registry"
Jul 22 11:26:42.699456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699414    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cab89c1-14b4-4e8a-b958-1a62176c9adf" containerName="registry"
Jul 22 11:26:42.699456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699426    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="alertmanager"
Jul 22 11:26:42.699456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699432    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="alertmanager"
Jul 22 11:26:42.699456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699439    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="prom-label-proxy"
Jul 22 11:26:42.699456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699444    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="prom-label-proxy"
Jul 22 11:26:42.699456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699452    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="config-reloader"
Jul 22 11:26:42.699456 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699457    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="config-reloader"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699467    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699472    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699483    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy-web"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699488    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy-web"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699495    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="init-config-reloader"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699500    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="init-config-reloader"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699507    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy-metric"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699512    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy-metric"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699559    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="alertmanager"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699567    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy-metric"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699573    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cab89c1-14b4-4e8a-b958-1a62176c9adf" containerName="registry"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699579    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="config-reloader"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699584    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="prom-label-proxy"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699592    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy-web"
Jul 22 11:26:42.699674 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.699598    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" containerName="kube-rbac-proxy"
Jul 22 11:26:42.703023 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.702990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.706082 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.706039    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zllpw\""
Jul 22 11:26:42.706210 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.706179    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 22 11:26:42.706357 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.706338    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 22 11:26:42.706436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.706363    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 22 11:26:42.706478 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.706463    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 22 11:26:42.706863 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.706838    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 22 11:26:42.706958 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.706866    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 22 11:26:42.707213 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.707196    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 22 11:26:42.707213 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.707207    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 22 11:26:42.712399 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.712380    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 22 11:26:42.723400 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.723375    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:26:42.741782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.741747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.741982 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.741791    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62e89161-a4b3-4bae-b2c4-af6143cadbd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.741982 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.741812    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.741982 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.741881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62e89161-a4b3-4bae-b2c4-af6143cadbd8-config-out\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.741982 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.741913    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62e89161-a4b3-4bae-b2c4-af6143cadbd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.741982 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.741936    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.741982 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.741958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-web-config\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.742228 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.741986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e89161-a4b3-4bae-b2c4-af6143cadbd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.742228 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.742061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.742228 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.742086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.742228 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.742103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njpcx\" (UniqueName: \"kubernetes.io/projected/62e89161-a4b3-4bae-b2c4-af6143cadbd8-kube-api-access-njpcx\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.742228 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.742144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62e89161-a4b3-4bae-b2c4-af6143cadbd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.742228 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.742168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843351 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62e89161-a4b3-4bae-b2c4-af6143cadbd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843351 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843353    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843621 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843386    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-web-config\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843621 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843448    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e89161-a4b3-4bae-b2c4-af6143cadbd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843621 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843621 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843621 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njpcx\" (UniqueName: \"kubernetes.io/projected/62e89161-a4b3-4bae-b2c4-af6143cadbd8-kube-api-access-njpcx\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843621 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62e89161-a4b3-4bae-b2c4-af6143cadbd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843640    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843736    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62e89161-a4b3-4bae-b2c4-af6143cadbd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843761    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.843916 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.843817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62e89161-a4b3-4bae-b2c4-af6143cadbd8-config-out\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.844358 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.844335    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62e89161-a4b3-4bae-b2c4-af6143cadbd8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.844683 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.844360    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62e89161-a4b3-4bae-b2c4-af6143cadbd8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.844683 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.844588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/62e89161-a4b3-4bae-b2c4-af6143cadbd8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.846917 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.846890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-config-volume\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.847040 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.846958    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.847111 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.847041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-web-config\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.847297 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.847274    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/62e89161-a4b3-4bae-b2c4-af6143cadbd8-config-out\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.847297 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.847291    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/62e89161-a4b3-4bae-b2c4-af6143cadbd8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.847580 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.847565    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.847619 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.847585    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.847955 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.847940    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.848524 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.848507    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/62e89161-a4b3-4bae-b2c4-af6143cadbd8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:42.854699 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:42.854679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njpcx\" (UniqueName: \"kubernetes.io/projected/62e89161-a4b3-4bae-b2c4-af6143cadbd8-kube-api-access-njpcx\") pod \"alertmanager-main-0\" (UID: \"62e89161-a4b3-4bae-b2c4-af6143cadbd8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:43.013269 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:43.013173    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 22 11:26:43.154535 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:43.154324    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 22 11:26:43.156924 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:26:43.156895    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e89161_a4b3_4bae_b2c4_af6143cadbd8.slice/crio-6c6957a760664737186379dc9a9289952ee214c05b8772957736f5d57a66f014 WatchSource:0}: Error finding container 6c6957a760664737186379dc9a9289952ee214c05b8772957736f5d57a66f014: Status 404 returned error can't find the container with id 6c6957a760664737186379dc9a9289952ee214c05b8772957736f5d57a66f014
Jul 22 11:26:43.640230 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:43.640195    2580 generic.go:356] "Generic (PLEG): container finished" podID="62e89161-a4b3-4bae-b2c4-af6143cadbd8" containerID="22cc3e6029baa2b7d15cd29eb514c9e1e019f60e33c22d7fbbb6ffeec89adabe" exitCode=0
Jul 22 11:26:43.640664 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:43.640284    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62e89161-a4b3-4bae-b2c4-af6143cadbd8","Type":"ContainerDied","Data":"22cc3e6029baa2b7d15cd29eb514c9e1e019f60e33c22d7fbbb6ffeec89adabe"}
Jul 22 11:26:43.640664 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:43.640361    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62e89161-a4b3-4bae-b2c4-af6143cadbd8","Type":"ContainerStarted","Data":"6c6957a760664737186379dc9a9289952ee214c05b8772957736f5d57a66f014"}
Jul 22 11:26:43.736313 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:43.736284    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b68083-d377-41a2-b459-1257b3b8f57d" path="/var/lib/kubelet/pods/48b68083-d377-41a2-b459-1257b3b8f57d/volumes"
Jul 22 11:26:44.650978 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:44.650938    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62e89161-a4b3-4bae-b2c4-af6143cadbd8","Type":"ContainerStarted","Data":"baab9e8d90ff0253bc676aba0cd347abd3eaed399f53355f26c58e79d25a386e"}
Jul 22 11:26:44.651368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:44.651056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62e89161-a4b3-4bae-b2c4-af6143cadbd8","Type":"ContainerStarted","Data":"fb8a6d9429af416533c569a6e61e945d346acbdf1d5ecb1bbf29df7c54a527c6"}
Jul 22 11:26:44.651368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:44.651083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62e89161-a4b3-4bae-b2c4-af6143cadbd8","Type":"ContainerStarted","Data":"58903097699d086351fa6bd9a97ff09a67727c09ce8eace2fe07eb00a6f8ae8e"}
Jul 22 11:26:44.651368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:44.651109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62e89161-a4b3-4bae-b2c4-af6143cadbd8","Type":"ContainerStarted","Data":"d3c797315bc0f96fbdde3b5a13ebb56195c6e099773f702ed95755d16c4b24c2"}
Jul 22 11:26:44.651368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:44.651132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62e89161-a4b3-4bae-b2c4-af6143cadbd8","Type":"ContainerStarted","Data":"60905208399ae37f87fb60de7e13f0daa1a374ef6fc9b5d60c5bfa76eb17160a"}
Jul 22 11:26:44.651368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:44.651155    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"62e89161-a4b3-4bae-b2c4-af6143cadbd8","Type":"ContainerStarted","Data":"18c9f1a6ab60ff8a7172bfeecd9267272250524e8cacf8a4d65081878f76a4fa"}
Jul 22 11:26:44.680873 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:44.680811    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.661832608 podStartE2EDuration="2.680790787s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.958179ms" isStatefulPod=false podCreationTimestamp="2026-07-22 11:26:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:26:44.679039952 +0000 UTC m=+197.341687232" watchObservedRunningTime="2026-07-22 11:26:44.680790787 +0000 UTC m=+197.343438045"
Jul 22 11:26:45.427765 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.427727    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:26:45.428078 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.428018    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="prometheus" containerID="cri-o://8953d2ae852e68de63b4544fc1d2f4e9f827ed3d13c1bb4b67aadea59777913c" gracePeriod=600
Jul 22 11:26:45.428078 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.428041    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy" containerID="cri-o://cd6ea36e2ad1b7cb480ace5be954b9ed42f4e2da678ec92664243fc871b98fe0" gracePeriod=600
Jul 22 11:26:45.428226 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.428108    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="config-reloader" containerID="cri-o://f2e6dd30f86e364cfbf67c20f6712827ac5a4668b2786e4c48edb244c9ddd653" gracePeriod=600
Jul 22 11:26:45.428226 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.428053    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="thanos-sidecar" containerID="cri-o://6695119d40c436270c08ecc0b0df9dcee17a880b93b54b1a21415eb81ba21818" gracePeriod=600
Jul 22 11:26:45.428226 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.428113    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://c6401c877098946d30e68ad4dd5a6379f9032c1724aa66636b3b3a5a0b274b1c" gracePeriod=600
Jul 22 11:26:45.428226 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.428078    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy-web" containerID="cri-o://0c4938988c9bef6de55c6a0712beb377cd8efb494c282fd21aaeb0f1c535cea2" gracePeriod=600
Jul 22 11:26:45.659288 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659250    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerID="c6401c877098946d30e68ad4dd5a6379f9032c1724aa66636b3b3a5a0b274b1c" exitCode=0
Jul 22 11:26:45.659288 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659280    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerID="cd6ea36e2ad1b7cb480ace5be954b9ed42f4e2da678ec92664243fc871b98fe0" exitCode=0
Jul 22 11:26:45.659288 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659288    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerID="0c4938988c9bef6de55c6a0712beb377cd8efb494c282fd21aaeb0f1c535cea2" exitCode=0
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659297    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerID="6695119d40c436270c08ecc0b0df9dcee17a880b93b54b1a21415eb81ba21818" exitCode=0
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659306    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerID="f2e6dd30f86e364cfbf67c20f6712827ac5a4668b2786e4c48edb244c9ddd653" exitCode=0
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659314    2580 generic.go:356] "Generic (PLEG): container finished" podID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerID="8953d2ae852e68de63b4544fc1d2f4e9f827ed3d13c1bb4b67aadea59777913c" exitCode=0
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerDied","Data":"c6401c877098946d30e68ad4dd5a6379f9032c1724aa66636b3b3a5a0b274b1c"}
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659398    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerDied","Data":"cd6ea36e2ad1b7cb480ace5be954b9ed42f4e2da678ec92664243fc871b98fe0"}
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerDied","Data":"0c4938988c9bef6de55c6a0712beb377cd8efb494c282fd21aaeb0f1c535cea2"}
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659476    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerDied","Data":"6695119d40c436270c08ecc0b0df9dcee17a880b93b54b1a21415eb81ba21818"}
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659515    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerDied","Data":"f2e6dd30f86e364cfbf67c20f6712827ac5a4668b2786e4c48edb244c9ddd653"}
Jul 22 11:26:45.659702 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.659550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerDied","Data":"8953d2ae852e68de63b4544fc1d2f4e9f827ed3d13c1bb4b67aadea59777913c"}
Jul 22 11:26:45.688299 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.688270    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:45.770344 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770311    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770510 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770365    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-0\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770510 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770410    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-thanos-prometheus-http-client-file\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770510 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770446    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-kube-rbac-proxy\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770510 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770474    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-metrics-client-ca\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770510 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770505    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-tls-assets\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770759 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770553    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-trusted-ca-bundle\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770759 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770604    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-kubelet-serving-ca-bundle\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770759 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770629    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-web-config\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770759 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770656    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-metrics-client-certs\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770759 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770696    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhg86\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-kube-api-access-fhg86\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770759 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770721    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.770759 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770750    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-grpc-tls\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.771091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770778    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-tls\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.771091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770802    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-db\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.771091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770831    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-2\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.771091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770865    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-1\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.771091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770892    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config-out\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.771091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770922    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-serving-certs-ca-bundle\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.771091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770964    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\" (UID: \"a2a48a14-b028-45d9-aad3-3444cd4cd8f8\") "
Jul 22 11:26:45.771091 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.770984    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:45.771465 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.771157    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:45.771465 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.771411    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.771465 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.771429    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-metrics-client-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.771616 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.771588    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:45.771860 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.771838    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:45.773667 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.773411    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.773971 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.773882    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:45.774072 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.774028    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.774072 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.774054    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:26:45.774198 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.774160    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.774560 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.774532    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-kube-api-access-fhg86" (OuterVolumeSpecName: "kube-api-access-fhg86") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "kube-api-access-fhg86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:26:45.775436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.775198    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:45.775436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.775364    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.775754 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.775614    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:26:45.776116 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.776091    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config" (OuterVolumeSpecName: "config") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.776483 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.776465    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:26:45.776646 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.776625    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.776959 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.776940    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.777220 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.777198    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.777220 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.777210    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config-out" (OuterVolumeSpecName: "config-out") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:26:45.785496 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.785473    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-web-config" (OuterVolumeSpecName: "web-config") pod "a2a48a14-b028-45d9-aad3-3444cd4cd8f8" (UID: "a2a48a14-b028-45d9-aad3-3444cd4cd8f8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:26:45.872308 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872278    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-web-config\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872308 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872304    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-metrics-client-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872308 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872315    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhg86\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-kube-api-access-fhg86\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872326    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872335    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-grpc-tls\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872343    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872353    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-db\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872360    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872369    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872377    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config-out\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872385    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872395    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872403    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-config\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872411    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872420    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872428    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-secret-kube-rbac-proxy\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872436    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-tls-assets\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:45.872537 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:45.872444    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a48a14-b028-45d9-aad3-3444cd4cd8f8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:26:46.667072 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.667038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a48a14-b028-45d9-aad3-3444cd4cd8f8","Type":"ContainerDied","Data":"79a62bf621dcca22a625c3be62c6051b4da9601711a8bb73eaa0eff9a9454981"}
Jul 22 11:26:46.667482 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.667096    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.667482 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.667134    2580 scope.go:117] "RemoveContainer" containerID="c6401c877098946d30e68ad4dd5a6379f9032c1724aa66636b3b3a5a0b274b1c"
Jul 22 11:26:46.677241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.677066    2580 scope.go:117] "RemoveContainer" containerID="cd6ea36e2ad1b7cb480ace5be954b9ed42f4e2da678ec92664243fc871b98fe0"
Jul 22 11:26:46.684517 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.684501    2580 scope.go:117] "RemoveContainer" containerID="0c4938988c9bef6de55c6a0712beb377cd8efb494c282fd21aaeb0f1c535cea2"
Jul 22 11:26:46.691360 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.691342    2580 scope.go:117] "RemoveContainer" containerID="6695119d40c436270c08ecc0b0df9dcee17a880b93b54b1a21415eb81ba21818"
Jul 22 11:26:46.697186 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.697160    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:26:46.698738 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.698720    2580 scope.go:117] "RemoveContainer" containerID="f2e6dd30f86e364cfbf67c20f6712827ac5a4668b2786e4c48edb244c9ddd653"
Jul 22 11:26:46.702243 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.702224    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:26:46.706178 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.706160    2580 scope.go:117] "RemoveContainer" containerID="8953d2ae852e68de63b4544fc1d2f4e9f827ed3d13c1bb4b67aadea59777913c"
Jul 22 11:26:46.713549 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.713531    2580 scope.go:117] "RemoveContainer" containerID="6e1670d19c17ee66c709cdb8c71c30e46dfd3d7fcdf3e3ef6af562ec5f004421"
Jul 22 11:26:46.730199 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730176    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:26:46.730491 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730478    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730493    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730501    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy-thanos"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730508    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy-thanos"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730522    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="thanos-sidecar"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730527    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="thanos-sidecar"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730538    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="init-config-reloader"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730543    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="init-config-reloader"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730548    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="prometheus"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730552    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="prometheus"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730559    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy-web"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730564    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy-web"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730571    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="config-reloader"
Jul 22 11:26:46.730579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730576    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="config-reloader"
Jul 22 11:26:46.730956 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730625    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="prometheus"
Jul 22 11:26:46.730956 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730632    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy-web"
Jul 22 11:26:46.730956 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730639    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="thanos-sidecar"
Jul 22 11:26:46.730956 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730645    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="config-reloader"
Jul 22 11:26:46.730956 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730650    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy-thanos"
Jul 22 11:26:46.730956 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.730655    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" containerName="kube-rbac-proxy"
Jul 22 11:26:46.735913 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.735893    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.739198 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.739181    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 11:26:46.739322 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.739306    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 11:26:46.739490 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.739465    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 11:26:46.739490 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.739470    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 11:26:46.739727 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.739707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 11:26:46.739849 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.739779    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 11:26:46.739849 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.739841    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 11:26:46.739956 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.739841    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 11:26:46.741570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.740584    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b1kude7nljpfa\""
Jul 22 11:26:46.741570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.740738    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 11:26:46.741570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.741072    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-c5hvm\""
Jul 22 11:26:46.741776 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.741642    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 11:26:46.742541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.742024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 11:26:46.743390 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.742985    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 11:26:46.749304 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.749281    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 11:26:46.751067 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.751047    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 11:26:46.751736 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.751717    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:26:46.880209 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880246    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880272    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efedb072-6df9-431d-a649-d94274b34136-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880299    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efedb072-6df9-431d-a649-d94274b34136-config-out\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880411 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880634    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-config\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880965 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880965 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880893    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.880965 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.880922    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4blq\" (UniqueName: \"kubernetes.io/projected/efedb072-6df9-431d-a649-d94274b34136-kube-api-access-d4blq\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.881067 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.881048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.881107 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.881076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.881185 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.881170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-web-config\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982276 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982199    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982276 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-web-config\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982276 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982260    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982285    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efedb072-6df9-431d-a649-d94274b34136-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982461    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efedb072-6df9-431d-a649-d94274b34136-config-out\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982541 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-config\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982740    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4blq\" (UniqueName: \"kubernetes.io/projected/efedb072-6df9-431d-a649-d94274b34136-kube-api-access-d4blq\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.982856 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.982839    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.983352 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.983193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.983352 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.983258    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.983512 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.983438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.983709 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.983692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.984088 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.984059    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.985983 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.985956    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.986086 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.986045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.986428 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.986403    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.987108 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.986693    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.987108 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.987064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.987326 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.987303    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/efedb072-6df9-431d-a649-d94274b34136-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.987681 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.987657    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efedb072-6df9-431d-a649-d94274b34136-config-out\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.988460 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.988435    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.988543 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.988496    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.988888 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.988866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-config\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.988983 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.988885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efedb072-6df9-431d-a649-d94274b34136-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.988983 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.988925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.989097 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.989045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.989381 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.989361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efedb072-6df9-431d-a649-d94274b34136-web-config\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:46.994692 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:46.994675    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4blq\" (UniqueName: \"kubernetes.io/projected/efedb072-6df9-431d-a649-d94274b34136-kube-api-access-d4blq\") pod \"prometheus-k8s-0\" (UID: \"efedb072-6df9-431d-a649-d94274b34136\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:47.051271 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:47.051233    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:26:47.202872 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:47.202843    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 11:26:47.203772 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:26:47.203751    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefedb072_6df9_431d_a649_d94274b34136.slice/crio-1df80e70ae160669af712f390458e4b82af288c4cf1c29aeaeccc231e5b98e97 WatchSource:0}: Error finding container 1df80e70ae160669af712f390458e4b82af288c4cf1c29aeaeccc231e5b98e97: Status 404 returned error can't find the container with id 1df80e70ae160669af712f390458e4b82af288c4cf1c29aeaeccc231e5b98e97
Jul 22 11:26:47.673787 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:47.673754    2580 generic.go:356] "Generic (PLEG): container finished" podID="efedb072-6df9-431d-a649-d94274b34136" containerID="02499de28d598d2e58c651562f6bb58883ffd0a844543668299c05c178706598" exitCode=0
Jul 22 11:26:47.674188 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:47.673852    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efedb072-6df9-431d-a649-d94274b34136","Type":"ContainerDied","Data":"02499de28d598d2e58c651562f6bb58883ffd0a844543668299c05c178706598"}
Jul 22 11:26:47.674188 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:47.673946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efedb072-6df9-431d-a649-d94274b34136","Type":"ContainerStarted","Data":"1df80e70ae160669af712f390458e4b82af288c4cf1c29aeaeccc231e5b98e97"}
Jul 22 11:26:47.737076 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:47.737048    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a48a14-b028-45d9-aad3-3444cd4cd8f8" path="/var/lib/kubelet/pods/a2a48a14-b028-45d9-aad3-3444cd4cd8f8/volumes"
Jul 22 11:26:48.683979 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:48.683930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efedb072-6df9-431d-a649-d94274b34136","Type":"ContainerStarted","Data":"b7b6968943dad18920b46536a4ea3156e422a708cbdf32b0a043e5aaa3fefc11"}
Jul 22 11:26:48.684371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:48.684056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efedb072-6df9-431d-a649-d94274b34136","Type":"ContainerStarted","Data":"f73174430ce2d0e95e6db4207384da4cc149cf7e206d08cb42d4c4147599f698"}
Jul 22 11:26:48.684371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:48.684087    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efedb072-6df9-431d-a649-d94274b34136","Type":"ContainerStarted","Data":"db805ce27bdb3c0b3b30b51b10779315304243c3c51d03a41ee734b78fc07d61"}
Jul 22 11:26:48.684371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:48.684132    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efedb072-6df9-431d-a649-d94274b34136","Type":"ContainerStarted","Data":"060e09db0e5d7d7a82085697c49504b6f00268b6af4ecad26709877651fa33c2"}
Jul 22 11:26:48.684371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:48.684154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efedb072-6df9-431d-a649-d94274b34136","Type":"ContainerStarted","Data":"831ad83c800acb499c3e91c3740f443a4afe17ee554f4008cc2b0266a7a00a4d"}
Jul 22 11:26:48.684371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:48.684178    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"efedb072-6df9-431d-a649-d94274b34136","Type":"ContainerStarted","Data":"5c186b877aa1093cc8915dbab2e9ae297a887228be203271d688433322b48a35"}
Jul 22 11:26:48.721264 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:48.721212    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.702417533 podStartE2EDuration="2.721196383s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.77885ms" isStatefulPod=false podCreationTimestamp="2026-07-22 11:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:26:48.71815412 +0000 UTC m=+201.380801403" watchObservedRunningTime="2026-07-22 11:26:48.721196383 +0000 UTC m=+201.383843640"
Jul 22 11:26:52.051601 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:26:52.051559    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:27:47.051730 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:27:47.051692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:27:47.068113 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:27:47.068091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:27:47.932501 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:27:47.932475    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 11:28:27.656344 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:28:27.656315    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 11:29:38.150902 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.150816    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"]
Jul 22 11:29:38.154319 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.154297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"
Jul 22 11:29:38.157245 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.157223    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 11:29:38.157245 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.157226    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bwhjz\""
Jul 22 11:29:38.158386 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.158352    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 11:29:38.163790 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.163766    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"]
Jul 22 11:29:38.214088 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.214050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ptxz\" (UniqueName: \"kubernetes.io/projected/cb08019b-6fc1-4a7c-9c1a-005bfcd2f329-kube-api-access-9ptxz\") pod \"cert-manager-cainjector-559cdd8c87-4dw6w\" (UID: \"cb08019b-6fc1-4a7c-9c1a-005bfcd2f329\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"
Jul 22 11:29:38.214282 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.214135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb08019b-6fc1-4a7c-9c1a-005bfcd2f329-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4dw6w\" (UID: \"cb08019b-6fc1-4a7c-9c1a-005bfcd2f329\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"
Jul 22 11:29:38.315338 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.315297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb08019b-6fc1-4a7c-9c1a-005bfcd2f329-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4dw6w\" (UID: \"cb08019b-6fc1-4a7c-9c1a-005bfcd2f329\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"
Jul 22 11:29:38.315338 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.315339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ptxz\" (UniqueName: \"kubernetes.io/projected/cb08019b-6fc1-4a7c-9c1a-005bfcd2f329-kube-api-access-9ptxz\") pod \"cert-manager-cainjector-559cdd8c87-4dw6w\" (UID: \"cb08019b-6fc1-4a7c-9c1a-005bfcd2f329\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"
Jul 22 11:29:38.325861 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.325820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb08019b-6fc1-4a7c-9c1a-005bfcd2f329-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4dw6w\" (UID: \"cb08019b-6fc1-4a7c-9c1a-005bfcd2f329\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"
Jul 22 11:29:38.326147 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.326125    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ptxz\" (UniqueName: \"kubernetes.io/projected/cb08019b-6fc1-4a7c-9c1a-005bfcd2f329-kube-api-access-9ptxz\") pod \"cert-manager-cainjector-559cdd8c87-4dw6w\" (UID: \"cb08019b-6fc1-4a7c-9c1a-005bfcd2f329\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"
Jul 22 11:29:38.480664 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.480574    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"
Jul 22 11:29:38.617778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.617752    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w"]
Jul 22 11:29:38.620164 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:29:38.620131    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb08019b_6fc1_4a7c_9c1a_005bfcd2f329.slice/crio-1caf217b9157dd8d50157081aed800a81f0f64abf77ba5ba7c65b20f7ec9a44c WatchSource:0}: Error finding container 1caf217b9157dd8d50157081aed800a81f0f64abf77ba5ba7c65b20f7ec9a44c: Status 404 returned error can't find the container with id 1caf217b9157dd8d50157081aed800a81f0f64abf77ba5ba7c65b20f7ec9a44c
Jul 22 11:29:38.622047 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:38.622031    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 11:29:39.342701 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:39.342664    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w" event={"ID":"cb08019b-6fc1-4a7c-9c1a-005bfcd2f329","Type":"ContainerStarted","Data":"1caf217b9157dd8d50157081aed800a81f0f64abf77ba5ba7c65b20f7ec9a44c"}
Jul 22 11:29:42.360173 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:42.360129    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w" event={"ID":"cb08019b-6fc1-4a7c-9c1a-005bfcd2f329","Type":"ContainerStarted","Data":"a1177ec834a8cab1037e5be98b6a9c47be2863d07fecd363148bf98afeaa36fa"}
Jul 22 11:29:42.379610 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:29:42.379556    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4dw6w" podStartSLOduration=1.2806420379999999 podStartE2EDuration="4.379538422s" totalImagesPullingTime="3.098896384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:29:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:29:42.377653143 +0000 UTC m=+375.040300401" watchObservedRunningTime="2026-07-22 11:29:42.379538422 +0000 UTC m=+375.042185680"
Jul 22 11:30:07.698783 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.698753    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"]
Jul 22 11:30:07.704034 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.703995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.707276 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.707256    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 11:30:07.707633 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.707617    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 11:30:07.707712 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.707654    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 11:30:07.707783 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.707708    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x6rn5\""
Jul 22 11:30:07.708072 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.708055    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 11:30:07.726147 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.726110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"]
Jul 22 11:30:07.760562 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.760526    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-tmp\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.760562 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.760562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdmvj\" (UniqueName: \"kubernetes.io/projected/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-kube-api-access-jdmvj\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.760778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.760587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-manifests\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.760778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.760667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.760778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.760704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.862104 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.862069    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-tmp\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.862289 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.862119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdmvj\" (UniqueName: \"kubernetes.io/projected/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-kube-api-access-jdmvj\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.862289 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.862160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-manifests\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.862289 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.862204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.862289 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.862266    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.862727 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.862702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-manifests\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.865094 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.865045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-webhook-cert\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.865409 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.865223    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.865409 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.865343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-tmp\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:07.872741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:07.872714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdmvj\" (UniqueName: \"kubernetes.io/projected/f6d648ca-57e3-4ec9-a774-8a6a9c95cb72-kube-api-access-jdmvj\") pod \"opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm\" (UID: \"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72\") " pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:08.014133 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:08.014049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:08.154965 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:08.154942    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"]
Jul 22 11:30:08.157868 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:30:08.157840    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d648ca_57e3_4ec9_a774_8a6a9c95cb72.slice/crio-f8e7f4b613bf395d2e300f7bb49256db5a4409f8446de28b42f795ca2554ab02 WatchSource:0}: Error finding container f8e7f4b613bf395d2e300f7bb49256db5a4409f8446de28b42f795ca2554ab02: Status 404 returned error can't find the container with id f8e7f4b613bf395d2e300f7bb49256db5a4409f8446de28b42f795ca2554ab02
Jul 22 11:30:08.465775 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:08.465742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm" event={"ID":"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72","Type":"ContainerStarted","Data":"f8e7f4b613bf395d2e300f7bb49256db5a4409f8446de28b42f795ca2554ab02"}
Jul 22 11:30:11.482129 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:11.482041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm" event={"ID":"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72","Type":"ContainerStarted","Data":"3984aeebd9d53c8aa15863325b0fcced4cdd7d1ca998e28ca7bbabb6fb7830ea"}
Jul 22 11:30:12.487622 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:12.487586    2580 generic.go:356] "Generic (PLEG): container finished" podID="f6d648ca-57e3-4ec9-a774-8a6a9c95cb72" containerID="3984aeebd9d53c8aa15863325b0fcced4cdd7d1ca998e28ca7bbabb6fb7830ea" exitCode=0
Jul 22 11:30:12.488146 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:12.487619    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm" event={"ID":"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72","Type":"ContainerDied","Data":"3984aeebd9d53c8aa15863325b0fcced4cdd7d1ca998e28ca7bbabb6fb7830ea"}
Jul 22 11:30:14.498844 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:14.498812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm" event={"ID":"f6d648ca-57e3-4ec9-a774-8a6a9c95cb72","Type":"ContainerStarted","Data":"456783c896168fde7d37834a809a6a444ea02e23c27c6cddbb45fe565d780005"}
Jul 22 11:30:14.499264 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:14.498935    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:14.523947 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:14.523896    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm" podStartSLOduration=2.090880349 podStartE2EDuration="7.52387955s" totalImagesPullingTime="4.404163237s" totalInitContainerRuntime="1.028835964s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:30:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:30:14.521303735 +0000 UTC m=+407.183950992" watchObservedRunningTime="2026-07-22 11:30:14.52387955 +0000 UTC m=+407.186526807"
Jul 22 11:30:25.505122 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:25.505093    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm"
Jul 22 11:30:38.823385 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.823347    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"]
Jul 22 11:30:38.831686 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.831662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:38.835079 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.835057    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 11:30:38.836813 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.836782    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 11:30:38.836903 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.836785    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 11:30:38.836903 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.836883    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mbp5b\""
Jul 22 11:30:38.836903 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.836792    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 11:30:38.837050 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.836812    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 11:30:38.844025 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.842486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"]
Jul 22 11:30:38.947168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.947132    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v7rq\" (UniqueName: \"kubernetes.io/projected/02cdddf2-36e4-40c2-9e97-1277766ef6c3-kube-api-access-8v7rq\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:38.947366 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.947189    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02cdddf2-36e4-40c2-9e97-1277766ef6c3-metrics-cert\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:38.947366 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.947298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02cdddf2-36e4-40c2-9e97-1277766ef6c3-cert\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:38.947366 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:38.947339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02cdddf2-36e4-40c2-9e97-1277766ef6c3-manager-config\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.047785 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.047745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7rq\" (UniqueName: \"kubernetes.io/projected/02cdddf2-36e4-40c2-9e97-1277766ef6c3-kube-api-access-8v7rq\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.047933 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.047807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02cdddf2-36e4-40c2-9e97-1277766ef6c3-metrics-cert\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.047933 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.047884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02cdddf2-36e4-40c2-9e97-1277766ef6c3-cert\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.047933 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.047919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02cdddf2-36e4-40c2-9e97-1277766ef6c3-manager-config\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.048652 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.048628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/02cdddf2-36e4-40c2-9e97-1277766ef6c3-manager-config\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.050392 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.050373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/02cdddf2-36e4-40c2-9e97-1277766ef6c3-cert\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.050519 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.050500    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/02cdddf2-36e4-40c2-9e97-1277766ef6c3-metrics-cert\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.059433 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.059399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v7rq\" (UniqueName: \"kubernetes.io/projected/02cdddf2-36e4-40c2-9e97-1277766ef6c3-kube-api-access-8v7rq\") pod \"lws-controller-manager-55d777d8cf-xgqrf\" (UID: \"02cdddf2-36e4-40c2-9e97-1277766ef6c3\") " pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.147559 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.147476    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:39.289451 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.289416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"]
Jul 22 11:30:39.293373 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:30:39.293345    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cdddf2_36e4_40c2_9e97_1277766ef6c3.slice/crio-fe3a899a21da5535bd84ec0212a71e92343d82e0bdebca7b8f0fbe79f9b75e91 WatchSource:0}: Error finding container fe3a899a21da5535bd84ec0212a71e92343d82e0bdebca7b8f0fbe79f9b75e91: Status 404 returned error can't find the container with id fe3a899a21da5535bd84ec0212a71e92343d82e0bdebca7b8f0fbe79f9b75e91
Jul 22 11:30:39.607034 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:39.606973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf" event={"ID":"02cdddf2-36e4-40c2-9e97-1277766ef6c3","Type":"ContainerStarted","Data":"fe3a899a21da5535bd84ec0212a71e92343d82e0bdebca7b8f0fbe79f9b75e91"}
Jul 22 11:30:40.654826 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.654790    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"]
Jul 22 11:30:40.658798 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.658773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:40.661951 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.661917    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-48hsn\""
Jul 22 11:30:40.662570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.662506    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 22 11:30:40.668042 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.667746    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"]
Jul 22 11:30:40.672575 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.672552    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"]
Jul 22 11:30:40.672747 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.672727    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:40.676335 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.676313    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-p8hrn\""
Jul 22 11:30:40.677114 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.677090    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 22 11:30:40.685616 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.685547    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"]
Jul 22 11:30:40.762480 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.762407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f9bce89-eea1-48af-8119-d0f2ea2ed5ec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f7f7m\" (UID: \"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:40.762673 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.762502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6v5s\" (UniqueName: \"kubernetes.io/projected/3f9bce89-eea1-48af-8119-d0f2ea2ed5ec-kube-api-access-f6v5s\") pod \"llmisvc-controller-manager-777c6bd7d5-f7f7m\" (UID: \"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:40.762673 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.762549    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fdqx\" (UniqueName: \"kubernetes.io/projected/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-kube-api-access-8fdqx\") pod \"kserve-controller-manager-d6f4b65b8-rdzrl\" (UID: \"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:40.762673 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.762574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-cert\") pod \"kserve-controller-manager-d6f4b65b8-rdzrl\" (UID: \"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:40.863758 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.863705    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f9bce89-eea1-48af-8119-d0f2ea2ed5ec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f7f7m\" (UID: \"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:40.863946 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.863860    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6v5s\" (UniqueName: \"kubernetes.io/projected/3f9bce89-eea1-48af-8119-d0f2ea2ed5ec-kube-api-access-f6v5s\") pod \"llmisvc-controller-manager-777c6bd7d5-f7f7m\" (UID: \"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:40.864073 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.863980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fdqx\" (UniqueName: \"kubernetes.io/projected/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-kube-api-access-8fdqx\") pod \"kserve-controller-manager-d6f4b65b8-rdzrl\" (UID: \"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:40.864073 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.864030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-cert\") pod \"kserve-controller-manager-d6f4b65b8-rdzrl\" (UID: \"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:40.865252 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:30:40.865154    2580 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 22 11:30:40.865252 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:30:40.865232    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-cert podName:b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb nodeName:}" failed. No retries permitted until 2026-07-22 11:30:41.36520973 +0000 UTC m=+434.027856983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-cert") pod "kserve-controller-manager-d6f4b65b8-rdzrl" (UID: "b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb") : secret "kserve-webhook-server-cert" not found
Jul 22 11:30:40.867883 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.867857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f9bce89-eea1-48af-8119-d0f2ea2ed5ec-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-f7f7m\" (UID: \"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:40.877515 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.877468    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6v5s\" (UniqueName: \"kubernetes.io/projected/3f9bce89-eea1-48af-8119-d0f2ea2ed5ec-kube-api-access-f6v5s\") pod \"llmisvc-controller-manager-777c6bd7d5-f7f7m\" (UID: \"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:40.878184 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.878110    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fdqx\" (UniqueName: \"kubernetes.io/projected/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-kube-api-access-8fdqx\") pod \"kserve-controller-manager-d6f4b65b8-rdzrl\" (UID: \"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:40.989570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:40.989484    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:41.173523 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:41.173497    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"]
Jul 22 11:30:41.369450 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:41.369418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-cert\") pod \"kserve-controller-manager-d6f4b65b8-rdzrl\" (UID: \"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:41.372077 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:41.372052    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb-cert\") pod \"kserve-controller-manager-d6f4b65b8-rdzrl\" (UID: \"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:41.573505 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:41.573462    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:42.042000 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:30:42.041962    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f9bce89_eea1_48af_8119_d0f2ea2ed5ec.slice/crio-cb863bc8eccd4d21f8854fd266b43c849e02cc19dc88171266ac0240e096ee4c WatchSource:0}: Error finding container cb863bc8eccd4d21f8854fd266b43c849e02cc19dc88171266ac0240e096ee4c: Status 404 returned error can't find the container with id cb863bc8eccd4d21f8854fd266b43c849e02cc19dc88171266ac0240e096ee4c
Jul 22 11:30:42.221045 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:42.220977    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"]
Jul 22 11:30:42.223750 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:30:42.223722    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6e6fdeb_e6c3_4148_bde4_cbb4b564aafb.slice/crio-3a80a6f8b06c3c667c97ee0a86dc26dc10e87fe8177ca4948cc6ff7055f1cd89 WatchSource:0}: Error finding container 3a80a6f8b06c3c667c97ee0a86dc26dc10e87fe8177ca4948cc6ff7055f1cd89: Status 404 returned error can't find the container with id 3a80a6f8b06c3c667c97ee0a86dc26dc10e87fe8177ca4948cc6ff7055f1cd89
Jul 22 11:30:42.626244 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:42.626212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf" event={"ID":"02cdddf2-36e4-40c2-9e97-1277766ef6c3","Type":"ContainerStarted","Data":"832d2581a1f7e55193f18918a79411a8aa39bf7eddcd83aae50b0384eb53b7bb"}
Jul 22 11:30:42.626442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:42.626310    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:30:42.627502 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:42.627481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m" event={"ID":"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec","Type":"ContainerStarted","Data":"cb863bc8eccd4d21f8854fd266b43c849e02cc19dc88171266ac0240e096ee4c"}
Jul 22 11:30:42.628631 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:42.628605    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl" event={"ID":"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb","Type":"ContainerStarted","Data":"3a80a6f8b06c3c667c97ee0a86dc26dc10e87fe8177ca4948cc6ff7055f1cd89"}
Jul 22 11:30:42.656918 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:42.656867    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf" podStartSLOduration=1.840015448 podStartE2EDuration="4.656848453s" totalImagesPullingTime="2.816833005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:30:42.653209371 +0000 UTC m=+435.315856653" watchObservedRunningTime="2026-07-22 11:30:42.656848453 +0000 UTC m=+435.319495710"
Jul 22 11:30:45.646147 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:45.646105    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m" event={"ID":"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec","Type":"ContainerStarted","Data":"b13b02c36cdca4d6970c0cd402bcd4ea31c637d1c98d0bfb26fbf26ff5ad2eec"}
Jul 22 11:30:45.646584 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:45.646213    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:30:45.647636 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:45.647615    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl" event={"ID":"b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb","Type":"ContainerStarted","Data":"b125b66824a86333e617e01163ee879359574f4452106fc3a7a6518350024bdf"}
Jul 22 11:30:45.647754 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:45.647739    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:30:45.691737 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:45.691687    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m" podStartSLOduration=2.977846079 podStartE2EDuration="5.691671138s" totalImagesPullingTime="2.713825059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:30:45.690618146 +0000 UTC m=+438.353265403" watchObservedRunningTime="2026-07-22 11:30:45.691671138 +0000 UTC m=+438.354318395"
Jul 22 11:30:45.735459 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:45.735407    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl" podStartSLOduration=3.206904846 podStartE2EDuration="5.735389305s" totalImagesPullingTime="2.528484459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:30:45.732930711 +0000 UTC m=+438.395577990" watchObservedRunningTime="2026-07-22 11:30:45.735389305 +0000 UTC m=+438.398036557"
Jul 22 11:30:53.637354 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:30:53.637325    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55d777d8cf-xgqrf"
Jul 22 11:31:16.654469 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:16.654434    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:31:16.657434 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:16.657413    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-rdzrl"
Jul 22 11:31:28.983566 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:28.983532    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skbvh"]
Jul 22 11:31:28.986888 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:28.986869    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-skbvh"
Jul 22 11:31:28.989735 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:28.989714    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 11:31:28.989879 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:28.989734    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 11:31:28.991894 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:28.991876    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-28rb2\""
Jul 22 11:31:29.000656 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.000632    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skbvh"]
Jul 22 11:31:29.083136 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.083104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxcs8\" (UniqueName: \"kubernetes.io/projected/a1ad1d72-c902-4859-ba30-5af946107559-kube-api-access-mxcs8\") pod \"kuadrant-operator-catalog-skbvh\" (UID: \"a1ad1d72-c902-4859-ba30-5af946107559\") " pod="kuadrant-system/kuadrant-operator-catalog-skbvh"
Jul 22 11:31:29.184271 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.184233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxcs8\" (UniqueName: \"kubernetes.io/projected/a1ad1d72-c902-4859-ba30-5af946107559-kube-api-access-mxcs8\") pod \"kuadrant-operator-catalog-skbvh\" (UID: \"a1ad1d72-c902-4859-ba30-5af946107559\") " pod="kuadrant-system/kuadrant-operator-catalog-skbvh"
Jul 22 11:31:29.196741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.196710    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxcs8\" (UniqueName: \"kubernetes.io/projected/a1ad1d72-c902-4859-ba30-5af946107559-kube-api-access-mxcs8\") pod \"kuadrant-operator-catalog-skbvh\" (UID: \"a1ad1d72-c902-4859-ba30-5af946107559\") " pod="kuadrant-system/kuadrant-operator-catalog-skbvh"
Jul 22 11:31:29.298644 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.298538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-skbvh"
Jul 22 11:31:29.336646 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.336614    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skbvh"]
Jul 22 11:31:29.435366 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.435342    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skbvh"]
Jul 22 11:31:29.437938 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:31:29.437912    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ad1d72_c902_4859_ba30_5af946107559.slice/crio-dd39ea4d7fd27a8875bfece547e705ff7c04f66dda4750851ccf4108ee22eec9 WatchSource:0}: Error finding container dd39ea4d7fd27a8875bfece547e705ff7c04f66dda4750851ccf4108ee22eec9: Status 404 returned error can't find the container with id dd39ea4d7fd27a8875bfece547e705ff7c04f66dda4750851ccf4108ee22eec9
Jul 22 11:31:29.547987 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.547951    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz76x"]
Jul 22 11:31:29.552574 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.552524    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:29.561567 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.561543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz76x"]
Jul 22 11:31:29.688363 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.688325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lf8r\" (UniqueName: \"kubernetes.io/projected/76b794a5-9803-4671-9608-deebbe1ddbb1-kube-api-access-4lf8r\") pod \"kuadrant-operator-catalog-wz76x\" (UID: \"76b794a5-9803-4671-9608-deebbe1ddbb1\") " pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:29.788915 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.788878    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lf8r\" (UniqueName: \"kubernetes.io/projected/76b794a5-9803-4671-9608-deebbe1ddbb1-kube-api-access-4lf8r\") pod \"kuadrant-operator-catalog-wz76x\" (UID: \"76b794a5-9803-4671-9608-deebbe1ddbb1\") " pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:29.799667 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.799641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lf8r\" (UniqueName: \"kubernetes.io/projected/76b794a5-9803-4671-9608-deebbe1ddbb1-kube-api-access-4lf8r\") pod \"kuadrant-operator-catalog-wz76x\" (UID: \"76b794a5-9803-4671-9608-deebbe1ddbb1\") " pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:29.856770 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.856735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-skbvh" event={"ID":"a1ad1d72-c902-4859-ba30-5af946107559","Type":"ContainerStarted","Data":"dd39ea4d7fd27a8875bfece547e705ff7c04f66dda4750851ccf4108ee22eec9"}
Jul 22 11:31:29.862934 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:29.862900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:30.001660 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:30.001637    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wz76x"]
Jul 22 11:31:30.004317 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:31:30.004291    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b794a5_9803_4671_9608_deebbe1ddbb1.slice/crio-de7e3b120edfb1fccd27bfdaf067345a0766cac902623dcac2c5867dcf40dde7 WatchSource:0}: Error finding container de7e3b120edfb1fccd27bfdaf067345a0766cac902623dcac2c5867dcf40dde7: Status 404 returned error can't find the container with id de7e3b120edfb1fccd27bfdaf067345a0766cac902623dcac2c5867dcf40dde7
Jul 22 11:31:30.864414 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:30.864381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wz76x" event={"ID":"76b794a5-9803-4671-9608-deebbe1ddbb1","Type":"ContainerStarted","Data":"de7e3b120edfb1fccd27bfdaf067345a0766cac902623dcac2c5867dcf40dde7"}
Jul 22 11:31:32.879445 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:32.879402    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wz76x" event={"ID":"76b794a5-9803-4671-9608-deebbe1ddbb1","Type":"ContainerStarted","Data":"e670d14a9920cf6a78fc13b009fb9f4a74110c8db779bb64d84cabb923dfa44c"}
Jul 22 11:31:32.880829 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:32.880802    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-skbvh" event={"ID":"a1ad1d72-c902-4859-ba30-5af946107559","Type":"ContainerStarted","Data":"bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb"}
Jul 22 11:31:32.880939 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:32.880881    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-skbvh" podUID="a1ad1d72-c902-4859-ba30-5af946107559" containerName="registry-server" containerID="cri-o://bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb" gracePeriod=2
Jul 22 11:31:32.898989 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:32.898944    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wz76x" podStartSLOduration=2.087109015 podStartE2EDuration="3.898929642s" totalImagesPullingTime="1.811820627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:31:32.897234106 +0000 UTC m=+485.559881366" watchObservedRunningTime="2026-07-22 11:31:32.898929642 +0000 UTC m=+485.561576900"
Jul 22 11:31:32.917182 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:32.917136    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-skbvh" podStartSLOduration=2.537221545 podStartE2EDuration="4.917120448s" totalImagesPullingTime="2.379898903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:31:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:31:32.915205227 +0000 UTC m=+485.577852484" watchObservedRunningTime="2026-07-22 11:31:32.917120448 +0000 UTC m=+485.579767705"
Jul 22 11:31:33.131088 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.130981    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-skbvh"
Jul 22 11:31:33.221907 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.221868    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxcs8\" (UniqueName: \"kubernetes.io/projected/a1ad1d72-c902-4859-ba30-5af946107559-kube-api-access-mxcs8\") pod \"a1ad1d72-c902-4859-ba30-5af946107559\" (UID: \"a1ad1d72-c902-4859-ba30-5af946107559\") "
Jul 22 11:31:33.224237 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.224201    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1ad1d72-c902-4859-ba30-5af946107559-kube-api-access-mxcs8" (OuterVolumeSpecName: "kube-api-access-mxcs8") pod "a1ad1d72-c902-4859-ba30-5af946107559" (UID: "a1ad1d72-c902-4859-ba30-5af946107559"). InnerVolumeSpecName "kube-api-access-mxcs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:31:33.323446 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.323395    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxcs8\" (UniqueName: \"kubernetes.io/projected/a1ad1d72-c902-4859-ba30-5af946107559-kube-api-access-mxcs8\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:31:33.885997 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.885959    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1ad1d72-c902-4859-ba30-5af946107559" containerID="bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb" exitCode=0
Jul 22 11:31:33.886467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.886024    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-skbvh"
Jul 22 11:31:33.886467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.886056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-skbvh" event={"ID":"a1ad1d72-c902-4859-ba30-5af946107559","Type":"ContainerDied","Data":"bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb"}
Jul 22 11:31:33.886467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.886109    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-skbvh" event={"ID":"a1ad1d72-c902-4859-ba30-5af946107559","Type":"ContainerDied","Data":"dd39ea4d7fd27a8875bfece547e705ff7c04f66dda4750851ccf4108ee22eec9"}
Jul 22 11:31:33.886467 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.886134    2580 scope.go:117] "RemoveContainer" containerID="bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb"
Jul 22 11:31:33.894762 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.894744    2580 scope.go:117] "RemoveContainer" containerID="bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb"
Jul 22 11:31:33.895045 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:31:33.895026    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb\": container with ID starting with bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb not found: ID does not exist" containerID="bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb"
Jul 22 11:31:33.895113 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.895056    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb"} err="failed to get container status \"bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb\": rpc error: code = NotFound desc = could not find container \"bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb\": container with ID starting with bb5eaae69c31ad54857c625396e007952f957e05d00a9ad2ecd89a422f97f4cb not found: ID does not exist"
Jul 22 11:31:33.909056 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.909029    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skbvh"]
Jul 22 11:31:33.913793 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:33.913771    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-skbvh"]
Jul 22 11:31:35.736825 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:35.736789    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1ad1d72-c902-4859-ba30-5af946107559" path="/var/lib/kubelet/pods/a1ad1d72-c902-4859-ba30-5af946107559/volumes"
Jul 22 11:31:39.863941 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:39.863898    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:39.864368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:39.863965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:39.887487 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:39.887453    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:39.935544 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:39.935520    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wz76x"
Jul 22 11:31:56.029951 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.029915    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"]
Jul 22 11:31:56.030442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.030316    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1ad1d72-c902-4859-ba30-5af946107559" containerName="registry-server"
Jul 22 11:31:56.030442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.030328    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1ad1d72-c902-4859-ba30-5af946107559" containerName="registry-server"
Jul 22 11:31:56.030442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.030404    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1ad1d72-c902-4859-ba30-5af946107559" containerName="registry-server"
Jul 22 11:31:56.033488 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.033473    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"
Jul 22 11:31:56.038487 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.038468    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mc9bp\""
Jul 22 11:31:56.048396 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.048372    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"]
Jul 22 11:31:56.120588 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.120551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ts84\" (UniqueName: \"kubernetes.io/projected/8b432656-b391-4bca-b512-ee57b4dbd9cc-kube-api-access-2ts84\") pod \"authorino-operator-75cc8d5cb7-lhtx2\" (UID: \"8b432656-b391-4bca-b512-ee57b4dbd9cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"
Jul 22 11:31:56.221273 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.221221    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ts84\" (UniqueName: \"kubernetes.io/projected/8b432656-b391-4bca-b512-ee57b4dbd9cc-kube-api-access-2ts84\") pod \"authorino-operator-75cc8d5cb7-lhtx2\" (UID: \"8b432656-b391-4bca-b512-ee57b4dbd9cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"
Jul 22 11:31:56.236015 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.235980    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ts84\" (UniqueName: \"kubernetes.io/projected/8b432656-b391-4bca-b512-ee57b4dbd9cc-kube-api-access-2ts84\") pod \"authorino-operator-75cc8d5cb7-lhtx2\" (UID: \"8b432656-b391-4bca-b512-ee57b4dbd9cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"
Jul 22 11:31:56.343134 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.343097    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"
Jul 22 11:31:56.504757 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.504736    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"]
Jul 22 11:31:56.507588 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:31:56.507563    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b432656_b391_4bca_b512_ee57b4dbd9cc.slice/crio-f4ff8855b2935dc3764041c49525ae94b966bb7495043c2f81e3a53badfda669 WatchSource:0}: Error finding container f4ff8855b2935dc3764041c49525ae94b966bb7495043c2f81e3a53badfda669: Status 404 returned error can't find the container with id f4ff8855b2935dc3764041c49525ae94b966bb7495043c2f81e3a53badfda669
Jul 22 11:31:56.991083 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:31:56.991048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2" event={"ID":"8b432656-b391-4bca-b512-ee57b4dbd9cc","Type":"ContainerStarted","Data":"f4ff8855b2935dc3764041c49525ae94b966bb7495043c2f81e3a53badfda669"}
Jul 22 11:32:00.010965 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:00.010928    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2" event={"ID":"8b432656-b391-4bca-b512-ee57b4dbd9cc","Type":"ContainerStarted","Data":"39ddf49b3f105e2c9d13fc3993eac688ff94a55115e666c50008bf88fc0929e9"}
Jul 22 11:32:00.011435 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:00.011065    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"
Jul 22 11:32:00.034570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:00.034517    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2" podStartSLOduration=2.23589433 podStartE2EDuration="5.034500703s" totalImagesPullingTime="2.798606373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:32:00.031586575 +0000 UTC m=+512.694233851" watchObservedRunningTime="2026-07-22 11:32:00.034500703 +0000 UTC m=+512.697147961"
Jul 22 11:32:03.281841 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.281809    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"]
Jul 22 11:32:03.285389 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.285373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:32:03.292035 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.291859    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-p5mss\""
Jul 22 11:32:03.292223 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.292204    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 11:32:03.300499 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.300474    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"]
Jul 22 11:32:03.383430 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.383395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5zl9\" (UniqueName: \"kubernetes.io/projected/b46b2061-7dc7-4d8f-bdd9-282466b7a2e5-kube-api-access-v5zl9\") pod \"dns-operator-controller-manager-864dd78c4c-bb5lf\" (UID: \"b46b2061-7dc7-4d8f-bdd9-282466b7a2e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:32:03.483937 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.483886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5zl9\" (UniqueName: \"kubernetes.io/projected/b46b2061-7dc7-4d8f-bdd9-282466b7a2e5-kube-api-access-v5zl9\") pod \"dns-operator-controller-manager-864dd78c4c-bb5lf\" (UID: \"b46b2061-7dc7-4d8f-bdd9-282466b7a2e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:32:03.495898 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.495863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5zl9\" (UniqueName: \"kubernetes.io/projected/b46b2061-7dc7-4d8f-bdd9-282466b7a2e5-kube-api-access-v5zl9\") pod \"dns-operator-controller-manager-864dd78c4c-bb5lf\" (UID: \"b46b2061-7dc7-4d8f-bdd9-282466b7a2e5\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:32:03.596165 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.596118    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:32:03.741605 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:03.741583    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"]
Jul 22 11:32:03.743634 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:32:03.743606    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb46b2061_7dc7_4d8f_bdd9_282466b7a2e5.slice/crio-0ab787b0f5ac307713299fc014ee3dc68062e4db582a0802215e84376f7790ea WatchSource:0}: Error finding container 0ab787b0f5ac307713299fc014ee3dc68062e4db582a0802215e84376f7790ea: Status 404 returned error can't find the container with id 0ab787b0f5ac307713299fc014ee3dc68062e4db582a0802215e84376f7790ea
Jul 22 11:32:04.030601 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:04.030518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf" event={"ID":"b46b2061-7dc7-4d8f-bdd9-282466b7a2e5","Type":"ContainerStarted","Data":"0ab787b0f5ac307713299fc014ee3dc68062e4db582a0802215e84376f7790ea"}
Jul 22 11:32:06.042926 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:06.042890    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf" event={"ID":"b46b2061-7dc7-4d8f-bdd9-282466b7a2e5","Type":"ContainerStarted","Data":"5f27551215a493b6ab60fead2f35b118de1b875641c84f26b54bbec867a8680e"}
Jul 22 11:32:06.043357 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:06.042998    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:32:06.063814 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:06.063748    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf" podStartSLOduration=1.316897972 podStartE2EDuration="3.063733684s" totalImagesPullingTime="1.746835712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:32:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:32:06.063196756 +0000 UTC m=+518.725844048" watchObservedRunningTime="2026-07-22 11:32:06.063733684 +0000 UTC m=+518.726380941"
Jul 22 11:32:08.897952 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:08.897915    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"]
Jul 22 11:32:08.902151 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:08.902111    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:08.905882 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:08.905855    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5chdv\""
Jul 22 11:32:08.915866 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:08.915844    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"]
Jul 22 11:32:09.031385 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:09.031347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ff93da9-c2a1-49e1-9e44-340256231a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" (UID: \"3ff93da9-c2a1-49e1-9e44-340256231a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:09.031580 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:09.031414    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hc9b\" (UniqueName: \"kubernetes.io/projected/3ff93da9-c2a1-49e1-9e44-340256231a26-kube-api-access-7hc9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" (UID: \"3ff93da9-c2a1-49e1-9e44-340256231a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:09.132836 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:09.132805    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hc9b\" (UniqueName: \"kubernetes.io/projected/3ff93da9-c2a1-49e1-9e44-340256231a26-kube-api-access-7hc9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" (UID: \"3ff93da9-c2a1-49e1-9e44-340256231a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:09.133041 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:09.132862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ff93da9-c2a1-49e1-9e44-340256231a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" (UID: \"3ff93da9-c2a1-49e1-9e44-340256231a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:09.133296 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:09.133277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ff93da9-c2a1-49e1-9e44-340256231a26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" (UID: \"3ff93da9-c2a1-49e1-9e44-340256231a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:09.143885 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:09.143861    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hc9b\" (UniqueName: \"kubernetes.io/projected/3ff93da9-c2a1-49e1-9e44-340256231a26-kube-api-access-7hc9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" (UID: \"3ff93da9-c2a1-49e1-9e44-340256231a26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:09.216026 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:09.215901    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:09.358665 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:09.358633    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"]
Jul 22 11:32:09.362469 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:32:09.362440    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff93da9_c2a1_49e1_9e44_340256231a26.slice/crio-8d5277921c7313a598ebfc1dae0c41909d49c555b220199bc9f467ccdba744da WatchSource:0}: Error finding container 8d5277921c7313a598ebfc1dae0c41909d49c555b220199bc9f467ccdba744da: Status 404 returned error can't find the container with id 8d5277921c7313a598ebfc1dae0c41909d49c555b220199bc9f467ccdba744da
Jul 22 11:32:10.063185 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:10.063154    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx" event={"ID":"3ff93da9-c2a1-49e1-9e44-340256231a26","Type":"ContainerStarted","Data":"8d5277921c7313a598ebfc1dae0c41909d49c555b220199bc9f467ccdba744da"}
Jul 22 11:32:11.018284 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:11.018254    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-lhtx2"
Jul 22 11:32:15.090928 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:15.090892    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx" event={"ID":"3ff93da9-c2a1-49e1-9e44-340256231a26","Type":"ContainerStarted","Data":"29a2d5d77dd5e04aa38bd0a226f2a2092b650238c094728c57bcbf0096a4b2e3"}
Jul 22 11:32:15.091331 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:15.090963    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:15.113807 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:15.113754    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx" podStartSLOduration=2.121103601 podStartE2EDuration="7.113737773s" totalImagesPullingTime="4.992634172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:32:15.112105111 +0000 UTC m=+527.774752390" watchObservedRunningTime="2026-07-22 11:32:15.113737773 +0000 UTC m=+527.776385104"
Jul 22 11:32:17.050883 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:17.050852    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:32:26.098149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:26.098074    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:27.959519 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:27.959435    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"]
Jul 22 11:32:27.959915 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:27.959671    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" containerName="manager" containerID="cri-o://29a2d5d77dd5e04aa38bd0a226f2a2092b650238c094728c57bcbf0096a4b2e3" gracePeriod=2
Jul 22 11:32:27.978447 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:27.978415    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"]
Jul 22 11:32:27.989283 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:32:27.989237    2580 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3ff93da9-c2a1-49e1-9e44-340256231a26\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:28.025744 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.025710    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"]
Jul 22 11:32:28.026165 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.026148    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" containerName="manager"
Jul 22 11:32:28.026165 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.026164    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" containerName="manager"
Jul 22 11:32:28.026324 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.026235    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" containerName="manager"
Jul 22 11:32:28.029284 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.029264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:28.048775 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:32:28.048740    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" is forbidden: User \"system:node:ip-10-0-136-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-126.ec2.internal' and this object" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:28.054254 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.054229    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"]
Jul 22 11:32:28.155148 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.155108    2580 generic.go:356] "Generic (PLEG): container finished" podID="3ff93da9-c2a1-49e1-9e44-340256231a26" containerID="29a2d5d77dd5e04aa38bd0a226f2a2092b650238c094728c57bcbf0096a4b2e3" exitCode=0
Jul 22 11:32:28.211809 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.211742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmc9d\" (UniqueName: \"kubernetes.io/projected/35f3cead-c263-4047-8b65-8dc68bc1153a-kube-api-access-qmc9d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g9vcc\" (UID: \"35f3cead-c263-4047-8b65-8dc68bc1153a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:28.211944 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.211807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35f3cead-c263-4047-8b65-8dc68bc1153a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g9vcc\" (UID: \"35f3cead-c263-4047-8b65-8dc68bc1153a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:28.215480 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.215460    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:28.219929 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:32:28.219905    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" is forbidden: User \"system:node:ip-10-0-136-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-126.ec2.internal' and this object" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:28.312381 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.312345    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmc9d\" (UniqueName: \"kubernetes.io/projected/35f3cead-c263-4047-8b65-8dc68bc1153a-kube-api-access-qmc9d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g9vcc\" (UID: \"35f3cead-c263-4047-8b65-8dc68bc1153a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:28.312560 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.312414    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35f3cead-c263-4047-8b65-8dc68bc1153a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g9vcc\" (UID: \"35f3cead-c263-4047-8b65-8dc68bc1153a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:28.312805 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.312785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35f3cead-c263-4047-8b65-8dc68bc1153a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g9vcc\" (UID: \"35f3cead-c263-4047-8b65-8dc68bc1153a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:28.340950 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.340911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmc9d\" (UniqueName: \"kubernetes.io/projected/35f3cead-c263-4047-8b65-8dc68bc1153a-kube-api-access-qmc9d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-g9vcc\" (UID: \"35f3cead-c263-4047-8b65-8dc68bc1153a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:28.366535 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.366501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:28.412835 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.412799    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ff93da9-c2a1-49e1-9e44-340256231a26-extensions-socket-volume\") pod \"3ff93da9-c2a1-49e1-9e44-340256231a26\" (UID: \"3ff93da9-c2a1-49e1-9e44-340256231a26\") "
Jul 22 11:32:28.413042 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.412904    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hc9b\" (UniqueName: \"kubernetes.io/projected/3ff93da9-c2a1-49e1-9e44-340256231a26-kube-api-access-7hc9b\") pod \"3ff93da9-c2a1-49e1-9e44-340256231a26\" (UID: \"3ff93da9-c2a1-49e1-9e44-340256231a26\") "
Jul 22 11:32:28.413257 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.413230    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff93da9-c2a1-49e1-9e44-340256231a26-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3ff93da9-c2a1-49e1-9e44-340256231a26" (UID: "3ff93da9-c2a1-49e1-9e44-340256231a26"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:32:28.415156 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.415129    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff93da9-c2a1-49e1-9e44-340256231a26-kube-api-access-7hc9b" (OuterVolumeSpecName: "kube-api-access-7hc9b") pod "3ff93da9-c2a1-49e1-9e44-340256231a26" (UID: "3ff93da9-c2a1-49e1-9e44-340256231a26"). InnerVolumeSpecName "kube-api-access-7hc9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:32:28.511136 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.511109    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"]
Jul 22 11:32:28.513564 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:32:28.513536    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f3cead_c263_4047_8b65_8dc68bc1153a.slice/crio-9f20e87228ea17b8d6d8b06fb8f14c3b8d0780a2b0d9e6ff70037eec1aa834fc WatchSource:0}: Error finding container 9f20e87228ea17b8d6d8b06fb8f14c3b8d0780a2b0d9e6ff70037eec1aa834fc: Status 404 returned error can't find the container with id 9f20e87228ea17b8d6d8b06fb8f14c3b8d0780a2b0d9e6ff70037eec1aa834fc
Jul 22 11:32:28.513686 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.513630    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3ff93da9-c2a1-49e1-9e44-340256231a26-extensions-socket-volume\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:32:28.513686 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:28.513646    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hc9b\" (UniqueName: \"kubernetes.io/projected/3ff93da9-c2a1-49e1-9e44-340256231a26-kube-api-access-7hc9b\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:32:29.160996 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:29.160955    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc" event={"ID":"35f3cead-c263-4047-8b65-8dc68bc1153a","Type":"ContainerStarted","Data":"b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8"}
Jul 22 11:32:29.161434 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:29.161048    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc" event={"ID":"35f3cead-c263-4047-8b65-8dc68bc1153a","Type":"ContainerStarted","Data":"9f20e87228ea17b8d6d8b06fb8f14c3b8d0780a2b0d9e6ff70037eec1aa834fc"}
Jul 22 11:32:29.161434 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:29.161080    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:29.162285 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:29.162267    2580 scope.go:117] "RemoveContainer" containerID="29a2d5d77dd5e04aa38bd0a226f2a2092b650238c094728c57bcbf0096a4b2e3"
Jul 22 11:32:29.162285 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:29.162281    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:29.164113 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:32:29.163996    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" is forbidden: User \"system:node:ip-10-0-136-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-126.ec2.internal' and this object" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:29.189315 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:29.189266    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc" podStartSLOduration=2.189248942 podStartE2EDuration="2.189248942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:32:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:32:29.187278168 +0000 UTC m=+541.849925429" watchObservedRunningTime="2026-07-22 11:32:29.189248942 +0000 UTC m=+541.851896191"
Jul 22 11:32:29.190873 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:32:29.190849    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xwmbx\" is forbidden: User \"system:node:ip-10-0-136-126.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-126.ec2.internal' and this object" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xwmbx"
Jul 22 11:32:29.737478 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:29.737448    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ff93da9-c2a1-49e1-9e44-340256231a26" path="/var/lib/kubelet/pods/3ff93da9-c2a1-49e1-9e44-340256231a26/volumes"
Jul 22 11:32:40.170557 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:40.170528    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:43.617615 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.617582    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"]
Jul 22 11:32:43.618123 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.617774    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc" podUID="35f3cead-c263-4047-8b65-8dc68bc1153a" containerName="manager" containerID="cri-o://b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8" gracePeriod=10
Jul 22 11:32:43.875463 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.875406    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:43.900815 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.900785    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"]
Jul 22 11:32:43.901253 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.901235    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35f3cead-c263-4047-8b65-8dc68bc1153a" containerName="manager"
Jul 22 11:32:43.901345 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.901254    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35f3cead-c263-4047-8b65-8dc68bc1153a" containerName="manager"
Jul 22 11:32:43.901400 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.901351    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35f3cead-c263-4047-8b65-8dc68bc1153a" containerName="manager"
Jul 22 11:32:43.904294 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.904276    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:43.926087 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.926057    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"]
Jul 22 11:32:43.938700 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.938674    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmc9d\" (UniqueName: \"kubernetes.io/projected/35f3cead-c263-4047-8b65-8dc68bc1153a-kube-api-access-qmc9d\") pod \"35f3cead-c263-4047-8b65-8dc68bc1153a\" (UID: \"35f3cead-c263-4047-8b65-8dc68bc1153a\") "
Jul 22 11:32:43.938862 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.938717    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35f3cead-c263-4047-8b65-8dc68bc1153a-extensions-socket-volume\") pod \"35f3cead-c263-4047-8b65-8dc68bc1153a\" (UID: \"35f3cead-c263-4047-8b65-8dc68bc1153a\") "
Jul 22 11:32:43.938945 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.938925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca06df52-8c5b-4146-b25e-df35d79281f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h9p9g\" (UID: \"ca06df52-8c5b-4146-b25e-df35d79281f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:43.939047 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.938952    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55szb\" (UniqueName: \"kubernetes.io/projected/ca06df52-8c5b-4146-b25e-df35d79281f8-kube-api-access-55szb\") pod \"kuadrant-operator-controller-manager-86878c769f-h9p9g\" (UID: \"ca06df52-8c5b-4146-b25e-df35d79281f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:43.939145 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.939107    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35f3cead-c263-4047-8b65-8dc68bc1153a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "35f3cead-c263-4047-8b65-8dc68bc1153a" (UID: "35f3cead-c263-4047-8b65-8dc68bc1153a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:32:43.940922 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:43.940896    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35f3cead-c263-4047-8b65-8dc68bc1153a-kube-api-access-qmc9d" (OuterVolumeSpecName: "kube-api-access-qmc9d") pod "35f3cead-c263-4047-8b65-8dc68bc1153a" (UID: "35f3cead-c263-4047-8b65-8dc68bc1153a"). InnerVolumeSpecName "kube-api-access-qmc9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:32:44.040060 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.039999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55szb\" (UniqueName: \"kubernetes.io/projected/ca06df52-8c5b-4146-b25e-df35d79281f8-kube-api-access-55szb\") pod \"kuadrant-operator-controller-manager-86878c769f-h9p9g\" (UID: \"ca06df52-8c5b-4146-b25e-df35d79281f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:44.040241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.040134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca06df52-8c5b-4146-b25e-df35d79281f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h9p9g\" (UID: \"ca06df52-8c5b-4146-b25e-df35d79281f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:44.040241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.040162    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmc9d\" (UniqueName: \"kubernetes.io/projected/35f3cead-c263-4047-8b65-8dc68bc1153a-kube-api-access-qmc9d\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:32:44.040241 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.040171    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35f3cead-c263-4047-8b65-8dc68bc1153a-extensions-socket-volume\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:32:44.040466 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.040451    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca06df52-8c5b-4146-b25e-df35d79281f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-h9p9g\" (UID: \"ca06df52-8c5b-4146-b25e-df35d79281f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:44.055647 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.055614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55szb\" (UniqueName: \"kubernetes.io/projected/ca06df52-8c5b-4146-b25e-df35d79281f8-kube-api-access-55szb\") pod \"kuadrant-operator-controller-manager-86878c769f-h9p9g\" (UID: \"ca06df52-8c5b-4146-b25e-df35d79281f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:44.214328 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.214230    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:44.233904 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.233866    2580 generic.go:356] "Generic (PLEG): container finished" podID="35f3cead-c263-4047-8b65-8dc68bc1153a" containerID="b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8" exitCode=0
Jul 22 11:32:44.234087 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.233918    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"
Jul 22 11:32:44.234087 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.233914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc" event={"ID":"35f3cead-c263-4047-8b65-8dc68bc1153a","Type":"ContainerDied","Data":"b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8"}
Jul 22 11:32:44.234087 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.234063    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc" event={"ID":"35f3cead-c263-4047-8b65-8dc68bc1153a","Type":"ContainerDied","Data":"9f20e87228ea17b8d6d8b06fb8f14c3b8d0780a2b0d9e6ff70037eec1aa834fc"}
Jul 22 11:32:44.234263 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.234093    2580 scope.go:117] "RemoveContainer" containerID="b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8"
Jul 22 11:32:44.243697 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.243680    2580 scope.go:117] "RemoveContainer" containerID="b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8"
Jul 22 11:32:44.243987 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:32:44.243969    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8\": container with ID starting with b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8 not found: ID does not exist" containerID="b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8"
Jul 22 11:32:44.244067 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.243997    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8"} err="failed to get container status \"b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8\": rpc error: code = NotFound desc = could not find container \"b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8\": container with ID starting with b732da43abc8858c74e7bf4d6cf8f1cc9f07134c7aa5f09311d0c5461acb77a8 not found: ID does not exist"
Jul 22 11:32:44.281894 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.281837    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"]
Jul 22 11:32:44.285947 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.285899    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-g9vcc"]
Jul 22 11:32:44.373612 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:44.373586    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"]
Jul 22 11:32:44.375892 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:32:44.375856    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca06df52_8c5b_4146_b25e_df35d79281f8.slice/crio-424a50da0682ab5cdd4d026461c4794abbd90e7be2a3651d4fadd295ef3c4cf4 WatchSource:0}: Error finding container 424a50da0682ab5cdd4d026461c4794abbd90e7be2a3651d4fadd295ef3c4cf4: Status 404 returned error can't find the container with id 424a50da0682ab5cdd4d026461c4794abbd90e7be2a3651d4fadd295ef3c4cf4
Jul 22 11:32:45.244201 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:45.244164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g" event={"ID":"ca06df52-8c5b-4146-b25e-df35d79281f8","Type":"ContainerStarted","Data":"c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610"}
Jul 22 11:32:45.244696 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:45.244221    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g" event={"ID":"ca06df52-8c5b-4146-b25e-df35d79281f8","Type":"ContainerStarted","Data":"424a50da0682ab5cdd4d026461c4794abbd90e7be2a3651d4fadd295ef3c4cf4"}
Jul 22 11:32:45.244696 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:45.244252    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:32:45.269741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:45.269690    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g" podStartSLOduration=2.269673876 podStartE2EDuration="2.269673876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:32:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:32:45.268181778 +0000 UTC m=+557.930829037" watchObservedRunningTime="2026-07-22 11:32:45.269673876 +0000 UTC m=+557.932321134"
Jul 22 11:32:45.736782 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:45.736751    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35f3cead-c263-4047-8b65-8dc68bc1153a" path="/var/lib/kubelet/pods/35f3cead-c263-4047-8b65-8dc68bc1153a/volumes"
Jul 22 11:32:56.252631 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:32:56.252606    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:33:15.174281 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.174247    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:33:15.177708 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.177691    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:15.181067 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.181048    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 11:33:15.181823 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.181799    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hc5sn\""
Jul 22 11:33:15.191126 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.191102    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:33:15.207156 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.207129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:33:15.222679 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.222649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c397412c-8221-4cb8-a522-97d77953b8d5-config-file\") pod \"limitador-limitador-54d6d988d5-5gvpt\" (UID: \"c397412c-8221-4cb8-a522-97d77953b8d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:15.222796 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.222683    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlxfk\" (UniqueName: \"kubernetes.io/projected/c397412c-8221-4cb8-a522-97d77953b8d5-kube-api-access-zlxfk\") pod \"limitador-limitador-54d6d988d5-5gvpt\" (UID: \"c397412c-8221-4cb8-a522-97d77953b8d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:15.323854 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.323820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c397412c-8221-4cb8-a522-97d77953b8d5-config-file\") pod \"limitador-limitador-54d6d988d5-5gvpt\" (UID: \"c397412c-8221-4cb8-a522-97d77953b8d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:15.323854 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.323856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlxfk\" (UniqueName: \"kubernetes.io/projected/c397412c-8221-4cb8-a522-97d77953b8d5-kube-api-access-zlxfk\") pod \"limitador-limitador-54d6d988d5-5gvpt\" (UID: \"c397412c-8221-4cb8-a522-97d77953b8d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:15.324493 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.324472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c397412c-8221-4cb8-a522-97d77953b8d5-config-file\") pod \"limitador-limitador-54d6d988d5-5gvpt\" (UID: \"c397412c-8221-4cb8-a522-97d77953b8d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:15.335807 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.335782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlxfk\" (UniqueName: \"kubernetes.io/projected/c397412c-8221-4cb8-a522-97d77953b8d5-kube-api-access-zlxfk\") pod \"limitador-limitador-54d6d988d5-5gvpt\" (UID: \"c397412c-8221-4cb8-a522-97d77953b8d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:15.488833 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.488746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:15.627119 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:15.627033    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:33:15.629594 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:33:15.629567    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc397412c_8221_4cb8_a522_97d77953b8d5.slice/crio-77fe79a28ff78dd01e38384525dff2f5cbbf8e2199f26c63de25b587b2281d94 WatchSource:0}: Error finding container 77fe79a28ff78dd01e38384525dff2f5cbbf8e2199f26c63de25b587b2281d94: Status 404 returned error can't find the container with id 77fe79a28ff78dd01e38384525dff2f5cbbf8e2199f26c63de25b587b2281d94
Jul 22 11:33:16.402368 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:16.402332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt" event={"ID":"c397412c-8221-4cb8-a522-97d77953b8d5","Type":"ContainerStarted","Data":"77fe79a28ff78dd01e38384525dff2f5cbbf8e2199f26c63de25b587b2281d94"}
Jul 22 11:33:19.423249 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:19.423214    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt" event={"ID":"c397412c-8221-4cb8-a522-97d77953b8d5","Type":"ContainerStarted","Data":"a0924ae0383676d53d16819f2b512e0cb6258aef554cbf1bd676136f635b065e"}
Jul 22 11:33:19.423618 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:19.423271    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:33:19.445039 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:19.444962    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt" podStartSLOduration=1.315156209 podStartE2EDuration="4.444946207s" totalImagesPullingTime="3.129789998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:33:19.444401336 +0000 UTC m=+592.107048619" watchObservedRunningTime="2026-07-22 11:33:19.444946207 +0000 UTC m=+592.107593465"
Jul 22 11:33:30.428815 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:33:30.428781    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"
Jul 22 11:34:33.337691 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.337655    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dbsx2"]
Jul 22 11:34:33.341322 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.341302    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:33.344436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.344417    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 11:34:33.344611 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.344585    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6j6lh\""
Jul 22 11:34:33.345795 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.345779    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 11:34:33.345880 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.345821    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 11:34:33.352555 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.352534    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dbsx2"]
Jul 22 11:34:33.403902 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.403867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:34:33.408606 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.408582    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8fqm\" (UniqueName: \"kubernetes.io/projected/57991e3a-2545-4b2f-a97e-4e6b40f38f16-kube-api-access-h8fqm\") pod \"payload-processing-5bf47cd988-dbsx2\" (UID: \"57991e3a-2545-4b2f-a97e-4e6b40f38f16\") " pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:33.408705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.408623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57991e3a-2545-4b2f-a97e-4e6b40f38f16-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dbsx2\" (UID: \"57991e3a-2545-4b2f-a97e-4e6b40f38f16\") " pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:33.509963 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.509917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8fqm\" (UniqueName: \"kubernetes.io/projected/57991e3a-2545-4b2f-a97e-4e6b40f38f16-kube-api-access-h8fqm\") pod \"payload-processing-5bf47cd988-dbsx2\" (UID: \"57991e3a-2545-4b2f-a97e-4e6b40f38f16\") " pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:33.510213 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.509977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57991e3a-2545-4b2f-a97e-4e6b40f38f16-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dbsx2\" (UID: \"57991e3a-2545-4b2f-a97e-4e6b40f38f16\") " pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:33.510808 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.510786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57991e3a-2545-4b2f-a97e-4e6b40f38f16-plugins-config-volume\") pod \"payload-processing-5bf47cd988-dbsx2\" (UID: \"57991e3a-2545-4b2f-a97e-4e6b40f38f16\") " pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:33.520385 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.520361    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8fqm\" (UniqueName: \"kubernetes.io/projected/57991e3a-2545-4b2f-a97e-4e6b40f38f16-kube-api-access-h8fqm\") pod \"payload-processing-5bf47cd988-dbsx2\" (UID: \"57991e3a-2545-4b2f-a97e-4e6b40f38f16\") " pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:33.652959 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.652872    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:33.800372 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:33.800341    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-dbsx2"]
Jul 22 11:34:33.803669 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:34:33.803640    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57991e3a_2545_4b2f_a97e_4e6b40f38f16.slice/crio-29bb95ff80156e5b57fec35c5a958433ecd571ba8538585b0cc0d4d2f2446c7a WatchSource:0}: Error finding container 29bb95ff80156e5b57fec35c5a958433ecd571ba8538585b0cc0d4d2f2446c7a: Status 404 returned error can't find the container with id 29bb95ff80156e5b57fec35c5a958433ecd571ba8538585b0cc0d4d2f2446c7a
Jul 22 11:34:34.792479 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:34.792394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2" event={"ID":"57991e3a-2545-4b2f-a97e-4e6b40f38f16","Type":"ContainerStarted","Data":"29bb95ff80156e5b57fec35c5a958433ecd571ba8538585b0cc0d4d2f2446c7a"}
Jul 22 11:34:35.798605 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:35.798503    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2" event={"ID":"57991e3a-2545-4b2f-a97e-4e6b40f38f16","Type":"ContainerStarted","Data":"c30fddcd60c5fe3fdebc1b4d9dc94c4897600870cf31362a8f53aa1714134bc7"}
Jul 22 11:34:35.798998 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:35.798612    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:35.818331 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:35.818275    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2" podStartSLOduration=1.182544697 podStartE2EDuration="2.818260621s" totalImagesPullingTime="1.635715924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:34:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:34:35.815984645 +0000 UTC m=+668.478631940" watchObservedRunningTime="2026-07-22 11:34:35.818260621 +0000 UTC m=+668.480907878"
Jul 22 11:34:46.805937 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:46.805905    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-dbsx2"
Jul 22 11:34:53.008826 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:34:53.008789    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:35:00.700834 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:00.700800    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:35:16.303232 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:16.303194    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:35:26.400767 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.400668    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"]
Jul 22 11:35:26.404673 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.404650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.407748 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.407723    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 11:35:26.407907 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.407845    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t5vvq\""
Jul 22 11:35:26.409031 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.408997    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 11:35:26.409159 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.409081    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 11:35:26.417120 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.417098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"]
Jul 22 11:35:26.496511 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.496452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.496695 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.496538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zvr2\" (UniqueName: \"kubernetes.io/projected/671e0fa9-0027-456e-922a-13754d6b9984-kube-api-access-9zvr2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.496695 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.496591    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/671e0fa9-0027-456e-922a-13754d6b9984-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.496695 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.496643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.496695 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.496667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.496834 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.496697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.597774 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.597730    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.597966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.597791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zvr2\" (UniqueName: \"kubernetes.io/projected/671e0fa9-0027-456e-922a-13754d6b9984-kube-api-access-9zvr2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.597966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.597836    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/671e0fa9-0027-456e-922a-13754d6b9984-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.597966 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.597862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.598191 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.597998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.598191 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.598092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.598304 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.598253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.598364 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.598327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.598483 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.598458    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.600547 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.600522    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/671e0fa9-0027-456e-922a-13754d6b9984-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.600725 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.600707    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/671e0fa9-0027-456e-922a-13754d6b9984-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.608509 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.608487    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zvr2\" (UniqueName: \"kubernetes.io/projected/671e0fa9-0027-456e-922a-13754d6b9984-kube-api-access-9zvr2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p\" (UID: \"671e0fa9-0027-456e-922a-13754d6b9984\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.716995 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.716903    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:26.862260 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.862233    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"]
Jul 22 11:35:26.864599 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:35:26.864574    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod671e0fa9_0027_456e_922a_13754d6b9984.slice/crio-f29e7539d498545720772674617109c30b0358e365a27fcba17e2e2df9e69701 WatchSource:0}: Error finding container f29e7539d498545720772674617109c30b0358e365a27fcba17e2e2df9e69701: Status 404 returned error can't find the container with id f29e7539d498545720772674617109c30b0358e365a27fcba17e2e2df9e69701
Jul 22 11:35:26.866397 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:26.866379    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 11:35:27.052098 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:27.049975    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p" event={"ID":"671e0fa9-0027-456e-922a-13754d6b9984","Type":"ContainerStarted","Data":"f29e7539d498545720772674617109c30b0358e365a27fcba17e2e2df9e69701"}
Jul 22 11:35:28.057441 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:28.057397    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p" event={"ID":"671e0fa9-0027-456e-922a-13754d6b9984","Type":"ContainerStarted","Data":"21b83b6e1c9c73318fff340b32b38f1cbed897db49b4c19a476e4b4d0a7c3277"}
Jul 22 11:35:28.079768 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:28.079721    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p" podStartSLOduration=1.041507792 podStartE2EDuration="2.079703465s" totalImagesPullingTime="1.038195673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:35:28.079507288 +0000 UTC m=+720.742154546" watchObservedRunningTime="2026-07-22 11:35:28.079703465 +0000 UTC m=+720.742350723"
Jul 22 11:35:28.112768 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:28.112732    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:35:36.717583 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:36.717541    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:36.718102 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:36.717632    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:36.730162 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:36.730134    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:37.113235 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:37.113208    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p"
Jul 22 11:35:37.609624 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:37.609593    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:35:49.202726 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.202694    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"]
Jul 22 11:35:49.206270 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.206243    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.209304 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.209281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 11:35:49.216637 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.216616    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"]
Jul 22 11:35:49.297201 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.297165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.297201 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.297206    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.297415 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.297303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.297415 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.297339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.297415 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.297355    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/105519bc-8ba3-490b-a656-095461cd98fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.297559 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.297428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g222\" (UniqueName: \"kubernetes.io/projected/105519bc-8ba3-490b-a656-095461cd98fb-kube-api-access-9g222\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.398579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.398542    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.398579 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.398584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.398806 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.398603    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/105519bc-8ba3-490b-a656-095461cd98fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.398806 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.398639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g222\" (UniqueName: \"kubernetes.io/projected/105519bc-8ba3-490b-a656-095461cd98fb-kube-api-access-9g222\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.398806 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.398680    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.398806 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.398696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.399124 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.399094    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.399249 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.399137    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.399249 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.399211    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.401066 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.401048    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/105519bc-8ba3-490b-a656-095461cd98fb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.401228 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.401213    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/105519bc-8ba3-490b-a656-095461cd98fb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.409163 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.409138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g222\" (UniqueName: \"kubernetes.io/projected/105519bc-8ba3-490b-a656-095461cd98fb-kube-api-access-9g222\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-527bs\" (UID: \"105519bc-8ba3-490b-a656-095461cd98fb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.516115 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.515995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:49.662682 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:49.662656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"]
Jul 22 11:35:49.665335 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:35:49.665307    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod105519bc_8ba3_490b_a656_095461cd98fb.slice/crio-7fc6a7f286f2bc8d67020ff23c5c1a7752fe5af99eb1dc6911573a547ff0bdc0 WatchSource:0}: Error finding container 7fc6a7f286f2bc8d67020ff23c5c1a7752fe5af99eb1dc6911573a547ff0bdc0: Status 404 returned error can't find the container with id 7fc6a7f286f2bc8d67020ff23c5c1a7752fe5af99eb1dc6911573a547ff0bdc0
Jul 22 11:35:50.167949 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:50.167859    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs" event={"ID":"105519bc-8ba3-490b-a656-095461cd98fb","Type":"ContainerStarted","Data":"c389054ae65fd64279e41560d5e51ed687076d5b7ec1b160d301487b62a59485"}
Jul 22 11:35:50.167949 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:50.167903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs" event={"ID":"105519bc-8ba3-490b-a656-095461cd98fb","Type":"ContainerStarted","Data":"7fc6a7f286f2bc8d67020ff23c5c1a7752fe5af99eb1dc6911573a547ff0bdc0"}
Jul 22 11:35:50.192133 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:50.192083    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs" podStartSLOduration=0.972114359 podStartE2EDuration="1.192065133s" totalImagesPullingTime="219.950774ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:35:50.190586007 +0000 UTC m=+742.853233266" watchObservedRunningTime="2026-07-22 11:35:50.192065133 +0000 UTC m=+742.854712391"
Jul 22 11:35:52.704662 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:52.704630    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:35:59.516688 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:59.516653    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:59.516688 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:59.516696    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:35:59.529161 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:35:59.529134    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:36:00.227420 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:36:00.227389    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-527bs"
Jul 22 11:37:47.017290 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:37:47.017251    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:37:56.199278 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:37:56.199241    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:38:07.909932 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:38:07.909896    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:39:48.799544 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:39:48.799503    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:39:56.912556 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:39:56.912515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:40:29.804280 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:40:29.804240    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:40:37.503334 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:40:37.503297    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:40:46.602539 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:40:46.602506    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:40:54.300885 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:40:54.300848    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:41:04.510316 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:41:04.510281    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:41:13.712310 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:41:13.712277    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:41:25.309554 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:41:25.309476    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:41:34.010565 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:41:34.010530    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:41:44.401692 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:41:44.401655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:41:57.905816 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:41:57.905786    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:42:09.919479 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:42:09.919449    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:42:33.807072 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:42:33.807029    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:42:44.522864 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:42:44.522830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:43:00.207433 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:43:00.207398    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:43:10.000168 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:43:10.000133    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:43:19.396020 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:43:19.395972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:43:28.904321 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:43:28.904285    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:43:35.808929 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:43:35.808895    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:44:05.157024 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:05.156970    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"]
Jul 22 11:44:05.157637 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:05.157196    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g" podUID="ca06df52-8c5b-4146-b25e-df35d79281f8" containerName="manager" containerID="cri-o://c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610" gracePeriod=10
Jul 22 11:44:07.420721 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.420694    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:44:07.526338 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.526240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca06df52-8c5b-4146-b25e-df35d79281f8-extensions-socket-volume\") pod \"ca06df52-8c5b-4146-b25e-df35d79281f8\" (UID: \"ca06df52-8c5b-4146-b25e-df35d79281f8\") "
Jul 22 11:44:07.526338 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.526302    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55szb\" (UniqueName: \"kubernetes.io/projected/ca06df52-8c5b-4146-b25e-df35d79281f8-kube-api-access-55szb\") pod \"ca06df52-8c5b-4146-b25e-df35d79281f8\" (UID: \"ca06df52-8c5b-4146-b25e-df35d79281f8\") "
Jul 22 11:44:07.526630 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.526606    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca06df52-8c5b-4146-b25e-df35d79281f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ca06df52-8c5b-4146-b25e-df35d79281f8" (UID: "ca06df52-8c5b-4146-b25e-df35d79281f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:44:07.528447 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.528421    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca06df52-8c5b-4146-b25e-df35d79281f8-kube-api-access-55szb" (OuterVolumeSpecName: "kube-api-access-55szb") pod "ca06df52-8c5b-4146-b25e-df35d79281f8" (UID: "ca06df52-8c5b-4146-b25e-df35d79281f8"). InnerVolumeSpecName "kube-api-access-55szb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:44:07.627599 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.627562    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ca06df52-8c5b-4146-b25e-df35d79281f8-extensions-socket-volume\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:44:07.627599 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.627592    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55szb\" (UniqueName: \"kubernetes.io/projected/ca06df52-8c5b-4146-b25e-df35d79281f8-kube-api-access-55szb\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:44:07.669106 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.669075    2580 generic.go:356] "Generic (PLEG): container finished" podID="ca06df52-8c5b-4146-b25e-df35d79281f8" containerID="c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610" exitCode=0
Jul 22 11:44:07.669254 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.669125    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"
Jul 22 11:44:07.669254 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.669163    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g" event={"ID":"ca06df52-8c5b-4146-b25e-df35d79281f8","Type":"ContainerDied","Data":"c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610"}
Jul 22 11:44:07.669254 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.669217    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g" event={"ID":"ca06df52-8c5b-4146-b25e-df35d79281f8","Type":"ContainerDied","Data":"424a50da0682ab5cdd4d026461c4794abbd90e7be2a3651d4fadd295ef3c4cf4"}
Jul 22 11:44:07.669254 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.669239    2580 scope.go:117] "RemoveContainer" containerID="c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610"
Jul 22 11:44:07.679452 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.679433    2580 scope.go:117] "RemoveContainer" containerID="c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610"
Jul 22 11:44:07.679729 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:44:07.679713    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610\": container with ID starting with c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610 not found: ID does not exist" containerID="c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610"
Jul 22 11:44:07.679768 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.679738    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610"} err="failed to get container status \"c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610\": rpc error: code = NotFound desc = could not find container \"c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610\": container with ID starting with c1f5e0cea097f216243f99d45898e2e1707442916d27c93e8b932796f522b610 not found: ID does not exist"
Jul 22 11:44:07.696055 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.696027    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"]
Jul 22 11:44:07.704083 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.704060    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-h9p9g"]
Jul 22 11:44:07.737730 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:44:07.737696    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca06df52-8c5b-4146-b25e-df35d79281f8" path="/var/lib/kubelet/pods/ca06df52-8c5b-4146-b25e-df35d79281f8/volumes"
Jul 22 11:45:00.154860 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.154824    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc"]
Jul 22 11:45:00.157333 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.155281    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca06df52-8c5b-4146-b25e-df35d79281f8" containerName="manager"
Jul 22 11:45:00.157333 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.155294    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca06df52-8c5b-4146-b25e-df35d79281f8" containerName="manager"
Jul 22 11:45:00.157333 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.155359    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca06df52-8c5b-4146-b25e-df35d79281f8" containerName="manager"
Jul 22 11:45:00.158318 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.158304    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc"
Jul 22 11:45:00.161530 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.161512    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 11:45:00.168800 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.168771    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc"]
Jul 22 11:45:00.169274 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.169259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc"
Jul 22 11:45:00.310270 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.310244    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc"]
Jul 22 11:45:00.312557 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:45:00.312528    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0c1775_1a7f_49ed_958f_27a5f6e3f764.slice/crio-037da9b9e1b3686f0f05eefbcceb5ad8d7fe0f6e70787244d1cd5c5a38534a56 WatchSource:0}: Error finding container 037da9b9e1b3686f0f05eefbcceb5ad8d7fe0f6e70787244d1cd5c5a38534a56: Status 404 returned error can't find the container with id 037da9b9e1b3686f0f05eefbcceb5ad8d7fe0f6e70787244d1cd5c5a38534a56
Jul 22 11:45:00.314449 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.314431    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 11:45:00.931670 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:00.931637    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc" event={"ID":"0f0c1775-1a7f-49ed-958f-27a5f6e3f764","Type":"ContainerStarted","Data":"037da9b9e1b3686f0f05eefbcceb5ad8d7fe0f6e70787244d1cd5c5a38534a56"}
Jul 22 11:45:02.944126 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:02.944035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc" event={"ID":"0f0c1775-1a7f-49ed-958f-27a5f6e3f764","Type":"ContainerStarted","Data":"a1f77ec53bf479137e91c83ca810d0a4468bd9915407c166f36e0787a59b93fc"}
Jul 22 11:45:02.965877 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:02.965828    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc" podStartSLOduration=0.96927832 podStartE2EDuration="2.965809946s" totalImagesPullingTime="1.996531626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:45:02.9653889 +0000 UTC m=+1295.628036157" watchObservedRunningTime="2026-07-22 11:45:02.965809946 +0000 UTC m=+1295.628457205"
Jul 22 11:45:03.950442 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:03.950403    2580 generic.go:356] "Generic (PLEG): container finished" podID="0f0c1775-1a7f-49ed-958f-27a5f6e3f764" containerID="a1f77ec53bf479137e91c83ca810d0a4468bd9915407c166f36e0787a59b93fc" exitCode=0
Jul 22 11:45:03.950814 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:03.950468    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc" event={"ID":"0f0c1775-1a7f-49ed-958f-27a5f6e3f764","Type":"ContainerDied","Data":"a1f77ec53bf479137e91c83ca810d0a4468bd9915407c166f36e0787a59b93fc"}
Jul 22 11:45:05.094786 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:05.094759    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc"
Jul 22 11:45:05.961778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:05.961743    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc"
Jul 22 11:45:05.961778 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:05.961748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745345-qdtzc" event={"ID":"0f0c1775-1a7f-49ed-958f-27a5f6e3f764","Type":"ContainerDied","Data":"037da9b9e1b3686f0f05eefbcceb5ad8d7fe0f6e70787244d1cd5c5a38534a56"}
Jul 22 11:45:05.962047 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:05.961792    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="037da9b9e1b3686f0f05eefbcceb5ad8d7fe0f6e70787244d1cd5c5a38534a56"
Jul 22 11:45:06.343523 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.343488    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"]
Jul 22 11:45:06.343933 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.343920    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f0c1775-1a7f-49ed-958f-27a5f6e3f764" containerName="cleanup"
Jul 22 11:45:06.343991 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.343935    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f0c1775-1a7f-49ed-958f-27a5f6e3f764" containerName="cleanup"
Jul 22 11:45:06.344057 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.344032    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f0c1775-1a7f-49ed-958f-27a5f6e3f764" containerName="cleanup"
Jul 22 11:45:06.347270 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.347254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.350299 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.350280    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5chdv\""
Jul 22 11:45:06.357759 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.357734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"]
Jul 22 11:45:06.475624 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.475587    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775wp\" (UniqueName: \"kubernetes.io/projected/3947e3ed-ddb2-4e6a-baa5-dccfd609088a-kube-api-access-775wp\") pod \"kuadrant-operator-controller-manager-86878c769f-6bh4s\" (UID: \"3947e3ed-ddb2-4e6a-baa5-dccfd609088a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.475779 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.475644    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3947e3ed-ddb2-4e6a-baa5-dccfd609088a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bh4s\" (UID: \"3947e3ed-ddb2-4e6a-baa5-dccfd609088a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.577074 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.577033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3947e3ed-ddb2-4e6a-baa5-dccfd609088a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bh4s\" (UID: \"3947e3ed-ddb2-4e6a-baa5-dccfd609088a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.577260 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.577119    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775wp\" (UniqueName: \"kubernetes.io/projected/3947e3ed-ddb2-4e6a-baa5-dccfd609088a-kube-api-access-775wp\") pod \"kuadrant-operator-controller-manager-86878c769f-6bh4s\" (UID: \"3947e3ed-ddb2-4e6a-baa5-dccfd609088a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.577439 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.577420    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3947e3ed-ddb2-4e6a-baa5-dccfd609088a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6bh4s\" (UID: \"3947e3ed-ddb2-4e6a-baa5-dccfd609088a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.590853 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.590824    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-775wp\" (UniqueName: \"kubernetes.io/projected/3947e3ed-ddb2-4e6a-baa5-dccfd609088a-kube-api-access-775wp\") pod \"kuadrant-operator-controller-manager-86878c769f-6bh4s\" (UID: \"3947e3ed-ddb2-4e6a-baa5-dccfd609088a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.657740 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.657658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.808901 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.808869    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"]
Jul 22 11:45:06.811852 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:45:06.811814    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3947e3ed_ddb2_4e6a_baa5_dccfd609088a.slice/crio-62f3abe4c9b9a270a7ed2acd9470ccb4bcb6502d8c7b1536d020722b0861bfdc WatchSource:0}: Error finding container 62f3abe4c9b9a270a7ed2acd9470ccb4bcb6502d8c7b1536d020722b0861bfdc: Status 404 returned error can't find the container with id 62f3abe4c9b9a270a7ed2acd9470ccb4bcb6502d8c7b1536d020722b0861bfdc
Jul 22 11:45:06.968608 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.968523    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s" event={"ID":"3947e3ed-ddb2-4e6a-baa5-dccfd609088a","Type":"ContainerStarted","Data":"0e21836aab0f1923681c62038690560f623f2fd572db1740f89250d1c408b545"}
Jul 22 11:45:06.968608 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.968573    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s" event={"ID":"3947e3ed-ddb2-4e6a-baa5-dccfd609088a","Type":"ContainerStarted","Data":"62f3abe4c9b9a270a7ed2acd9470ccb4bcb6502d8c7b1536d020722b0861bfdc"}
Jul 22 11:45:06.968802 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.968646    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:06.992311 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:06.992259    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s" podStartSLOduration=0.992238998 podStartE2EDuration="992.238998ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:45:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:45:06.990581302 +0000 UTC m=+1299.653228561" watchObservedRunningTime="2026-07-22 11:45:06.992238998 +0000 UTC m=+1299.654886257"
Jul 22 11:45:17.975197 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:17.975164    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6bh4s"
Jul 22 11:45:27.397915 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:27.397881    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:45:36.306864 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:36.306831    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:45:49.096262 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:45:49.096224    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:46:02.303781 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:46:02.303737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:46:11.903720 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:46:11.903682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:46:22.913763 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:46:22.913726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:46:31.709612 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:46:31.706492    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:46:42.606117 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:46:42.606080    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:46:53.508159 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:46:53.508130    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:47:02.713197 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:02.713162    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:47:13.691420 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:13.691382    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:47:34.900309 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:34.900224    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:47:44.314038 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:44.313985    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:47:58.714316 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:58.714280    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:47:59.287371 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.287331    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"]
Jul 22 11:47:59.291685 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.291658    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.294399 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.294376    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ff5dcb7e-kserve-self-signed-certs\""
Jul 22 11:47:59.303219 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.303195    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"]
Jul 22 11:47:59.361260 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.361230    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-home\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.361450 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.361266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtgv2\" (UniqueName: \"kubernetes.io/projected/f3f2974e-b56f-403d-b20f-eb3336d462ab-kube-api-access-xtgv2\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.361450 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.361336    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-dshm\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.361450 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.361426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-tmp-dir\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.361562 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.361470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2974e-b56f-403d-b20f-eb3336d462ab-tls-certs\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.361562 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.361515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-model-cache\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462032 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.461966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-home\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462032 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.462029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtgv2\" (UniqueName: \"kubernetes.io/projected/f3f2974e-b56f-403d-b20f-eb3336d462ab-kube-api-access-xtgv2\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462291 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.462083    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-dshm\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462291 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.462123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-tmp-dir\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462291 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.462145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2974e-b56f-403d-b20f-eb3336d462ab-tls-certs\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462291 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.462193    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-model-cache\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462513 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.462367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-home\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462513 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.462503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-tmp-dir\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.462594 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.462578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-model-cache\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.464438 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.464414    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-dshm\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.464689 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.464670    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2974e-b56f-403d-b20f-eb3336d462ab-tls-certs\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.472329 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.472301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtgv2\" (UniqueName: \"kubernetes.io/projected/f3f2974e-b56f-403d-b20f-eb3336d462ab-kube-api-access-xtgv2\") pod \"e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") " pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.602126 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.602092    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:47:59.747423 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.747392    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"]
Jul 22 11:47:59.750960 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:47:59.750927    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3f2974e_b56f_403d_b20f_eb3336d462ab.slice/crio-61d9432c1296e81fc7754a48e8491cd253cd791c6d624f988d57d4a44a026d80 WatchSource:0}: Error finding container 61d9432c1296e81fc7754a48e8491cd253cd791c6d624f988d57d4a44a026d80: Status 404 returned error can't find the container with id 61d9432c1296e81fc7754a48e8491cd253cd791c6d624f988d57d4a44a026d80
Jul 22 11:47:59.861765 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.861684    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb" event={"ID":"f3f2974e-b56f-403d-b20f-eb3336d462ab","Type":"ContainerStarted","Data":"1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79"}
Jul 22 11:47:59.861765 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:47:59.861730    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb" event={"ID":"f3f2974e-b56f-403d-b20f-eb3336d462ab","Type":"ContainerStarted","Data":"61d9432c1296e81fc7754a48e8491cd253cd791c6d624f988d57d4a44a026d80"}
Jul 22 11:48:09.602908 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:09.602859    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:48:09.603351 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:09.602940    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:48:09.615557 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:09.615522    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:48:09.643201 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:09.643152    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb" podStartSLOduration=10.643136432 podStartE2EDuration="10.643136432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:47:59.881661036 +0000 UTC m=+1472.544308295" watchObservedRunningTime="2026-07-22 11:48:09.643136432 +0000 UTC m=+1482.305783690"
Jul 22 11:48:09.925998 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:09.925903    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:48:10.106229 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:10.106195    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:48:38.300000 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:38.299963    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:48:38.642377 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:38.642342    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"]
Jul 22 11:48:48.697479 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:48.697443    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:48:53.663127 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:53.663085    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb" podUID="f3f2974e-b56f-403d-b20f-eb3336d462ab" containerName="main" containerID="cri-o://1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79" gracePeriod=45
Jul 22 11:48:53.926039 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:53.925938    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:48:54.072747 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.072710    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2974e-b56f-403d-b20f-eb3336d462ab-tls-certs\") pod \"f3f2974e-b56f-403d-b20f-eb3336d462ab\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") "
Jul 22 11:48:54.072988 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.072800    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-home\") pod \"f3f2974e-b56f-403d-b20f-eb3336d462ab\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") "
Jul 22 11:48:54.072988 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.072836    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtgv2\" (UniqueName: \"kubernetes.io/projected/f3f2974e-b56f-403d-b20f-eb3336d462ab-kube-api-access-xtgv2\") pod \"f3f2974e-b56f-403d-b20f-eb3336d462ab\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") "
Jul 22 11:48:54.072988 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.072874    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-model-cache\") pod \"f3f2974e-b56f-403d-b20f-eb3336d462ab\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") "
Jul 22 11:48:54.072988 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.072905    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-dshm\") pod \"f3f2974e-b56f-403d-b20f-eb3336d462ab\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") "
Jul 22 11:48:54.073250 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.073041    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-tmp-dir\") pod \"f3f2974e-b56f-403d-b20f-eb3336d462ab\" (UID: \"f3f2974e-b56f-403d-b20f-eb3336d462ab\") "
Jul 22 11:48:54.073250 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.073094    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-home" (OuterVolumeSpecName: "home") pod "f3f2974e-b56f-403d-b20f-eb3336d462ab" (UID: "f3f2974e-b56f-403d-b20f-eb3336d462ab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:48:54.073250 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.073195    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-model-cache" (OuterVolumeSpecName: "model-cache") pod "f3f2974e-b56f-403d-b20f-eb3336d462ab" (UID: "f3f2974e-b56f-403d-b20f-eb3336d462ab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:48:54.073415 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.073268    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f3f2974e-b56f-403d-b20f-eb3336d462ab" (UID: "f3f2974e-b56f-403d-b20f-eb3336d462ab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:48:54.073415 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.073380    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:48:54.073415 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.073393    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:48:54.073415 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.073408    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:48:54.075226 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.075202    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-dshm" (OuterVolumeSpecName: "dshm") pod "f3f2974e-b56f-403d-b20f-eb3336d462ab" (UID: "f3f2974e-b56f-403d-b20f-eb3336d462ab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:48:54.075340 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.075254    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3f2974e-b56f-403d-b20f-eb3336d462ab-kube-api-access-xtgv2" (OuterVolumeSpecName: "kube-api-access-xtgv2") pod "f3f2974e-b56f-403d-b20f-eb3336d462ab" (UID: "f3f2974e-b56f-403d-b20f-eb3336d462ab"). InnerVolumeSpecName "kube-api-access-xtgv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:48:54.075340 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.075321    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3f2974e-b56f-403d-b20f-eb3336d462ab-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f3f2974e-b56f-403d-b20f-eb3336d462ab" (UID: "f3f2974e-b56f-403d-b20f-eb3336d462ab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:48:54.131717 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.131680    2580 generic.go:356] "Generic (PLEG): container finished" podID="f3f2974e-b56f-403d-b20f-eb3336d462ab" containerID="1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79" exitCode=0
Jul 22 11:48:54.131906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.131731    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"
Jul 22 11:48:54.131906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.131762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb" event={"ID":"f3f2974e-b56f-403d-b20f-eb3336d462ab","Type":"ContainerDied","Data":"1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79"}
Jul 22 11:48:54.131906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.131804    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb" event={"ID":"f3f2974e-b56f-403d-b20f-eb3336d462ab","Type":"ContainerDied","Data":"61d9432c1296e81fc7754a48e8491cd253cd791c6d624f988d57d4a44a026d80"}
Jul 22 11:48:54.131906 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.131825    2580 scope.go:117] "RemoveContainer" containerID="1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79"
Jul 22 11:48:54.141905 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.141876    2580 scope.go:117] "RemoveContainer" containerID="1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79"
Jul 22 11:48:54.142267 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:48:54.142243    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79\": container with ID starting with 1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79 not found: ID does not exist" containerID="1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79"
Jul 22 11:48:54.142369 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.142275    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79"} err="failed to get container status \"1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79\": rpc error: code = NotFound desc = could not find container \"1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79\": container with ID starting with 1cf9d4452b93df684d08e93102fa30774d2725336295f0b9bb00c11262d8de79 not found: ID does not exist"
Jul 22 11:48:54.156397 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.156369    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"]
Jul 22 11:48:54.164134 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.164111    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ff5dcb7e-kserve-86c58b7f79-9r7pb"]
Jul 22 11:48:54.174425 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.174404    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3f2974e-b56f-403d-b20f-eb3336d462ab-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:48:54.174425 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.174427    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtgv2\" (UniqueName: \"kubernetes.io/projected/f3f2974e-b56f-403d-b20f-eb3336d462ab-kube-api-access-xtgv2\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:48:54.174561 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:54.174436    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3f2974e-b56f-403d-b20f-eb3336d462ab-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:48:55.738298 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:55.738268    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3f2974e-b56f-403d-b20f-eb3336d462ab" path="/var/lib/kubelet/pods/f3f2974e-b56f-403d-b20f-eb3336d462ab/volumes"
Jul 22 11:48:59.903441 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:48:59.903408    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:49:15.807266 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:49:15.807222    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:49:25.398446 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:49:25.398408    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:49:34.800039 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:49:34.799991    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:49:45.600401 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:49:45.600367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:49:54.504592 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:49:54.504560    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:50:04.001190 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:50:04.001157    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:50:17.915278 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:50:17.915243    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:50:27.306332 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:50:27.306294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:50:36.607817 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:50:36.607782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:50:49.503255 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:50:49.503220    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:51:01.200219 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:51:01.200183    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:51:10.110101 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:51:10.110066    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:51:22.716309 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:51:22.716274    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:51:35.098633 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:51:35.098592    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:51:45.911313 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:51:45.911276    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:52:00.201833 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:52:00.201794    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:52:09.397128 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:52:09.397090    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:52:19.302288 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:52:19.302249    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:52:30.109282 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:52:30.109249    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:53:02.600132 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:02.600101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:53:15.100891 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:15.100850    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:53:36.096351 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.096312    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"]
Jul 22 11:53:36.096770 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.096707    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3f2974e-b56f-403d-b20f-eb3336d462ab" containerName="main"
Jul 22 11:53:36.096770 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.096718    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3f2974e-b56f-403d-b20f-eb3336d462ab" containerName="main"
Jul 22 11:53:36.096841 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.096795    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3f2974e-b56f-403d-b20f-eb3336d462ab" containerName="main"
Jul 22 11:53:36.099761 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.099746    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"
Jul 22 11:53:36.102549 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.102529    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 11:53:36.102638 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.102613    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 11:53:36.113410 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.113382    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"]
Jul 22 11:53:36.177238 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.177195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8\" (UID: \"218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"
Jul 22 11:53:36.277977 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.277943    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8\" (UID: \"218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"
Jul 22 11:53:36.278622 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.278596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8\" (UID: \"218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"
Jul 22 11:53:36.410747 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.410646    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"
Jul 22 11:53:36.554407 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.554307    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"]
Jul 22 11:53:36.557128 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:53:36.557091    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218c9c4d_6a51_46eb_9f01_2a0a6e5be1d8.slice/crio-7d203f0d89b3bd8f18f3d41cb1cf25177988290fd2fa6ff9d3b2f5096ab2510f WatchSource:0}: Error finding container 7d203f0d89b3bd8f18f3d41cb1cf25177988290fd2fa6ff9d3b2f5096ab2510f: Status 404 returned error can't find the container with id 7d203f0d89b3bd8f18f3d41cb1cf25177988290fd2fa6ff9d3b2f5096ab2510f
Jul 22 11:53:36.570390 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:36.570364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8" event={"ID":"218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8","Type":"ContainerStarted","Data":"7d203f0d89b3bd8f18f3d41cb1cf25177988290fd2fa6ff9d3b2f5096ab2510f"}
Jul 22 11:53:37.576793 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:37.576754    2580 generic.go:356] "Generic (PLEG): container finished" podID="218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8" containerID="7a2026429a158f2336d74292581f97dcecd7df619e6eaf9a29a0bfb84c13a67e" exitCode=0
Jul 22 11:53:37.577195 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:37.576819    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8" event={"ID":"218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8","Type":"ContainerDied","Data":"7a2026429a158f2336d74292581f97dcecd7df619e6eaf9a29a0bfb84c13a67e"}
Jul 22 11:53:38.717641 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:38.717612    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"
Jul 22 11:53:38.801901 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:38.801865    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8-maas-api-service-ca\") pod \"218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8\" (UID: \"218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8\") "
Jul 22 11:53:38.802278 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:38.802255    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8" (UID: "218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:53:38.903558 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:38.903471    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8-maas-api-service-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:53:39.588042 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:39.587987    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"
Jul 22 11:53:39.588042 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:39.588037    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8" event={"ID":"218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8","Type":"ContainerDied","Data":"7d203f0d89b3bd8f18f3d41cb1cf25177988290fd2fa6ff9d3b2f5096ab2510f"}
Jul 22 11:53:39.588254 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:39.588088    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d203f0d89b3bd8f18f3d41cb1cf25177988290fd2fa6ff9d3b2f5096ab2510f"
Jul 22 11:53:49.705882 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:49.705841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:53:51.240963 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:51.240927    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"]
Jul 22 11:53:51.244978 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:51.244952    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d8c0f9e9-kzqn8"]
Jul 22 11:53:51.737587 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:53:51.737553    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8" path="/var/lib/kubelet/pods/218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8/volumes"
Jul 22 11:54:01.110599 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:54:01.110561    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:54:34.501711 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:54:34.501673    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:54:43.517799 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:54:43.517765    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:55:05.368750 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.368714    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"]
Jul 22 11:55:05.371298 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.369166    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8" containerName="revoke-keys"
Jul 22 11:55:05.371298 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.369179    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8" containerName="revoke-keys"
Jul 22 11:55:05.371298 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.369244    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="218c9c4d-6a51-46eb-9f01-2a0a6e5be1d8" containerName="revoke-keys"
Jul 22 11:55:05.372436 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.372420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"
Jul 22 11:55:05.375550 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.375530    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 11:55:05.375658 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.375631    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 11:55:05.382121 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.382098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"]
Jul 22 11:55:05.428440 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.428406    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f00ab5-e6fb-42cb-945a-80f3d41f5498-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9906803d-gvght\" (UID: \"57f00ab5-e6fb-42cb-945a-80f3d41f5498\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"
Jul 22 11:55:05.529312 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.529268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f00ab5-e6fb-42cb-945a-80f3d41f5498-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9906803d-gvght\" (UID: \"57f00ab5-e6fb-42cb-945a-80f3d41f5498\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"
Jul 22 11:55:05.529895 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.529874    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f00ab5-e6fb-42cb-945a-80f3d41f5498-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9906803d-gvght\" (UID: \"57f00ab5-e6fb-42cb-945a-80f3d41f5498\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"
Jul 22 11:55:05.683494 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.683406    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"
Jul 22 11:55:05.822319 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:05.822294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"]
Jul 22 11:55:05.824418 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:55:05.824385    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f00ab5_e6fb_42cb_945a_80f3d41f5498.slice/crio-433affe549cc9526c190ee1e572cdcf155346835cd474c4a5489c22f40abd82c WatchSource:0}: Error finding container 433affe549cc9526c190ee1e572cdcf155346835cd474c4a5489c22f40abd82c: Status 404 returned error can't find the container with id 433affe549cc9526c190ee1e572cdcf155346835cd474c4a5489c22f40abd82c
Jul 22 11:55:06.028058 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:06.027963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght" event={"ID":"57f00ab5-e6fb-42cb-945a-80f3d41f5498","Type":"ContainerStarted","Data":"433affe549cc9526c190ee1e572cdcf155346835cd474c4a5489c22f40abd82c"}
Jul 22 11:55:07.034519 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:07.034482    2580 generic.go:356] "Generic (PLEG): container finished" podID="57f00ab5-e6fb-42cb-945a-80f3d41f5498" containerID="e57108bdd34bd60e422fe5267d536b24acbfca3648e76f7733ace1f85745b4a3" exitCode=0
Jul 22 11:55:07.034909 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:07.034579    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght" event={"ID":"57f00ab5-e6fb-42cb-945a-80f3d41f5498","Type":"ContainerDied","Data":"e57108bdd34bd60e422fe5267d536b24acbfca3648e76f7733ace1f85745b4a3"}
Jul 22 11:55:08.179393 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:08.179368    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"
Jul 22 11:55:08.252693 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:08.252664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f00ab5-e6fb-42cb-945a-80f3d41f5498-maas-api-service-ca\") pod \"57f00ab5-e6fb-42cb-945a-80f3d41f5498\" (UID: \"57f00ab5-e6fb-42cb-945a-80f3d41f5498\") "
Jul 22 11:55:08.253119 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:08.253092    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57f00ab5-e6fb-42cb-945a-80f3d41f5498-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57f00ab5-e6fb-42cb-945a-80f3d41f5498" (UID: "57f00ab5-e6fb-42cb-945a-80f3d41f5498"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:55:08.353823 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:08.353788    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57f00ab5-e6fb-42cb-945a-80f3d41f5498-maas-api-service-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:55:09.051897 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:09.051867    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"
Jul 22 11:55:09.051897 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:09.051875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght" event={"ID":"57f00ab5-e6fb-42cb-945a-80f3d41f5498","Type":"ContainerDied","Data":"433affe549cc9526c190ee1e572cdcf155346835cd474c4a5489c22f40abd82c"}
Jul 22 11:55:09.052128 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:09.051956    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="433affe549cc9526c190ee1e572cdcf155346835cd474c4a5489c22f40abd82c"
Jul 22 11:55:18.998048 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:18.997979    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:55:20.465839 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:20.465804    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"]
Jul 22 11:55:20.469570 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:20.469543    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9906803d-gvght"]
Jul 22 11:55:21.737942 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:55:21.737909    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57f00ab5-e6fb-42cb-945a-80f3d41f5498" path="/var/lib/kubelet/pods/57f00ab5-e6fb-42cb-945a-80f3d41f5498/volumes"
Jul 22 11:56:26.453453 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.453416    2580 generic.go:356] "Generic (PLEG): container finished" podID="b46b2061-7dc7-4d8f-bdd9-282466b7a2e5" containerID="5f27551215a493b6ab60fead2f35b118de1b875641c84f26b54bbec867a8680e" exitCode=1
Jul 22 11:56:26.453946 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.453498    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf" event={"ID":"b46b2061-7dc7-4d8f-bdd9-282466b7a2e5","Type":"ContainerDied","Data":"5f27551215a493b6ab60fead2f35b118de1b875641c84f26b54bbec867a8680e"}
Jul 22 11:56:26.453946 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.453869    2580 scope.go:117] "RemoveContainer" containerID="5f27551215a493b6ab60fead2f35b118de1b875641c84f26b54bbec867a8680e"
Jul 22 11:56:26.455333 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.455274    2580 generic.go:356] "Generic (PLEG): container finished" podID="3f9bce89-eea1-48af-8119-d0f2ea2ed5ec" containerID="b13b02c36cdca4d6970c0cd402bcd4ea31c637d1c98d0bfb26fbf26ff5ad2eec" exitCode=1
Jul 22 11:56:26.455422 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.455344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m" event={"ID":"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec","Type":"ContainerDied","Data":"b13b02c36cdca4d6970c0cd402bcd4ea31c637d1c98d0bfb26fbf26ff5ad2eec"}
Jul 22 11:56:26.455618 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.455605    2580 scope.go:117] "RemoveContainer" containerID="b13b02c36cdca4d6970c0cd402bcd4ea31c637d1c98d0bfb26fbf26ff5ad2eec"
Jul 22 11:56:26.455877 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.455866    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 11:56:26.458211 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.458185    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 22 11:56:26.652234 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:26.652202    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:56:27.048818 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:27.048782    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:56:27.462739 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:27.462692    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf" event={"ID":"b46b2061-7dc7-4d8f-bdd9-282466b7a2e5","Type":"ContainerStarted","Data":"8a00709e3c13ca20fee8eae53476b8348a6b19537a6304e20e7f90faaa3fa680"}
Jul 22 11:56:27.463149 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:27.462782    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:56:29.474039 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:29.473979    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m" event={"ID":"3f9bce89-eea1-48af-8119-d0f2ea2ed5ec","Type":"ContainerStarted","Data":"2fd5f6a2c31b01e48930578446a06445a974762893200a70c34f4751e31ad6e7"}
Jul 22 11:56:29.474462 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:29.474104    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:56:38.469696 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:38.469660    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bb5lf"
Jul 22 11:56:49.104075 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:56:49.104032    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:57:00.531566 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:00.531519    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-f7f7m"
Jul 22 11:57:01.605255 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:01.605219    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:57:13.101267 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:13.101217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:57:19.298793 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.298757    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"]
Jul 22 11:57:19.299211 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.299191    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57f00ab5-e6fb-42cb-945a-80f3d41f5498" containerName="revoke-keys"
Jul 22 11:57:19.299211 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.299202    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="57f00ab5-e6fb-42cb-945a-80f3d41f5498" containerName="revoke-keys"
Jul 22 11:57:19.299293 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.299263    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="57f00ab5-e6fb-42cb-945a-80f3d41f5498" containerName="revoke-keys"
Jul 22 11:57:19.302580 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.302561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"
Jul 22 11:57:19.305624 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.305598    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 11:57:19.305754 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.305638    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 11:57:19.310535 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.310498    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"]
Jul 22 11:57:19.470659 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.470623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91b1b95-37b5-4337-ae0a-cfdeada246a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8709147b-25vf4\" (UID: \"e91b1b95-37b5-4337-ae0a-cfdeada246a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"
Jul 22 11:57:19.572258 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.572225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91b1b95-37b5-4337-ae0a-cfdeada246a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8709147b-25vf4\" (UID: \"e91b1b95-37b5-4337-ae0a-cfdeada246a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"
Jul 22 11:57:19.572876 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.572856    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91b1b95-37b5-4337-ae0a-cfdeada246a9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8709147b-25vf4\" (UID: \"e91b1b95-37b5-4337-ae0a-cfdeada246a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"
Jul 22 11:57:19.614448 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.614396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"
Jul 22 11:57:19.761453 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:19.761419    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"]
Jul 22 11:57:19.763809 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:57:19.763778    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91b1b95_37b5_4337_ae0a_cfdeada246a9.slice/crio-aa6a72a983e44ef21f62ca1dcf0ad1004db4d9871b2be89124338a2a161d6d9a WatchSource:0}: Error finding container aa6a72a983e44ef21f62ca1dcf0ad1004db4d9871b2be89124338a2a161d6d9a: Status 404 returned error can't find the container with id aa6a72a983e44ef21f62ca1dcf0ad1004db4d9871b2be89124338a2a161d6d9a
Jul 22 11:57:20.746956 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:20.746866    2580 generic.go:356] "Generic (PLEG): container finished" podID="e91b1b95-37b5-4337-ae0a-cfdeada246a9" containerID="47e359b9aa2ccee1a24192055b9cfb78a8feacc5d2c0ac91d28480b4e9ce4204" exitCode=0
Jul 22 11:57:20.747336 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:20.746951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4" event={"ID":"e91b1b95-37b5-4337-ae0a-cfdeada246a9","Type":"ContainerDied","Data":"47e359b9aa2ccee1a24192055b9cfb78a8feacc5d2c0ac91d28480b4e9ce4204"}
Jul 22 11:57:20.747336 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:20.746998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4" event={"ID":"e91b1b95-37b5-4337-ae0a-cfdeada246a9","Type":"ContainerStarted","Data":"aa6a72a983e44ef21f62ca1dcf0ad1004db4d9871b2be89124338a2a161d6d9a"}
Jul 22 11:57:21.891695 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:21.891669    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"
Jul 22 11:57:21.994360 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:21.994286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91b1b95-37b5-4337-ae0a-cfdeada246a9-maas-api-service-ca\") pod \"e91b1b95-37b5-4337-ae0a-cfdeada246a9\" (UID: \"e91b1b95-37b5-4337-ae0a-cfdeada246a9\") "
Jul 22 11:57:21.994741 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:21.994715    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e91b1b95-37b5-4337-ae0a-cfdeada246a9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e91b1b95-37b5-4337-ae0a-cfdeada246a9" (UID: "e91b1b95-37b5-4337-ae0a-cfdeada246a9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 11:57:22.095256 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:22.095219    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e91b1b95-37b5-4337-ae0a-cfdeada246a9-maas-api-service-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:57:22.758143 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:22.758113    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"
Jul 22 11:57:22.758143 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:22.758141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4" event={"ID":"e91b1b95-37b5-4337-ae0a-cfdeada246a9","Type":"ContainerDied","Data":"aa6a72a983e44ef21f62ca1dcf0ad1004db4d9871b2be89124338a2a161d6d9a"}
Jul 22 11:57:22.758358 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:22.758180    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa6a72a983e44ef21f62ca1dcf0ad1004db4d9871b2be89124338a2a161d6d9a"
Jul 22 11:57:32.902236 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:32.902198    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:57:34.400951 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:34.400918    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"]
Jul 22 11:57:34.404609 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:34.404583    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8709147b-25vf4"]
Jul 22 11:57:35.737263 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:57:35.737232    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e91b1b95-37b5-4337-ae0a-cfdeada246a9" path="/var/lib/kubelet/pods/e91b1b95-37b5-4337-ae0a-cfdeada246a9/volumes"
Jul 22 11:58:10.303845 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:10.303806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:58:16.823646 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.823610    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"]
Jul 22 11:58:16.824170 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.824035    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e91b1b95-37b5-4337-ae0a-cfdeada246a9" containerName="revoke-keys"
Jul 22 11:58:16.824170 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.824050    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e91b1b95-37b5-4337-ae0a-cfdeada246a9" containerName="revoke-keys"
Jul 22 11:58:16.824170 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.824139    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e91b1b95-37b5-4337-ae0a-cfdeada246a9" containerName="revoke-keys"
Jul 22 11:58:16.827238 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.827223    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:16.830146 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.830123    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-98b5a8b0\"/\"openshift-service-ca.crt\""
Jul 22 11:58:16.831465 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.831441    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-98b5a8b0\"/\"default-dockercfg-khl7j\""
Jul 22 11:58:16.831678 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.831511    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-98b5a8b0\"/\"kube-root-ca.crt\""
Jul 22 11:58:16.831678 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.831672    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-98b5a8b0\"/\"e2e-lifecycle-model-98b5a8b0-kserve-self-signed-certs\""
Jul 22 11:58:16.837356 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:16.837334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"]
Jul 22 11:58:17.008255 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.008213    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-model-cache\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.008255 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.008256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tmp-dir\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.008489 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.008287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tls-certs\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.008489 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.008315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-home\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.008489 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.008358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-dshm\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.008489 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.008459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d94s8\" (UniqueName: \"kubernetes.io/projected/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-kube-api-access-d94s8\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110027 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.109917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-model-cache\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110027 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.109955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tmp-dir\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110027 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.109974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tls-certs\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110373 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.110029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-home\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110373 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.110070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-dshm\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110373 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.110142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d94s8\" (UniqueName: \"kubernetes.io/projected/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-kube-api-access-d94s8\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110526 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.110412    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-model-cache\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110526 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.110428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tmp-dir\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.110632 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.110593    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-home\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.112540 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.112520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-dshm\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.112701 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.112684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tls-certs\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.122127 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.122105    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d94s8\" (UniqueName: \"kubernetes.io/projected/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-kube-api-access-d94s8\") pod \"e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") " pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.137796 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.137764    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:17.296046 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:17.296017    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"]
Jul 22 11:58:17.297827 ip-10-0-136-126 kubenswrapper[2580]: W0722 11:58:17.297800    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf428a90d_4bb3_4bc9_8551_bad9dcfe3f0f.slice/crio-d2b8492ef9cc77ca4e4872a83058b3f8c87c692332f5b76f071a7e371552d67b WatchSource:0}: Error finding container d2b8492ef9cc77ca4e4872a83058b3f8c87c692332f5b76f071a7e371552d67b: Status 404 returned error can't find the container with id d2b8492ef9cc77ca4e4872a83058b3f8c87c692332f5b76f071a7e371552d67b
Jul 22 11:58:18.046410 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:18.046373    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7" event={"ID":"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f","Type":"ContainerStarted","Data":"b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f"}
Jul 22 11:58:18.046410 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:18.046417    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7" event={"ID":"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f","Type":"ContainerStarted","Data":"d2b8492ef9cc77ca4e4872a83058b3f8c87c692332f5b76f071a7e371552d67b"}
Jul 22 11:58:18.088039 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:18.087967    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7" podStartSLOduration=2.0879501129999998 podStartE2EDuration="2.087950113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 11:58:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 11:58:18.086349407 +0000 UTC m=+2090.748996667" watchObservedRunningTime="2026-07-22 11:58:18.087950113 +0000 UTC m=+2090.750597362"
Jul 22 11:58:22.005696 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:22.005658    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:58:25.837964 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:25.837925    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-z25mq" podUID="04424bd6-9ee4-41be-b934-f966eb467d50" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 11:58:25.838607 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:25.838579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:58:25.839298 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:25.839272    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="kube-system/konnectivity-agent-z25mq" podUID="04424bd6-9ee4-41be-b934-f966eb467d50" containerName="konnectivity-agent" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 22 11:58:27.138902 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:27.138871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:27.139358 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:27.138915    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:27.151953 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:27.151926    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:28.111080 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:28.111052    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:58:49.907755 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:49.907717    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:58:55.840389 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:58:55.840361    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z25mq"
Jul 22 11:59:07.406618 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:07.406585    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:59:16.598705 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:16.598667    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 11:59:20.855464 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:20.855381    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"]
Jul 22 11:59:35.876686 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:35.876618    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7" podUID="f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" containerName="main" containerID="cri-o://b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f" gracePeriod=45
Jul 22 11:59:36.131947 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.131888    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:59:36.240272 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240240    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tmp-dir\") pod \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") "
Jul 22 11:59:36.240464 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240282    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-dshm\") pod \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") "
Jul 22 11:59:36.240464 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240313    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d94s8\" (UniqueName: \"kubernetes.io/projected/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-kube-api-access-d94s8\") pod \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") "
Jul 22 11:59:36.240464 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240357    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tls-certs\") pod \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") "
Jul 22 11:59:36.240464 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240425    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-model-cache\") pod \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") "
Jul 22 11:59:36.240685 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240506    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-home\") pod \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\" (UID: \"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f\") "
Jul 22 11:59:36.240685 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240566    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" (UID: "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:59:36.241071 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240750    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-model-cache" (OuterVolumeSpecName: "model-cache") pod "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" (UID: "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:59:36.241071 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240799    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-home" (OuterVolumeSpecName: "home") pod "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" (UID: "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:59:36.241071 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.240817    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:59:36.242770 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.242746    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-dshm" (OuterVolumeSpecName: "dshm") pod "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" (UID: "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 11:59:36.243134 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.243112    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" (UID: "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 11:59:36.243134 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.243123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-kube-api-access-d94s8" (OuterVolumeSpecName: "kube-api-access-d94s8") pod "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" (UID: "f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f"). InnerVolumeSpecName "kube-api-access-d94s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 11:59:36.341843 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.341807    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:59:36.341843 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.341837    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:59:36.341843 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.341848    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d94s8\" (UniqueName: \"kubernetes.io/projected/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-kube-api-access-d94s8\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:59:36.342131 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.341859    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:59:36.342131 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.341868    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 11:59:36.459998 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.459901    2580 generic.go:356] "Generic (PLEG): container finished" podID="f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" containerID="b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f" exitCode=0
Jul 22 11:59:36.459998 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.459949    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"
Jul 22 11:59:36.460262 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.459991    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7" event={"ID":"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f","Type":"ContainerDied","Data":"b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f"}
Jul 22 11:59:36.460262 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.460064    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7" event={"ID":"f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f","Type":"ContainerDied","Data":"d2b8492ef9cc77ca4e4872a83058b3f8c87c692332f5b76f071a7e371552d67b"}
Jul 22 11:59:36.460262 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.460086    2580 scope.go:117] "RemoveContainer" containerID="b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f"
Jul 22 11:59:36.469683 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.469668    2580 scope.go:117] "RemoveContainer" containerID="b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f"
Jul 22 11:59:36.469953 ip-10-0-136-126 kubenswrapper[2580]: E0722 11:59:36.469936    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f\": container with ID starting with b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f not found: ID does not exist" containerID="b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f"
Jul 22 11:59:36.470032 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.469962    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f"} err="failed to get container status \"b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f\": rpc error: code = NotFound desc = could not find container \"b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f\": container with ID starting with b7276962d596010752e9bc8d4ecb226af1e5c427ca7a2b12fe2cd27fc695f52f not found: ID does not exist"
Jul 22 11:59:36.485025 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.484977    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"]
Jul 22 11:59:36.490669 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:36.490644    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-98b5a8b0/e2e-lifecycle-model-98b5a8b0-kserve-55fd7585f9-vstg7"]
Jul 22 11:59:37.739121 ip-10-0-136-126 kubenswrapper[2580]: I0722 11:59:37.739086    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" path="/var/lib/kubelet/pods/f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f/volumes"
Jul 22 12:00:00.144958 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.144928    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q"]
Jul 22 12:00:00.145434 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.145351    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" containerName="main"
Jul 22 12:00:00.145434 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.145362    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" containerName="main"
Jul 22 12:00:00.145510 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.145458    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f428a90d-4bb3-4bc9-8551-bad9dcfe3f0f" containerName="main"
Jul 22 12:00:00.149848 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.149833    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q"
Jul 22 12:00:00.156512 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.154431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 12:00:00.166227 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.166207    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q"
Jul 22 12:00:00.169490 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.169469    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q"]
Jul 22 12:00:00.310601 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.310575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q"]
Jul 22 12:00:00.312814 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:00:00.312769    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba97201_3994_4b2b_868d_c8439182d22d.slice/crio-c981d13fcce4ee5a35df4542d584c7e4f974286ad1736f887134949f0f9fe077 WatchSource:0}: Error finding container c981d13fcce4ee5a35df4542d584c7e4f974286ad1736f887134949f0f9fe077: Status 404 returned error can't find the container with id c981d13fcce4ee5a35df4542d584c7e4f974286ad1736f887134949f0f9fe077
Jul 22 12:00:00.592170 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:00.592133    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q" event={"ID":"fba97201-3994-4b2b-868d-c8439182d22d","Type":"ContainerStarted","Data":"c981d13fcce4ee5a35df4542d584c7e4f974286ad1736f887134949f0f9fe077"}
Jul 22 12:00:01.599107 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:01.599070    2580 generic.go:356] "Generic (PLEG): container finished" podID="fba97201-3994-4b2b-868d-c8439182d22d" containerID="2ccd32f3177ea0c6c29fe662bc3953724cc8a2a0e4b6d2989975509ce4f85d7e" exitCode=0
Jul 22 12:00:01.599489 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:01.599160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q" event={"ID":"fba97201-3994-4b2b-868d-c8439182d22d","Type":"ContainerDied","Data":"2ccd32f3177ea0c6c29fe662bc3953724cc8a2a0e4b6d2989975509ce4f85d7e"}
Jul 22 12:00:02.740968 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:02.740935    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q"
Jul 22 12:00:03.611784 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:03.611760    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q"
Jul 22 12:00:03.611972 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:03.611763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29745360-vrk4q" event={"ID":"fba97201-3994-4b2b-868d-c8439182d22d","Type":"ContainerDied","Data":"c981d13fcce4ee5a35df4542d584c7e4f974286ad1736f887134949f0f9fe077"}
Jul 22 12:00:03.611972 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:03.611877    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c981d13fcce4ee5a35df4542d584c7e4f974286ad1736f887134949f0f9fe077"
Jul 22 12:00:09.113111 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:09.113077    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:00:19.200737 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:19.200697    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:00:27.926086 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:00:27.926055    2580 scope.go:117] "RemoveContainer" containerID="7a2026429a158f2336d74292581f97dcecd7df619e6eaf9a29a0bfb84c13a67e"
Jul 22 12:01:12.606256 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:12.606218    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:01:21.092361 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:21.092324    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:01:27.954910 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:27.954876    2580 scope.go:117] "RemoveContainer" containerID="e57108bdd34bd60e422fe5267d536b24acbfca3648e76f7733ace1f85745b4a3"
Jul 22 12:01:35.700241 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.700207    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"]
Jul 22 12:01:35.700642 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.700627    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fba97201-3994-4b2b-868d-c8439182d22d" containerName="cleanup"
Jul 22 12:01:35.700686 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.700644    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fba97201-3994-4b2b-868d-c8439182d22d" containerName="cleanup"
Jul 22 12:01:35.700721 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.700717    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fba97201-3994-4b2b-868d-c8439182d22d" containerName="cleanup"
Jul 22 12:01:35.704314 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.704299    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.708864 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.708841    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4750a4\"/\"test-model-4750a4-kserve-self-signed-certs\""
Jul 22 12:01:35.709031 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.708863    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4750a4\"/\"default-dockercfg-z52nl\""
Jul 22 12:01:35.709031 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.708891    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4750a4\"/\"kube-root-ca.crt\""
Jul 22 12:01:35.709031 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.708925    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4750a4\"/\"openshift-service-ca.crt\""
Jul 22 12:01:35.715825 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.715799    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"]
Jul 22 12:01:35.738948 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.738921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-dshm\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.739134 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.738967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjbs5\" (UniqueName: \"kubernetes.io/projected/4326df0e-506a-4056-963f-4ce7b45080b4-kube-api-access-rjbs5\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.739134 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.739000    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-home\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.739134 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.739049    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-model-cache\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.739134 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.739085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4326df0e-506a-4056-963f-4ce7b45080b4-tls-certs\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.739271 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.739159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-tmp-dir\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840105 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840070    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-dshm\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840286 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjbs5\" (UniqueName: \"kubernetes.io/projected/4326df0e-506a-4056-963f-4ce7b45080b4-kube-api-access-rjbs5\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840286 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-home\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840286 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840177    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-model-cache\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840286 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4326df0e-506a-4056-963f-4ce7b45080b4-tls-certs\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840286 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840282    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-tmp-dir\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840694 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-tmp-dir\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840849 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840749    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-model-cache\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.840970 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.840906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-home\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.842627 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.842603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-dshm\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.843219 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.843195    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4326df0e-506a-4056-963f-4ce7b45080b4-tls-certs\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:35.852525 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:35.852501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjbs5\" (UniqueName: \"kubernetes.io/projected/4326df0e-506a-4056-963f-4ce7b45080b4-kube-api-access-rjbs5\") pod \"test-model-4750a4-kserve-78dcd975f5-zszkz\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") " pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:36.014269 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:36.014183    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:36.156103 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:36.156079    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"]
Jul 22 12:01:36.158734 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:01:36.158703    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4326df0e_506a_4056_963f_4ce7b45080b4.slice/crio-00773739956c4d04bb5622c748a57c33c62204ef346dd1dd229cf7029fa6fed9 WatchSource:0}: Error finding container 00773739956c4d04bb5622c748a57c33c62204ef346dd1dd229cf7029fa6fed9: Status 404 returned error can't find the container with id 00773739956c4d04bb5622c748a57c33c62204ef346dd1dd229cf7029fa6fed9
Jul 22 12:01:37.104351 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:37.104307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz" event={"ID":"4326df0e-506a-4056-963f-4ce7b45080b4","Type":"ContainerStarted","Data":"9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711"}
Jul 22 12:01:37.104746 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:37.104363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz" event={"ID":"4326df0e-506a-4056-963f-4ce7b45080b4","Type":"ContainerStarted","Data":"00773739956c4d04bb5622c748a57c33c62204ef346dd1dd229cf7029fa6fed9"}
Jul 22 12:01:37.125398 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:37.125346    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz" podStartSLOduration=2.125331645 podStartE2EDuration="2.125331645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:01:37.123098296 +0000 UTC m=+2289.785745576" watchObservedRunningTime="2026-07-22 12:01:37.125331645 +0000 UTC m=+2289.787978918"
Jul 22 12:01:39.728832 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:39.728795    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:01:46.015235 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:46.015192    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:46.015736 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:46.015249    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:46.027743 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:46.027712    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:46.165230 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:46.165203    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:01:52.401311 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:52.401270    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:01:59.737843 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.737809    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"]
Jul 22 12:01:59.742523 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.742506    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.745450 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.745419    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-aa23a9\"/\"kube-root-ca.crt\""
Jul 22 12:01:59.745588 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.745571    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-aa23a9\"/\"default-dockercfg-zzbbv\""
Jul 22 12:01:59.745665 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.745573    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-aa23a9\"/\"openshift-service-ca.crt\""
Jul 22 12:01:59.746896 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.746870    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-aa23a9\"/\"test-model-aa23a9-kserve-self-signed-certs\""
Jul 22 12:01:59.749265 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.749244    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"]
Jul 22 12:01:59.878623 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.878594    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tls-certs\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.878808 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.878643    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-model-cache\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.878808 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.878740    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-home\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.878905 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.878833    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95nvm\" (UniqueName: \"kubernetes.io/projected/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-kube-api-access-95nvm\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.878973 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.878946    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-dshm\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.879087 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.878992    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tmp-dir\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980281 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-dshm\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980281 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tmp-dir\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980530 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980318    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tls-certs\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980530 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-model-cache\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980649 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980567    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-home\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980707 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95nvm\" (UniqueName: \"kubernetes.io/projected/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-kube-api-access-95nvm\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980792 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980765    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tmp-dir\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980849 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980802    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-model-cache\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.980928 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.980907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-home\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.982888 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.982866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tls-certs\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.982992 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.982885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-dshm\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:01:59.993757 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:01:59.993699    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95nvm\" (UniqueName: \"kubernetes.io/projected/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-kube-api-access-95nvm\") pod \"test-model-aa23a9-kserve-594bf67b55-rhw2b\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") " pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:02:00.053717 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:00.053674    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:02:00.200894 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:00.200867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"]
Jul 22 12:02:00.203521 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:02:00.203497    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6ed9c40_5d76_4d3b_99fb_c637e79b4f6e.slice/crio-7e78104a6b5b7c3e179e1d90893097e3dc97a312499278d4fbdf963152e1458f WatchSource:0}: Error finding container 7e78104a6b5b7c3e179e1d90893097e3dc97a312499278d4fbdf963152e1458f: Status 404 returned error can't find the container with id 7e78104a6b5b7c3e179e1d90893097e3dc97a312499278d4fbdf963152e1458f
Jul 22 12:02:00.229923 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:00.229896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b" event={"ID":"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e","Type":"ContainerStarted","Data":"7e78104a6b5b7c3e179e1d90893097e3dc97a312499278d4fbdf963152e1458f"}
Jul 22 12:02:01.237587 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:01.237550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b" event={"ID":"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e","Type":"ContainerStarted","Data":"ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3"}
Jul 22 12:02:01.262426 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:01.262354    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b" podStartSLOduration=2.26233352 podStartE2EDuration="2.26233352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:02:01.259043999 +0000 UTC m=+2313.921691271" watchObservedRunningTime="2026-07-22 12:02:01.26233352 +0000 UTC m=+2313.924980778"
Jul 22 12:02:03.300448 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:03.300412    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:02:10.054637 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:10.054601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:02:10.055069 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:10.054655    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:02:10.067511 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:10.067480    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:02:10.295213 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:10.295182    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:02:20.394812 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:20.394740    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:02:39.648746 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:39.648705    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"]
Jul 22 12:02:40.636296 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.636252    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"]
Jul 22 12:02:40.765018 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.764969    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"]
Jul 22 12:02:40.768863 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.768846    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"
Jul 22 12:02:40.771748 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.771723    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 12:02:40.771748 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.771740    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 12:02:40.778443 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.778414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"]
Jul 22 12:02:40.855140 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.855095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f4d1d8-32a8-45d5-8b02-dd89711d9daa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx\" (UID: \"23f4d1d8-32a8-45d5-8b02-dd89711d9daa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"
Jul 22 12:02:40.956743 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.956643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f4d1d8-32a8-45d5-8b02-dd89711d9daa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx\" (UID: \"23f4d1d8-32a8-45d5-8b02-dd89711d9daa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"
Jul 22 12:02:40.957267 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:40.957247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f4d1d8-32a8-45d5-8b02-dd89711d9daa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx\" (UID: \"23f4d1d8-32a8-45d5-8b02-dd89711d9daa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"
Jul 22 12:02:41.080453 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:41.080418    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"
Jul 22 12:02:41.433459 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:41.433436    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"]
Jul 22 12:02:41.435464 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:02:41.435433    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f4d1d8_32a8_45d5_8b02_dd89711d9daa.slice/crio-527c56654160b63ad11a497c43f846569a253969bdf4e241916d0007e99c9317 WatchSource:0}: Error finding container 527c56654160b63ad11a497c43f846569a253969bdf4e241916d0007e99c9317: Status 404 returned error can't find the container with id 527c56654160b63ad11a497c43f846569a253969bdf4e241916d0007e99c9317
Jul 22 12:02:41.448762 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:41.448734    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx" event={"ID":"23f4d1d8-32a8-45d5-8b02-dd89711d9daa","Type":"ContainerStarted","Data":"527c56654160b63ad11a497c43f846569a253969bdf4e241916d0007e99c9317"}
Jul 22 12:02:42.455141 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:42.455103    2580 generic.go:356] "Generic (PLEG): container finished" podID="23f4d1d8-32a8-45d5-8b02-dd89711d9daa" containerID="3b173b3074de4eebec0fff9c01af1c8102b6379f214a38362a739727e156691a" exitCode=0
Jul 22 12:02:42.455513 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:42.455188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx" event={"ID":"23f4d1d8-32a8-45d5-8b02-dd89711d9daa","Type":"ContainerDied","Data":"3b173b3074de4eebec0fff9c01af1c8102b6379f214a38362a739727e156691a"}
Jul 22 12:02:43.601749 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:43.601723    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"
Jul 22 12:02:43.682052 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:43.681971    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f4d1d8-32a8-45d5-8b02-dd89711d9daa-maas-api-service-ca\") pod \"23f4d1d8-32a8-45d5-8b02-dd89711d9daa\" (UID: \"23f4d1d8-32a8-45d5-8b02-dd89711d9daa\") "
Jul 22 12:02:43.682337 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:43.682313    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23f4d1d8-32a8-45d5-8b02-dd89711d9daa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23f4d1d8-32a8-45d5-8b02-dd89711d9daa" (UID: "23f4d1d8-32a8-45d5-8b02-dd89711d9daa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:02:43.783021 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:43.782983    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23f4d1d8-32a8-45d5-8b02-dd89711d9daa-maas-api-service-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:44.466278 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:44.466251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"
Jul 22 12:02:44.466278 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:44.466259    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx" event={"ID":"23f4d1d8-32a8-45d5-8b02-dd89711d9daa","Type":"ContainerDied","Data":"527c56654160b63ad11a497c43f846569a253969bdf4e241916d0007e99c9317"}
Jul 22 12:02:44.466495 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:44.466306    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="527c56654160b63ad11a497c43f846569a253969bdf4e241916d0007e99c9317"
Jul 22 12:02:44.994656 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:44.994625    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:02:54.669958 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.669916    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz" podUID="4326df0e-506a-4056-963f-4ce7b45080b4" containerName="main" containerID="cri-o://9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711" gracePeriod=45
Jul 22 12:02:54.917132 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.917106    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:02:54.986669 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.986579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-tmp-dir\") pod \"4326df0e-506a-4056-963f-4ce7b45080b4\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") "
Jul 22 12:02:54.986669 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.986624    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjbs5\" (UniqueName: \"kubernetes.io/projected/4326df0e-506a-4056-963f-4ce7b45080b4-kube-api-access-rjbs5\") pod \"4326df0e-506a-4056-963f-4ce7b45080b4\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") "
Jul 22 12:02:54.986669 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.986659    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-home\") pod \"4326df0e-506a-4056-963f-4ce7b45080b4\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") "
Jul 22 12:02:54.986934 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.986690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-dshm\") pod \"4326df0e-506a-4056-963f-4ce7b45080b4\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") "
Jul 22 12:02:54.986934 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.986884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4326df0e-506a-4056-963f-4ce7b45080b4-tls-certs\") pod \"4326df0e-506a-4056-963f-4ce7b45080b4\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") "
Jul 22 12:02:54.987063 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.986888    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4326df0e-506a-4056-963f-4ce7b45080b4" (UID: "4326df0e-506a-4056-963f-4ce7b45080b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:02:54.987063 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.986941    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-home" (OuterVolumeSpecName: "home") pod "4326df0e-506a-4056-963f-4ce7b45080b4" (UID: "4326df0e-506a-4056-963f-4ce7b45080b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:02:54.987264 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.987240    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:54.987264 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.987267    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:54.989120 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.989092    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4326df0e-506a-4056-963f-4ce7b45080b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4326df0e-506a-4056-963f-4ce7b45080b4" (UID: "4326df0e-506a-4056-963f-4ce7b45080b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:02:54.989120 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.989109    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-dshm" (OuterVolumeSpecName: "dshm") pod "4326df0e-506a-4056-963f-4ce7b45080b4" (UID: "4326df0e-506a-4056-963f-4ce7b45080b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:02:54.989264 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:54.989175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4326df0e-506a-4056-963f-4ce7b45080b4-kube-api-access-rjbs5" (OuterVolumeSpecName: "kube-api-access-rjbs5") pod "4326df0e-506a-4056-963f-4ce7b45080b4" (UID: "4326df0e-506a-4056-963f-4ce7b45080b4"). InnerVolumeSpecName "kube-api-access-rjbs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:02:55.088427 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.088383    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-model-cache\") pod \"4326df0e-506a-4056-963f-4ce7b45080b4\" (UID: \"4326df0e-506a-4056-963f-4ce7b45080b4\") "
Jul 22 12:02:55.088664 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.088646    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4326df0e-506a-4056-963f-4ce7b45080b4-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:55.088739 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.088672    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjbs5\" (UniqueName: \"kubernetes.io/projected/4326df0e-506a-4056-963f-4ce7b45080b4-kube-api-access-rjbs5\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:55.088739 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.088685    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:55.088739 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.088649    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "4326df0e-506a-4056-963f-4ce7b45080b4" (UID: "4326df0e-506a-4056-963f-4ce7b45080b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:02:55.189719 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.189687    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4326df0e-506a-4056-963f-4ce7b45080b4-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:55.529489 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.529452    2580 generic.go:356] "Generic (PLEG): container finished" podID="4326df0e-506a-4056-963f-4ce7b45080b4" containerID="9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711" exitCode=0
Jul 22 12:02:55.529679 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.529497    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"
Jul 22 12:02:55.529679 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.529509    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz" event={"ID":"4326df0e-506a-4056-963f-4ce7b45080b4","Type":"ContainerDied","Data":"9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711"}
Jul 22 12:02:55.529679 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.529541    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz" event={"ID":"4326df0e-506a-4056-963f-4ce7b45080b4","Type":"ContainerDied","Data":"00773739956c4d04bb5622c748a57c33c62204ef346dd1dd229cf7029fa6fed9"}
Jul 22 12:02:55.529679 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.529558    2580 scope.go:117] "RemoveContainer" containerID="9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711"
Jul 22 12:02:55.540365 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.540345    2580 scope.go:117] "RemoveContainer" containerID="9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711"
Jul 22 12:02:55.540728 ip-10-0-136-126 kubenswrapper[2580]: E0722 12:02:55.540707    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711\": container with ID starting with 9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711 not found: ID does not exist" containerID="9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711"
Jul 22 12:02:55.540778 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.540738    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711"} err="failed to get container status \"9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711\": rpc error: code = NotFound desc = could not find container \"9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711\": container with ID starting with 9388149f4e1a7a762712f24046d22401d5fe044076fc15645064e2cd4a966711 not found: ID does not exist"
Jul 22 12:02:55.557932 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.557894    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"]
Jul 22 12:02:55.562639 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.562613    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4750a4/test-model-4750a4-kserve-78dcd975f5-zszkz"]
Jul 22 12:02:55.656819 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.656771    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b" podUID="f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" containerName="main" containerID="cri-o://ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3" gracePeriod=45
Jul 22 12:02:55.739460 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.739424    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4326df0e-506a-4056-963f-4ce7b45080b4" path="/var/lib/kubelet/pods/4326df0e-506a-4056-963f-4ce7b45080b4/volumes"
Jul 22 12:02:55.904722 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.904694    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"]
Jul 22 12:02:55.908412 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.908388    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4750a4-25dwx"]
Jul 22 12:02:55.908544 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.908462    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:02:55.996417 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996377    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-model-cache\") pod \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") "
Jul 22 12:02:55.996623 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996446    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-home\") pod \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") "
Jul 22 12:02:55.996623 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996487    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tls-certs\") pod \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") "
Jul 22 12:02:55.996623 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996511    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tmp-dir\") pod \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") "
Jul 22 12:02:55.996623 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996530    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-dshm\") pod \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") "
Jul 22 12:02:55.996623 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996600    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95nvm\" (UniqueName: \"kubernetes.io/projected/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-kube-api-access-95nvm\") pod \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\" (UID: \"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e\") "
Jul 22 12:02:55.996869 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996762    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-model-cache" (OuterVolumeSpecName: "model-cache") pod "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" (UID: "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:02:55.996869 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996766    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-home" (OuterVolumeSpecName: "home") pod "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" (UID: "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:02:55.996869 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996793    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" (UID: "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:02:55.996976 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996909    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:55.996976 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996924    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:55.996976 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.996934    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:55.999029 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.998982    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-dshm" (OuterVolumeSpecName: "dshm") pod "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" (UID: "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:02:55.999150 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.999000    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-kube-api-access-95nvm" (OuterVolumeSpecName: "kube-api-access-95nvm") pod "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" (UID: "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e"). InnerVolumeSpecName "kube-api-access-95nvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:02:55.999150 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:55.999058    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" (UID: "f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:02:56.098150 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.098071    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:56.098150 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.098095    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:56.098150 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.098106    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95nvm\" (UniqueName: \"kubernetes.io/projected/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e-kube-api-access-95nvm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:02:56.537238 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.537143    2580 generic.go:356] "Generic (PLEG): container finished" podID="f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" containerID="ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3" exitCode=0
Jul 22 12:02:56.537423 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.537249    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"
Jul 22 12:02:56.537423 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.537264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b" event={"ID":"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e","Type":"ContainerDied","Data":"ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3"}
Jul 22 12:02:56.537423 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.537305    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b" event={"ID":"f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e","Type":"ContainerDied","Data":"7e78104a6b5b7c3e179e1d90893097e3dc97a312499278d4fbdf963152e1458f"}
Jul 22 12:02:56.537423 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.537329    2580 scope.go:117] "RemoveContainer" containerID="ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3"
Jul 22 12:02:56.547724 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.547702    2580 scope.go:117] "RemoveContainer" containerID="ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3"
Jul 22 12:02:56.548071 ip-10-0-136-126 kubenswrapper[2580]: E0722 12:02:56.548052    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3\": container with ID starting with ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3 not found: ID does not exist" containerID="ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3"
Jul 22 12:02:56.548119 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.548081    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3"} err="failed to get container status \"ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3\": rpc error: code = NotFound desc = could not find container \"ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3\": container with ID starting with ec2bcd6b0f0bfbc5b569323b6514f94ba37c7cf3b239b673db513e6e0e6a88c3 not found: ID does not exist"
Jul 22 12:02:56.562478 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.562446    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"]
Jul 22 12:02:56.571718 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:56.571691    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-aa23a9/test-model-aa23a9-kserve-594bf67b55-rhw2b"]
Jul 22 12:02:57.737976 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:57.737938    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23f4d1d8-32a8-45d5-8b02-dd89711d9daa" path="/var/lib/kubelet/pods/23f4d1d8-32a8-45d5-8b02-dd89711d9daa/volumes"
Jul 22 12:02:57.738376 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:02:57.738364    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" path="/var/lib/kubelet/pods/f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e/volumes"
Jul 22 12:03:00.106872 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:00.106840    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:03:03.919522 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.919487    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"]
Jul 22 12:03:03.919936 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.919877    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f4d1d8-32a8-45d5-8b02-dd89711d9daa" containerName="revoke-keys"
Jul 22 12:03:03.919936 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.919889    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f4d1d8-32a8-45d5-8b02-dd89711d9daa" containerName="revoke-keys"
Jul 22 12:03:03.919936 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.919898    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4326df0e-506a-4056-963f-4ce7b45080b4" containerName="main"
Jul 22 12:03:03.919936 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.919904    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4326df0e-506a-4056-963f-4ce7b45080b4" containerName="main"
Jul 22 12:03:03.919936 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.919931    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" containerName="main"
Jul 22 12:03:03.919936 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.919936    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" containerName="main"
Jul 22 12:03:03.920199 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.919993    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4326df0e-506a-4056-963f-4ce7b45080b4" containerName="main"
Jul 22 12:03:03.920199 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.920016    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ed9c40-5d76-4d3b-99fb-c637e79b4f6e" containerName="main"
Jul 22 12:03:03.920199 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.920023    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f4d1d8-32a8-45d5-8b02-dd89711d9daa" containerName="revoke-keys"
Jul 22 12:03:03.923080 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.923064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"
Jul 22 12:03:03.925786 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.925763    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 12:03:03.925910 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.925855    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 12:03:03.934264 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.934237    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"]
Jul 22 12:03:03.975521 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:03.975489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb64e40-d2e7-4e91-a253-caac02b4f242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq\" (UID: \"bdb64e40-d2e7-4e91-a253-caac02b4f242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"
Jul 22 12:03:04.076987 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:04.076948    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb64e40-d2e7-4e91-a253-caac02b4f242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq\" (UID: \"bdb64e40-d2e7-4e91-a253-caac02b4f242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"
Jul 22 12:03:04.077566 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:04.077546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb64e40-d2e7-4e91-a253-caac02b4f242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq\" (UID: \"bdb64e40-d2e7-4e91-a253-caac02b4f242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"
Jul 22 12:03:04.234158 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:04.234057    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"
Jul 22 12:03:04.380478 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:04.378604    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"]
Jul 22 12:03:04.382482 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:03:04.382432    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdb64e40_d2e7_4e91_a253_caac02b4f242.slice/crio-c289548df2687c6a6699e49faf1e8fc53f3700d2fb8d6b3665ec0b5bf6b76001 WatchSource:0}: Error finding container c289548df2687c6a6699e49faf1e8fc53f3700d2fb8d6b3665ec0b5bf6b76001: Status 404 returned error can't find the container with id c289548df2687c6a6699e49faf1e8fc53f3700d2fb8d6b3665ec0b5bf6b76001
Jul 22 12:03:04.582307 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:04.582268    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq" event={"ID":"bdb64e40-d2e7-4e91-a253-caac02b4f242","Type":"ContainerStarted","Data":"c289548df2687c6a6699e49faf1e8fc53f3700d2fb8d6b3665ec0b5bf6b76001"}
Jul 22 12:03:05.591391 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:05.591355    2580 generic.go:356] "Generic (PLEG): container finished" podID="bdb64e40-d2e7-4e91-a253-caac02b4f242" containerID="0423a518d5235e4a6bbb493b777a7de19685fbb484275aa8a8ade322744317c7" exitCode=0
Jul 22 12:03:05.591808 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:05.591446    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq" event={"ID":"bdb64e40-d2e7-4e91-a253-caac02b4f242","Type":"ContainerDied","Data":"0423a518d5235e4a6bbb493b777a7de19685fbb484275aa8a8ade322744317c7"}
Jul 22 12:03:06.739162 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:06.739133    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"
Jul 22 12:03:06.805673 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:06.805642    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb64e40-d2e7-4e91-a253-caac02b4f242-maas-api-service-ca\") pod \"bdb64e40-d2e7-4e91-a253-caac02b4f242\" (UID: \"bdb64e40-d2e7-4e91-a253-caac02b4f242\") "
Jul 22 12:03:06.806060 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:06.806040    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdb64e40-d2e7-4e91-a253-caac02b4f242-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bdb64e40-d2e7-4e91-a253-caac02b4f242" (UID: "bdb64e40-d2e7-4e91-a253-caac02b4f242"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:03:06.906841 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:06.906752    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdb64e40-d2e7-4e91-a253-caac02b4f242-maas-api-service-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:03:07.605066 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:07.605035    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"
Jul 22 12:03:07.605066 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:07.605055    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq" event={"ID":"bdb64e40-d2e7-4e91-a253-caac02b4f242","Type":"ContainerDied","Data":"c289548df2687c6a6699e49faf1e8fc53f3700d2fb8d6b3665ec0b5bf6b76001"}
Jul 22 12:03:07.605282 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:07.605107    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c289548df2687c6a6699e49faf1e8fc53f3700d2fb8d6b3665ec0b5bf6b76001"
Jul 22 12:03:17.509435 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:17.509399    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:03:19.019845 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:19.019808    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"]
Jul 22 12:03:19.023594 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:19.023568    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-aa23a9-q7wpq"]
Jul 22 12:03:19.738751 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:19.738717    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdb64e40-d2e7-4e91-a253-caac02b4f242" path="/var/lib/kubelet/pods/bdb64e40-d2e7-4e91-a253-caac02b4f242/volumes"
Jul 22 12:03:27.982235 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:27.982208    2580 scope.go:117] "RemoveContainer" containerID="47e359b9aa2ccee1a24192055b9cfb78a8feacc5d2c0ac91d28480b4e9ce4204"
Jul 22 12:03:36.027072 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:36.027024    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:03:45.215991 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:03:45.215952    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:04:09.804950 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:09.804914    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:04:19.742158 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.742122    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"]
Jul 22 12:04:19.742650 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.742632    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdb64e40-d2e7-4e91-a253-caac02b4f242" containerName="revoke-keys"
Jul 22 12:04:19.742698 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.742653    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdb64e40-d2e7-4e91-a253-caac02b4f242" containerName="revoke-keys"
Jul 22 12:04:19.742734 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.742724    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdb64e40-d2e7-4e91-a253-caac02b4f242" containerName="revoke-keys"
Jul 22 12:04:19.745913 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.745897    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"
Jul 22 12:04:19.748522 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.748503    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 12:04:19.748768 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.748749    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 12:04:19.753443 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.753416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"]
Jul 22 12:04:19.872120 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.872083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6916b486-8c16-43fd-b416-9fcabf860115-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f39058-f269f\" (UID: \"6916b486-8c16-43fd-b416-9fcabf860115\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"
Jul 22 12:04:19.973129 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.973095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6916b486-8c16-43fd-b416-9fcabf860115-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f39058-f269f\" (UID: \"6916b486-8c16-43fd-b416-9fcabf860115\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"
Jul 22 12:04:19.973742 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:19.973721    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6916b486-8c16-43fd-b416-9fcabf860115-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f39058-f269f\" (UID: \"6916b486-8c16-43fd-b416-9fcabf860115\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"
Jul 22 12:04:20.059077 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:20.058962    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"
Jul 22 12:04:20.202958 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:20.202928    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"]
Jul 22 12:04:20.205735 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:04:20.205709    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6916b486_8c16_43fd_b416_9fcabf860115.slice/crio-3be1657d2e3a7e0777b096fff8ee0e11d989a56c9994a169fec4fc1dd8bd2e1a WatchSource:0}: Error finding container 3be1657d2e3a7e0777b096fff8ee0e11d989a56c9994a169fec4fc1dd8bd2e1a: Status 404 returned error can't find the container with id 3be1657d2e3a7e0777b096fff8ee0e11d989a56c9994a169fec4fc1dd8bd2e1a
Jul 22 12:04:20.989730 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:20.989691    2580 generic.go:356] "Generic (PLEG): container finished" podID="6916b486-8c16-43fd-b416-9fcabf860115" containerID="47c31ddc680140e23b9410455fd661e9184d3561db6a49bfc23276e17e53786a" exitCode=0
Jul 22 12:04:20.990185 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:20.989747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f" event={"ID":"6916b486-8c16-43fd-b416-9fcabf860115","Type":"ContainerDied","Data":"47c31ddc680140e23b9410455fd661e9184d3561db6a49bfc23276e17e53786a"}
Jul 22 12:04:20.990185 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:20.989790    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f" event={"ID":"6916b486-8c16-43fd-b416-9fcabf860115","Type":"ContainerStarted","Data":"3be1657d2e3a7e0777b096fff8ee0e11d989a56c9994a169fec4fc1dd8bd2e1a"}
Jul 22 12:04:22.142123 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:22.142096    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"
Jul 22 12:04:22.292911 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:22.292824    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6916b486-8c16-43fd-b416-9fcabf860115-maas-api-service-ca\") pod \"6916b486-8c16-43fd-b416-9fcabf860115\" (UID: \"6916b486-8c16-43fd-b416-9fcabf860115\") "
Jul 22 12:04:22.293221 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:22.293195    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6916b486-8c16-43fd-b416-9fcabf860115-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6916b486-8c16-43fd-b416-9fcabf860115" (UID: "6916b486-8c16-43fd-b416-9fcabf860115"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:04:22.394493 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:22.394459    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6916b486-8c16-43fd-b416-9fcabf860115-maas-api-service-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:04:23.004561 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:23.004534    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"
Jul 22 12:04:23.004759 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:23.004579    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f" event={"ID":"6916b486-8c16-43fd-b416-9fcabf860115","Type":"ContainerDied","Data":"3be1657d2e3a7e0777b096fff8ee0e11d989a56c9994a169fec4fc1dd8bd2e1a"}
Jul 22 12:04:23.004759 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:23.004633    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3be1657d2e3a7e0777b096fff8ee0e11d989a56c9994a169fec4fc1dd8bd2e1a"
Jul 22 12:04:39.859996 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:39.859960    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"]
Jul 22 12:04:39.864182 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:39.864143    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f39058-f269f"]
Jul 22 12:04:39.908212 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:39.908178    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:04:41.737994 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:41.737947    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6916b486-8c16-43fd-b416-9fcabf860115" path="/var/lib/kubelet/pods/6916b486-8c16-43fd-b416-9fcabf860115/volumes"
Jul 22 12:04:58.594702 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:04:58.594667    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:05:09.500073 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:09.500034    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:05:16.500307 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.500272    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"]
Jul 22 12:05:16.500712 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.500674    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6916b486-8c16-43fd-b416-9fcabf860115" containerName="revoke-keys"
Jul 22 12:05:16.500712 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.500684    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6916b486-8c16-43fd-b416-9fcabf860115" containerName="revoke-keys"
Jul 22 12:05:16.500784 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.500757    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6916b486-8c16-43fd-b416-9fcabf860115" containerName="revoke-keys"
Jul 22 12:05:16.503921 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.503905    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.508122 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.508095    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"kube-root-ca.crt\""
Jul 22 12:05:16.508122 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.508116    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"openshift-service-ca.crt\""
Jul 22 12:05:16.508335 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.508098    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"auth-test-model-fc3650-kserve-self-signed-certs\""
Jul 22 12:05:16.508335 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.508096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"default-dockercfg-m4fbn\""
Jul 22 12:05:16.514145 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.514122    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"]
Jul 22 12:05:16.585123 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.585091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c813aee3-68b0-43e5-a05a-f701ad3430b0-tls-certs\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.585339 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.585141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-home\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.585339 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.585180    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-tmp-dir\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.585339 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.585225    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck6jz\" (UniqueName: \"kubernetes.io/projected/c813aee3-68b0-43e5-a05a-f701ad3430b0-kube-api-access-ck6jz\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.585339 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.585260    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-dshm\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.585339 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.585277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-model-cache\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.685868 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.685825    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-home\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.686119 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.685883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-tmp-dir\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.686119 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.685929    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck6jz\" (UniqueName: \"kubernetes.io/projected/c813aee3-68b0-43e5-a05a-f701ad3430b0-kube-api-access-ck6jz\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.686119 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.685967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-dshm\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.686119 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.685998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-model-cache\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.686119 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.686110    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c813aee3-68b0-43e5-a05a-f701ad3430b0-tls-certs\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.686343 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.686283    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-home\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.686343 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.686311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-tmp-dir\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.686531 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.686513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-model-cache\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.688506 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.688483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-dshm\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.688645 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.688628    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c813aee3-68b0-43e5-a05a-f701ad3430b0-tls-certs\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.698641 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.698613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck6jz\" (UniqueName: \"kubernetes.io/projected/c813aee3-68b0-43e5-a05a-f701ad3430b0-kube-api-access-ck6jz\") pod \"auth-test-model-fc3650-kserve-98d6c47-6r9r8\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") " pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.814211 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.814130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:16.957641 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:16.957614    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"]
Jul 22 12:05:16.959575 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:05:16.959548    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc813aee3_68b0_43e5_a05a_f701ad3430b0.slice/crio-a8fe74bc14549afcebfa94a40142a227be4af19d5202b45fedd9dc15731ec146 WatchSource:0}: Error finding container a8fe74bc14549afcebfa94a40142a227be4af19d5202b45fedd9dc15731ec146: Status 404 returned error can't find the container with id a8fe74bc14549afcebfa94a40142a227be4af19d5202b45fedd9dc15731ec146
Jul 22 12:05:17.303048 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:17.302984    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8" event={"ID":"c813aee3-68b0-43e5-a05a-f701ad3430b0","Type":"ContainerStarted","Data":"5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462"}
Jul 22 12:05:17.303265 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:17.303073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8" event={"ID":"c813aee3-68b0-43e5-a05a-f701ad3430b0","Type":"ContainerStarted","Data":"a8fe74bc14549afcebfa94a40142a227be4af19d5202b45fedd9dc15731ec146"}
Jul 22 12:05:17.325629 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:17.325573    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8" podStartSLOduration=1.325557175 podStartE2EDuration="1.325557175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:05:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:05:17.32518161 +0000 UTC m=+2509.987828869" watchObservedRunningTime="2026-07-22 12:05:17.325557175 +0000 UTC m=+2509.988204433"
Jul 22 12:05:21.106482 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:21.106399    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:05:26.814937 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:26.814900    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:26.815357 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:26.814954    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:26.827469 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:26.827437    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:27.367757 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:27.367725    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:05:43.504355 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.504323    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"]
Jul 22 12:05:43.507951 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.507935    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.510987 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.510943    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"openshift-service-ca.crt\""
Jul 22 12:05:43.512406 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.512383    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"default-dockercfg-prfcr\""
Jul 22 12:05:43.512519 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.512416    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"auth-test-model-ae7383-kserve-self-signed-certs\""
Jul 22 12:05:43.512519 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.512421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"kube-root-ca.crt\""
Jul 22 12:05:43.517167 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.517143    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"]
Jul 22 12:05:43.627112 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.627081    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-dshm\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.627308 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.627124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b26dc23b-d7de-4950-848c-459c19c51801-tls-certs\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.627308 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.627146    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-home\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.627308 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.627207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-model-cache\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.627308 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.627240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-tmp-dir\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.627513 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.627303    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nl4w\" (UniqueName: \"kubernetes.io/projected/b26dc23b-d7de-4950-848c-459c19c51801-kube-api-access-8nl4w\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.728341 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-dshm\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.728515 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b26dc23b-d7de-4950-848c-459c19c51801-tls-certs\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.728515 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728474    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-home\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.728654 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-model-cache\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.728654 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728578    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-tmp-dir\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.728654 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728611    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nl4w\" (UniqueName: \"kubernetes.io/projected/b26dc23b-d7de-4950-848c-459c19c51801-kube-api-access-8nl4w\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.728869 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728838    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-home\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.729031 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-tmp-dir\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.729031 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.728917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-model-cache\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.730805 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.730783    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-dshm\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.731088 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.731071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b26dc23b-d7de-4950-848c-459c19c51801-tls-certs\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.739212 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.739189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nl4w\" (UniqueName: \"kubernetes.io/projected/b26dc23b-d7de-4950-848c-459c19c51801-kube-api-access-8nl4w\") pod \"auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") " pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.818362 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.818328    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:43.965191 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:43.965166    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"]
Jul 22 12:05:43.966811 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:05:43.966781    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb26dc23b_d7de_4950_848c_459c19c51801.slice/crio-4e865739b1b9e9cfeb8049b824be87f4bf303c7db7d7a8866b1c3893b688c37c WatchSource:0}: Error finding container 4e865739b1b9e9cfeb8049b824be87f4bf303c7db7d7a8866b1c3893b688c37c: Status 404 returned error can't find the container with id 4e865739b1b9e9cfeb8049b824be87f4bf303c7db7d7a8866b1c3893b688c37c
Jul 22 12:05:44.443740 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:44.443702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv" event={"ID":"b26dc23b-d7de-4950-848c-459c19c51801","Type":"ContainerStarted","Data":"213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890"}
Jul 22 12:05:44.443916 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:44.443750    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv" event={"ID":"b26dc23b-d7de-4950-848c-459c19c51801","Type":"ContainerStarted","Data":"4e865739b1b9e9cfeb8049b824be87f4bf303c7db7d7a8866b1c3893b688c37c"}
Jul 22 12:05:44.467973 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:44.467916    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv" podStartSLOduration=1.467900087 podStartE2EDuration="1.467900087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:05:44.46491797 +0000 UTC m=+2537.127565228" watchObservedRunningTime="2026-07-22 12:05:44.467900087 +0000 UTC m=+2537.130547345"
Jul 22 12:05:47.303260 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:47.303225    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:05:53.819084 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:53.819041    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:53.819489 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:53.819098    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:53.831704 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:53.831668    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:05:54.508956 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:05:54.508931    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:06:01.608054 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:06:01.608019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:06:18.128262 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:06:18.128223    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:06:35.900960 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:06:35.900920    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:06:53.302068 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:06:53.302025    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:07:08.196961 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:08.196912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:07:24.321696 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:24.321653    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:07:35.765434 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:35.765397    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"]
Jul 22 12:07:36.686154 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:36.686120    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"]
Jul 22 12:07:36.889955 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:36.889914    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:07:49.987906 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:49.987865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:07:50.785997 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:50.785943    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8" podUID="c813aee3-68b0-43e5-a05a-f701ad3430b0" containerName="main" containerID="cri-o://5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462" gracePeriod=45
Jul 22 12:07:51.042851 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.042782    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:07:51.124157 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.124119    2580 generic.go:356] "Generic (PLEG): container finished" podID="c813aee3-68b0-43e5-a05a-f701ad3430b0" containerID="5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462" exitCode=0
Jul 22 12:07:51.124157 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.124161    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"
Jul 22 12:07:51.124435 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.124206    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8" event={"ID":"c813aee3-68b0-43e5-a05a-f701ad3430b0","Type":"ContainerDied","Data":"5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462"}
Jul 22 12:07:51.124435 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.124250    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8" event={"ID":"c813aee3-68b0-43e5-a05a-f701ad3430b0","Type":"ContainerDied","Data":"a8fe74bc14549afcebfa94a40142a227be4af19d5202b45fedd9dc15731ec146"}
Jul 22 12:07:51.124435 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.124272    2580 scope.go:117] "RemoveContainer" containerID="5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462"
Jul 22 12:07:51.134197 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.134178    2580 scope.go:117] "RemoveContainer" containerID="5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462"
Jul 22 12:07:51.134516 ip-10-0-136-126 kubenswrapper[2580]: E0722 12:07:51.134492    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462\": container with ID starting with 5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462 not found: ID does not exist" containerID="5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462"
Jul 22 12:07:51.134605 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.134525    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462"} err="failed to get container status \"5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462\": rpc error: code = NotFound desc = could not find container \"5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462\": container with ID starting with 5c81ea5200b69304a457f8849434f87efc5969b6c200df5f4048591b9a22a462 not found: ID does not exist"
Jul 22 12:07:51.191884 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.191852    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c813aee3-68b0-43e5-a05a-f701ad3430b0-tls-certs\") pod \"c813aee3-68b0-43e5-a05a-f701ad3430b0\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") "
Jul 22 12:07:51.192147 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.191900    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-tmp-dir\") pod \"c813aee3-68b0-43e5-a05a-f701ad3430b0\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") "
Jul 22 12:07:51.192147 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.191918    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-model-cache\") pod \"c813aee3-68b0-43e5-a05a-f701ad3430b0\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") "
Jul 22 12:07:51.192147 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.191960    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-home\") pod \"c813aee3-68b0-43e5-a05a-f701ad3430b0\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") "
Jul 22 12:07:51.192147 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.191989    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-dshm\") pod \"c813aee3-68b0-43e5-a05a-f701ad3430b0\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") "
Jul 22 12:07:51.192147 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.192073    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ck6jz\" (UniqueName: \"kubernetes.io/projected/c813aee3-68b0-43e5-a05a-f701ad3430b0-kube-api-access-ck6jz\") pod \"c813aee3-68b0-43e5-a05a-f701ad3430b0\" (UID: \"c813aee3-68b0-43e5-a05a-f701ad3430b0\") "
Jul 22 12:07:51.192397 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.192168    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-model-cache" (OuterVolumeSpecName: "model-cache") pod "c813aee3-68b0-43e5-a05a-f701ad3430b0" (UID: "c813aee3-68b0-43e5-a05a-f701ad3430b0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:07:51.192397 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.192191    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c813aee3-68b0-43e5-a05a-f701ad3430b0" (UID: "c813aee3-68b0-43e5-a05a-f701ad3430b0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:07:51.192397 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.192269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-home" (OuterVolumeSpecName: "home") pod "c813aee3-68b0-43e5-a05a-f701ad3430b0" (UID: "c813aee3-68b0-43e5-a05a-f701ad3430b0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:07:51.192608 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.192398    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:51.192608 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.192421    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:51.192608 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.192435    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:51.194474 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.194449    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c813aee3-68b0-43e5-a05a-f701ad3430b0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c813aee3-68b0-43e5-a05a-f701ad3430b0" (UID: "c813aee3-68b0-43e5-a05a-f701ad3430b0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:07:51.194627 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.194469    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c813aee3-68b0-43e5-a05a-f701ad3430b0-kube-api-access-ck6jz" (OuterVolumeSpecName: "kube-api-access-ck6jz") pod "c813aee3-68b0-43e5-a05a-f701ad3430b0" (UID: "c813aee3-68b0-43e5-a05a-f701ad3430b0"). InnerVolumeSpecName "kube-api-access-ck6jz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:07:51.194627 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.194451    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-dshm" (OuterVolumeSpecName: "dshm") pod "c813aee3-68b0-43e5-a05a-f701ad3430b0" (UID: "c813aee3-68b0-43e5-a05a-f701ad3430b0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:07:51.293774 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.293688    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c813aee3-68b0-43e5-a05a-f701ad3430b0-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:51.293774 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.293717    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck6jz\" (UniqueName: \"kubernetes.io/projected/c813aee3-68b0-43e5-a05a-f701ad3430b0-kube-api-access-ck6jz\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:51.293774 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.293727    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c813aee3-68b0-43e5-a05a-f701ad3430b0-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:51.449494 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.449461    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"]
Jul 22 12:07:51.453919 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.453889    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/auth-test-model-fc3650-kserve-98d6c47-6r9r8"]
Jul 22 12:07:51.707659 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.707619    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv" podUID="b26dc23b-d7de-4950-848c-459c19c51801" containerName="main" containerID="cri-o://213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890" gracePeriod=45
Jul 22 12:07:51.739130 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.739099    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c813aee3-68b0-43e5-a05a-f701ad3430b0" path="/var/lib/kubelet/pods/c813aee3-68b0-43e5-a05a-f701ad3430b0/volumes"
Jul 22 12:07:51.968983 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.968909    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:07:51.999957 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.999920    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b26dc23b-d7de-4950-848c-459c19c51801-tls-certs\") pod \"b26dc23b-d7de-4950-848c-459c19c51801\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") "
Jul 22 12:07:52.000158 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:51.999985    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-home\") pod \"b26dc23b-d7de-4950-848c-459c19c51801\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") "
Jul 22 12:07:52.000158 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.000047    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nl4w\" (UniqueName: \"kubernetes.io/projected/b26dc23b-d7de-4950-848c-459c19c51801-kube-api-access-8nl4w\") pod \"b26dc23b-d7de-4950-848c-459c19c51801\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") "
Jul 22 12:07:52.000158 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.000091    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-dshm\") pod \"b26dc23b-d7de-4950-848c-459c19c51801\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") "
Jul 22 12:07:52.000158 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.000131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-model-cache\") pod \"b26dc23b-d7de-4950-848c-459c19c51801\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") "
Jul 22 12:07:52.000398 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.000164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-tmp-dir\") pod \"b26dc23b-d7de-4950-848c-459c19c51801\" (UID: \"b26dc23b-d7de-4950-848c-459c19c51801\") "
Jul 22 12:07:52.000398 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.000245    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-home" (OuterVolumeSpecName: "home") pod "b26dc23b-d7de-4950-848c-459c19c51801" (UID: "b26dc23b-d7de-4950-848c-459c19c51801"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:07:52.000601 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.000578    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:52.000712 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.000690    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b26dc23b-d7de-4950-848c-459c19c51801" (UID: "b26dc23b-d7de-4950-848c-459c19c51801"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:07:52.000712 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.000701    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-model-cache" (OuterVolumeSpecName: "model-cache") pod "b26dc23b-d7de-4950-848c-459c19c51801" (UID: "b26dc23b-d7de-4950-848c-459c19c51801"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:07:52.002695 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.002654    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-dshm" (OuterVolumeSpecName: "dshm") pod "b26dc23b-d7de-4950-848c-459c19c51801" (UID: "b26dc23b-d7de-4950-848c-459c19c51801"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:07:52.002925 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.002898    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b26dc23b-d7de-4950-848c-459c19c51801-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b26dc23b-d7de-4950-848c-459c19c51801" (UID: "b26dc23b-d7de-4950-848c-459c19c51801"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:07:52.003248 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.003216    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b26dc23b-d7de-4950-848c-459c19c51801-kube-api-access-8nl4w" (OuterVolumeSpecName: "kube-api-access-8nl4w") pod "b26dc23b-d7de-4950-848c-459c19c51801" (UID: "b26dc23b-d7de-4950-848c-459c19c51801"). InnerVolumeSpecName "kube-api-access-8nl4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:07:52.101757 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.101719    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b26dc23b-d7de-4950-848c-459c19c51801-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:52.101757 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.101751    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nl4w\" (UniqueName: \"kubernetes.io/projected/b26dc23b-d7de-4950-848c-459c19c51801-kube-api-access-8nl4w\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:52.102219 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.101766    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:52.102219 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.101781    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:52.102219 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.101794    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b26dc23b-d7de-4950-848c-459c19c51801-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:07:52.130448 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.130412    2580 generic.go:356] "Generic (PLEG): container finished" podID="b26dc23b-d7de-4950-848c-459c19c51801" containerID="213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890" exitCode=0
Jul 22 12:07:52.130621 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.130465    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"
Jul 22 12:07:52.130621 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.130513    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv" event={"ID":"b26dc23b-d7de-4950-848c-459c19c51801","Type":"ContainerDied","Data":"213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890"}
Jul 22 12:07:52.130621 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.130571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv" event={"ID":"b26dc23b-d7de-4950-848c-459c19c51801","Type":"ContainerDied","Data":"4e865739b1b9e9cfeb8049b824be87f4bf303c7db7d7a8866b1c3893b688c37c"}
Jul 22 12:07:52.130621 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.130595    2580 scope.go:117] "RemoveContainer" containerID="213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890"
Jul 22 12:07:52.140848 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.140830    2580 scope.go:117] "RemoveContainer" containerID="213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890"
Jul 22 12:07:52.141171 ip-10-0-136-126 kubenswrapper[2580]: E0722 12:07:52.141148    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890\": container with ID starting with 213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890 not found: ID does not exist" containerID="213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890"
Jul 22 12:07:52.141229 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.141184    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890"} err="failed to get container status \"213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890\": rpc error: code = NotFound desc = could not find container \"213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890\": container with ID starting with 213e46cb34e455c4f0814c9e2036e120d89a00c38951926d157dc745e54b2890 not found: ID does not exist"
Jul 22 12:07:52.156306 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.156279    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"]
Jul 22 12:07:52.160610 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:52.160586    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/auth-test-model-ae7383-kserve-5d8b64b6c-nhdfv"]
Jul 22 12:07:53.738344 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:53.738301    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b26dc23b-d7de-4950-848c-459c19c51801" path="/var/lib/kubelet/pods/b26dc23b-d7de-4950-848c-459c19c51801/volumes"
Jul 22 12:07:56.008379 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.008335    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"]
Jul 22 12:07:56.008969 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.008949    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c813aee3-68b0-43e5-a05a-f701ad3430b0" containerName="main"
Jul 22 12:07:56.009091 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.008972    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c813aee3-68b0-43e5-a05a-f701ad3430b0" containerName="main"
Jul 22 12:07:56.009091 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.008988    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b26dc23b-d7de-4950-848c-459c19c51801" containerName="main"
Jul 22 12:07:56.009091 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.008995    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b26dc23b-d7de-4950-848c-459c19c51801" containerName="main"
Jul 22 12:07:56.009249 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.009127    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c813aee3-68b0-43e5-a05a-f701ad3430b0" containerName="main"
Jul 22 12:07:56.009249 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.009147    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b26dc23b-d7de-4950-848c-459c19c51801" containerName="main"
Jul 22 12:07:56.013448 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.013427    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.016290 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.016267    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"default-dockercfg-m4fbn\""
Jul 22 12:07:56.017907 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.017889    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"kube-root-ca.crt\""
Jul 22 12:07:56.017987 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.017926    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"openshift-service-ca.crt\""
Jul 22 12:07:56.017987 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.017894    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"sub-test-model-fc3650-kserve-self-signed-certs\""
Jul 22 12:07:56.023058 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.023034    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"]
Jul 22 12:07:56.046401 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.046363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-model-cache\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.046578 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.046428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-home\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.046578 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.046459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlw2\" (UniqueName: \"kubernetes.io/projected/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-kube-api-access-shlw2\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.046578 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.046541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-dshm\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.046729 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.046578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tls-certs\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.046729 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.046636    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tmp-dir\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.147379 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tls-certs\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.147583 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tmp-dir\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.147583 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-model-cache\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.147583 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147472    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-home\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.147583 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlw2\" (UniqueName: \"kubernetes.io/projected/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-kube-api-access-shlw2\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.147807 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147638    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-dshm\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.147915 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-model-cache\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.148062 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-home\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.148062 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.147982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tmp-dir\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.149913 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.149888    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-dshm\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.150196 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.150172    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tls-certs\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.160801 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.160778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlw2\" (UniqueName: \"kubernetes.io/projected/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-kube-api-access-shlw2\") pod \"sub-test-model-fc3650-kserve-c65f48fcc-gpvx7\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") " pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.323166 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.323130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:07:56.466749 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:56.466726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"]
Jul 22 12:07:56.468689 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:07:56.468660    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83c85a0f_ddd5_42fc_b35a_92bbd0a05058.slice/crio-15cc19b46f673b41f47fe31e88d7e0d98775f639e68cc518828dbf865647bc4b WatchSource:0}: Error finding container 15cc19b46f673b41f47fe31e88d7e0d98775f639e68cc518828dbf865647bc4b: Status 404 returned error can't find the container with id 15cc19b46f673b41f47fe31e88d7e0d98775f639e68cc518828dbf865647bc4b
Jul 22 12:07:57.165588 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:57.165556    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7" event={"ID":"83c85a0f-ddd5-42fc-b35a-92bbd0a05058","Type":"ContainerStarted","Data":"0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378"}
Jul 22 12:07:57.165969 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:57.165597    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7" event={"ID":"83c85a0f-ddd5-42fc-b35a-92bbd0a05058","Type":"ContainerStarted","Data":"15cc19b46f673b41f47fe31e88d7e0d98775f639e68cc518828dbf865647bc4b"}
Jul 22 12:07:57.197019 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:07:57.196940    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7" podStartSLOduration=2.196924629 podStartE2EDuration="2.196924629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:07:57.19529562 +0000 UTC m=+2669.857942899" watchObservedRunningTime="2026-07-22 12:07:57.196924629 +0000 UTC m=+2669.859571906"
Jul 22 12:08:02.097343 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:02.097309    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:08:06.324254 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:06.324214    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:08:06.324638 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:06.324275    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:08:06.336848 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:06.336822    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:08:07.230418 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:07.230383    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:08:15.104055 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.104017    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"]
Jul 22 12:08:15.107766 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.107749    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.111891 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.111856    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"sub-test-model-ae7383-kserve-self-signed-certs\""
Jul 22 12:08:15.111891 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.111874    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"openshift-service-ca.crt\""
Jul 22 12:08:15.112113 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.111874    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"default-dockercfg-prfcr\""
Jul 22 12:08:15.112113 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.111903    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"kube-root-ca.crt\""
Jul 22 12:08:15.119446 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.119420    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"]
Jul 22 12:08:15.227027 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.226961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581b28c1-cdbe-407f-9727-b15850aa151c-tls-certs\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.227210 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.227070    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-dshm\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.227210 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.227096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-home\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.227210 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.227161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f29l\" (UniqueName: \"kubernetes.io/projected/581b28c1-cdbe-407f-9727-b15850aa151c-kube-api-access-2f29l\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.227210 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.227196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-model-cache\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.227359 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.227221    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-tmp-dir\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328220 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f29l\" (UniqueName: \"kubernetes.io/projected/581b28c1-cdbe-407f-9727-b15850aa151c-kube-api-access-2f29l\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328418 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-model-cache\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328418 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-tmp-dir\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328418 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581b28c1-cdbe-407f-9727-b15850aa151c-tls-certs\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328418 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-dshm\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328418 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-home\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328692 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-model-cache\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328793 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-tmp-dir\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.328906 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.328779    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-home\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.330936 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.330916    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-dshm\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.331057 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.331035    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581b28c1-cdbe-407f-9727-b15850aa151c-tls-certs\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.338976 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.338946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f29l\" (UniqueName: \"kubernetes.io/projected/581b28c1-cdbe-407f-9727-b15850aa151c-kube-api-access-2f29l\") pod \"sub-test-model-ae7383-kserve-f4c888969-4n5dj\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") " pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.418658 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.418550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:15.565724 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:15.565700    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"]
Jul 22 12:08:15.567808 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:08:15.567767    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod581b28c1_cdbe_407f_9727_b15850aa151c.slice/crio-f6587ee14b56cc294f63cd7f4e2dd3dbf50c00c1dd554531fa476c4e7379866c WatchSource:0}: Error finding container f6587ee14b56cc294f63cd7f4e2dd3dbf50c00c1dd554531fa476c4e7379866c: Status 404 returned error can't find the container with id f6587ee14b56cc294f63cd7f4e2dd3dbf50c00c1dd554531fa476c4e7379866c
Jul 22 12:08:16.272280 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:16.272247    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj" event={"ID":"581b28c1-cdbe-407f-9727-b15850aa151c","Type":"ContainerStarted","Data":"7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a"}
Jul 22 12:08:16.272739 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:16.272291    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj" event={"ID":"581b28c1-cdbe-407f-9727-b15850aa151c","Type":"ContainerStarted","Data":"f6587ee14b56cc294f63cd7f4e2dd3dbf50c00c1dd554531fa476c4e7379866c"}
Jul 22 12:08:16.294952 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:16.294890    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj" podStartSLOduration=1.294874279 podStartE2EDuration="1.294874279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:08:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:08:16.291997053 +0000 UTC m=+2688.954644311" watchObservedRunningTime="2026-07-22 12:08:16.294874279 +0000 UTC m=+2688.957521537"
Jul 22 12:08:18.897754 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:18.897667    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:08:25.418795 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:25.418748    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:25.419258 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:25.418818    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:25.431522 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:25.431498    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:26.341792 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:26.341764    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:08:33.213262 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:33.213222    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:08:52.207542 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:52.207507    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:08:58.637267 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:58.637227    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"]
Jul 22 12:08:59.746684 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:08:59.746652    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"]
Jul 22 12:09:11.012844 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:11.012810    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:09:13.658347 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:13.658294    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7" podUID="83c85a0f-ddd5-42fc-b35a-92bbd0a05058" containerName="main" containerID="cri-o://0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378" gracePeriod=45
Jul 22 12:09:13.919796 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:13.919732    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:09:14.080446 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080414    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-dshm\") pod \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") "
Jul 22 12:09:14.080629 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080467    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-model-cache\") pod \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") "
Jul 22 12:09:14.080629 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080498    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shlw2\" (UniqueName: \"kubernetes.io/projected/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-kube-api-access-shlw2\") pod \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") "
Jul 22 12:09:14.080629 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080516    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-home\") pod \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") "
Jul 22 12:09:14.080629 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080546    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tmp-dir\") pod \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") "
Jul 22 12:09:14.080629 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080601    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tls-certs\") pod \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\" (UID: \"83c85a0f-ddd5-42fc-b35a-92bbd0a05058\") "
Jul 22 12:09:14.080934 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080827    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-home" (OuterVolumeSpecName: "home") pod "83c85a0f-ddd5-42fc-b35a-92bbd0a05058" (UID: "83c85a0f-ddd5-42fc-b35a-92bbd0a05058"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:09:14.081030 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080905    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "83c85a0f-ddd5-42fc-b35a-92bbd0a05058" (UID: "83c85a0f-ddd5-42fc-b35a-92bbd0a05058"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:09:14.081030 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.080961    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-model-cache" (OuterVolumeSpecName: "model-cache") pod "83c85a0f-ddd5-42fc-b35a-92bbd0a05058" (UID: "83c85a0f-ddd5-42fc-b35a-92bbd0a05058"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:09:14.082728 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.082702    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-dshm" (OuterVolumeSpecName: "dshm") pod "83c85a0f-ddd5-42fc-b35a-92bbd0a05058" (UID: "83c85a0f-ddd5-42fc-b35a-92bbd0a05058"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:09:14.082881 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.082865    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-kube-api-access-shlw2" (OuterVolumeSpecName: "kube-api-access-shlw2") pod "83c85a0f-ddd5-42fc-b35a-92bbd0a05058" (UID: "83c85a0f-ddd5-42fc-b35a-92bbd0a05058"). InnerVolumeSpecName "kube-api-access-shlw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:09:14.082929 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.082898    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "83c85a0f-ddd5-42fc-b35a-92bbd0a05058" (UID: "83c85a0f-ddd5-42fc-b35a-92bbd0a05058"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:09:14.182180 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.182095    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:14.182180 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.182124    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shlw2\" (UniqueName: \"kubernetes.io/projected/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-kube-api-access-shlw2\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:14.182180 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.182133    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:14.182180 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.182142    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:14.182180 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.182151    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:14.182180 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.182159    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83c85a0f-ddd5-42fc-b35a-92bbd0a05058-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:14.588518 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.588486    2580 generic.go:356] "Generic (PLEG): container finished" podID="83c85a0f-ddd5-42fc-b35a-92bbd0a05058" containerID="0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378" exitCode=0
Jul 22 12:09:14.588711 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.588531    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"
Jul 22 12:09:14.588711 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.588534    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7" event={"ID":"83c85a0f-ddd5-42fc-b35a-92bbd0a05058","Type":"ContainerDied","Data":"0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378"}
Jul 22 12:09:14.588711 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.588628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7" event={"ID":"83c85a0f-ddd5-42fc-b35a-92bbd0a05058","Type":"ContainerDied","Data":"15cc19b46f673b41f47fe31e88d7e0d98775f639e68cc518828dbf865647bc4b"}
Jul 22 12:09:14.588711 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.588643    2580 scope.go:117] "RemoveContainer" containerID="0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378"
Jul 22 12:09:14.598435 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.598417    2580 scope.go:117] "RemoveContainer" containerID="0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378"
Jul 22 12:09:14.598727 ip-10-0-136-126 kubenswrapper[2580]: E0722 12:09:14.598709    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378\": container with ID starting with 0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378 not found: ID does not exist" containerID="0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378"
Jul 22 12:09:14.598772 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.598738    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378"} err="failed to get container status \"0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378\": rpc error: code = NotFound desc = could not find container \"0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378\": container with ID starting with 0d983a253bc5a2647ab309f7464452a59569decdc094777ba782d6e3b7a72378 not found: ID does not exist"
Jul 22 12:09:14.611754 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.611714    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"]
Jul 22 12:09:14.620610 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.620585    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/sub-test-model-fc3650-kserve-c65f48fcc-gpvx7"]
Jul 22 12:09:14.767668 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:14.767631    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj" podUID="581b28c1-cdbe-407f-9727-b15850aa151c" containerName="main" containerID="cri-o://7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a" gracePeriod=45
Jul 22 12:09:15.028265 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.028240    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:09:15.193026 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.192894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-home\") pod \"581b28c1-cdbe-407f-9727-b15850aa151c\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") "
Jul 22 12:09:15.193026 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.192970    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581b28c1-cdbe-407f-9727-b15850aa151c-tls-certs\") pod \"581b28c1-cdbe-407f-9727-b15850aa151c\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") "
Jul 22 12:09:15.193026 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.193019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f29l\" (UniqueName: \"kubernetes.io/projected/581b28c1-cdbe-407f-9727-b15850aa151c-kube-api-access-2f29l\") pod \"581b28c1-cdbe-407f-9727-b15850aa151c\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") "
Jul 22 12:09:15.193310 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.193084    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-dshm\") pod \"581b28c1-cdbe-407f-9727-b15850aa151c\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") "
Jul 22 12:09:15.193310 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.193169    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-model-cache\") pod \"581b28c1-cdbe-407f-9727-b15850aa151c\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") "
Jul 22 12:09:15.193310 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.193221    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-tmp-dir\") pod \"581b28c1-cdbe-407f-9727-b15850aa151c\" (UID: \"581b28c1-cdbe-407f-9727-b15850aa151c\") "
Jul 22 12:09:15.193310 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.193292    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-home" (OuterVolumeSpecName: "home") pod "581b28c1-cdbe-407f-9727-b15850aa151c" (UID: "581b28c1-cdbe-407f-9727-b15850aa151c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:09:15.193625 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.193604    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:15.194041 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.193968    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "581b28c1-cdbe-407f-9727-b15850aa151c" (UID: "581b28c1-cdbe-407f-9727-b15850aa151c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:09:15.194392 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.194070    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-model-cache" (OuterVolumeSpecName: "model-cache") pod "581b28c1-cdbe-407f-9727-b15850aa151c" (UID: "581b28c1-cdbe-407f-9727-b15850aa151c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:09:15.195911 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.195884    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581b28c1-cdbe-407f-9727-b15850aa151c-kube-api-access-2f29l" (OuterVolumeSpecName: "kube-api-access-2f29l") pod "581b28c1-cdbe-407f-9727-b15850aa151c" (UID: "581b28c1-cdbe-407f-9727-b15850aa151c"). InnerVolumeSpecName "kube-api-access-2f29l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:09:15.196084 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.196063    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-dshm" (OuterVolumeSpecName: "dshm") pod "581b28c1-cdbe-407f-9727-b15850aa151c" (UID: "581b28c1-cdbe-407f-9727-b15850aa151c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:09:15.196165 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.196117    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/581b28c1-cdbe-407f-9727-b15850aa151c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "581b28c1-cdbe-407f-9727-b15850aa151c" (UID: "581b28c1-cdbe-407f-9727-b15850aa151c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:09:15.295268 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.295225    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:15.295268 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.295256    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/581b28c1-cdbe-407f-9727-b15850aa151c-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:15.295268 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.295265    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f29l\" (UniqueName: \"kubernetes.io/projected/581b28c1-cdbe-407f-9727-b15850aa151c-kube-api-access-2f29l\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:15.295268 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.295274    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:15.295531 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.295285    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/581b28c1-cdbe-407f-9727-b15850aa151c-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:09:15.595616 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.595580    2580 generic.go:356] "Generic (PLEG): container finished" podID="581b28c1-cdbe-407f-9727-b15850aa151c" containerID="7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a" exitCode=0
Jul 22 12:09:15.595825 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.595636    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"
Jul 22 12:09:15.595825 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.595667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj" event={"ID":"581b28c1-cdbe-407f-9727-b15850aa151c","Type":"ContainerDied","Data":"7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a"}
Jul 22 12:09:15.595825 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.595710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj" event={"ID":"581b28c1-cdbe-407f-9727-b15850aa151c","Type":"ContainerDied","Data":"f6587ee14b56cc294f63cd7f4e2dd3dbf50c00c1dd554531fa476c4e7379866c"}
Jul 22 12:09:15.595825 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.595734    2580 scope.go:117] "RemoveContainer" containerID="7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a"
Jul 22 12:09:15.605556 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.605538    2580 scope.go:117] "RemoveContainer" containerID="7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a"
Jul 22 12:09:15.605810 ip-10-0-136-126 kubenswrapper[2580]: E0722 12:09:15.605791    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a\": container with ID starting with 7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a not found: ID does not exist" containerID="7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a"
Jul 22 12:09:15.605878 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.605818    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a"} err="failed to get container status \"7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a\": rpc error: code = NotFound desc = could not find container \"7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a\": container with ID starting with 7da977168140855a24c57695a71cc7cdc9d9055297a10c72cd3c7a67ff74ac2a not found: ID does not exist"
Jul 22 12:09:15.620212 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.620180    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"]
Jul 22 12:09:15.626339 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.626310    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/sub-test-model-ae7383-kserve-f4c888969-4n5dj"]
Jul 22 12:09:15.739153 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.739118    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581b28c1-cdbe-407f-9727-b15850aa151c" path="/var/lib/kubelet/pods/581b28c1-cdbe-407f-9727-b15850aa151c/volumes"
Jul 22 12:09:15.739510 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:15.739497    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83c85a0f-ddd5-42fc-b35a-92bbd0a05058" path="/var/lib/kubelet/pods/83c85a0f-ddd5-42fc-b35a-92bbd0a05058/volumes"
Jul 22 12:09:22.808523 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.808485    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"]
Jul 22 12:09:22.809143 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.809121    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83c85a0f-ddd5-42fc-b35a-92bbd0a05058" containerName="main"
Jul 22 12:09:22.809226 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.809146    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="83c85a0f-ddd5-42fc-b35a-92bbd0a05058" containerName="main"
Jul 22 12:09:22.809226 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.809158    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581b28c1-cdbe-407f-9727-b15850aa151c" containerName="main"
Jul 22 12:09:22.809226 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.809166    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="581b28c1-cdbe-407f-9727-b15850aa151c" containerName="main"
Jul 22 12:09:22.809376 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.809287    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="83c85a0f-ddd5-42fc-b35a-92bbd0a05058" containerName="main"
Jul 22 12:09:22.809376 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.809302    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="581b28c1-cdbe-407f-9727-b15850aa151c" containerName="main"
Jul 22 12:09:22.814248 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.814224    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:22.817306 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.817281    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"kube-root-ca.crt\""
Jul 22 12:09:22.818588 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.818569    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"default-dockercfg-m4fbn\""
Jul 22 12:09:22.818704 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.818572    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"openshift-service-ca.crt\""
Jul 22 12:09:22.818704 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.818574    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-fc3650\"/\"rate-test-model-fc3650-kserve-self-signed-certs\""
Jul 22 12:09:22.824053 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.824026    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"]
Jul 22 12:09:22.967180 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.967140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-dshm\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:22.967353 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.967195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cb4\" (UniqueName: \"kubernetes.io/projected/4083aaad-37c6-4771-b294-a8d1669b849c-kube-api-access-w4cb4\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:22.967353 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.967256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-model-cache\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:22.967353 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.967320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-home\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:22.967477 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.967382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4083aaad-37c6-4771-b294-a8d1669b849c-tls-certs\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:22.967477 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:22.967408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-tmp-dir\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.068532 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.068504    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-dshm\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.068708 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.068561    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cb4\" (UniqueName: \"kubernetes.io/projected/4083aaad-37c6-4771-b294-a8d1669b849c-kube-api-access-w4cb4\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.068708 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.068591    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-model-cache\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.068708 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.068619    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-home\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.068708 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.068688    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4083aaad-37c6-4771-b294-a8d1669b849c-tls-certs\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.068918 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.068720    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-tmp-dir\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.069083 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.069059    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-model-cache\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.069083 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.069077    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-tmp-dir\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.069209 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.069122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-home\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.070999 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.070968    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-dshm\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.071256 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.071236    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4083aaad-37c6-4771-b294-a8d1669b849c-tls-certs\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.078817 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.078793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cb4\" (UniqueName: \"kubernetes.io/projected/4083aaad-37c6-4771-b294-a8d1669b849c-kube-api-access-w4cb4\") pod \"rate-test-model-fc3650-kserve-54f5485bbc-c7n8d\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") " pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.124070 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.124033    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:23.270335 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.270302    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"]
Jul 22 12:09:23.274508 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:09:23.274469    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4083aaad_37c6_4771_b294_a8d1669b849c.slice/crio-31d117d96560713959b2a661b667675de8c4942b1732454eeea927b6df066ce9 WatchSource:0}: Error finding container 31d117d96560713959b2a661b667675de8c4942b1732454eeea927b6df066ce9: Status 404 returned error can't find the container with id 31d117d96560713959b2a661b667675de8c4942b1732454eeea927b6df066ce9
Jul 22 12:09:23.646079 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.645961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d" event={"ID":"4083aaad-37c6-4771-b294-a8d1669b849c","Type":"ContainerStarted","Data":"8af5cab2a110b66d0bc852ba31c71a3e9d9df74a9ac3cd2068ee3af77c7735f9"}
Jul 22 12:09:23.646079 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.646038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d" event={"ID":"4083aaad-37c6-4771-b294-a8d1669b849c","Type":"ContainerStarted","Data":"31d117d96560713959b2a661b667675de8c4942b1732454eeea927b6df066ce9"}
Jul 22 12:09:23.664351 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:23.664294    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d" podStartSLOduration=1.664277315 podStartE2EDuration="1.664277315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:09:23.663667166 +0000 UTC m=+2756.326314450" watchObservedRunningTime="2026-07-22 12:09:23.664277315 +0000 UTC m=+2756.326924570"
Jul 22 12:09:26.394297 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:26.394256    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:09:28.068766 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:28.068732    2580 scope.go:117] "RemoveContainer" containerID="0423a518d5235e4a6bbb493b777a7de19685fbb484275aa8a8ade322744317c7"
Jul 22 12:09:28.077535 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:28.077510    2580 scope.go:117] "RemoveContainer" containerID="3b173b3074de4eebec0fff9c01af1c8102b6379f214a38362a739727e156691a"
Jul 22 12:09:33.125199 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:33.125156    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:33.125617 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:33.125216    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:33.137848 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:33.137823    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:33.710803 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:33.710775    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:09:55.602947 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.602913    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"]
Jul 22 12:09:55.606713 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.606692    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.611219 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.611195    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"kube-root-ca.crt\""
Jul 22 12:09:55.611219 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.611216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"default-dockercfg-prfcr\""
Jul 22 12:09:55.611443 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.611216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"rate-test-model-ae7383-kserve-self-signed-certs\""
Jul 22 12:09:55.611443 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.611268    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ae7383\"/\"openshift-service-ca.crt\""
Jul 22 12:09:55.618249 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.618226    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"]
Jul 22 12:09:55.761413 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.761379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f9b5c94-3ae0-4892-9191-fa6199179270-tls-certs\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.761591 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.761434    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-dshm\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.761591 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.761490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-tmp-dir\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.761591 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.761512    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcjdw\" (UniqueName: \"kubernetes.io/projected/6f9b5c94-3ae0-4892-9191-fa6199179270-kube-api-access-lcjdw\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.761707 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.761595    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-home\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.761707 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.761623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-model-cache\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862347 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862258    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-home\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862347 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862294    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-model-cache\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862577 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862358    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f9b5c94-3ae0-4892-9191-fa6199179270-tls-certs\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862577 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-dshm\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862577 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-tmp-dir\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862577 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcjdw\" (UniqueName: \"kubernetes.io/projected/6f9b5c94-3ae0-4892-9191-fa6199179270-kube-api-access-lcjdw\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862789 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862661    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-home\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862789 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862701    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-model-cache\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.862789 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.862786    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-tmp-dir\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.864655 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.864636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-dshm\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.864913 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.864896    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f9b5c94-3ae0-4892-9191-fa6199179270-tls-certs\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.872217 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.872192    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcjdw\" (UniqueName: \"kubernetes.io/projected/6f9b5c94-3ae0-4892-9191-fa6199179270-kube-api-access-lcjdw\") pod \"rate-test-model-ae7383-kserve-7688447b79-qwdk4\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") " pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:55.918304 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:55.918254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:09:56.066496 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:56.066466    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"]
Jul 22 12:09:56.068370 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:09:56.068339    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f9b5c94_3ae0_4892_9191_fa6199179270.slice/crio-a0fb70bcd6b931a69e82d6a7c02aa939ad7afa8d4d472689600ad3574a2b18c3 WatchSource:0}: Error finding container a0fb70bcd6b931a69e82d6a7c02aa939ad7afa8d4d472689600ad3574a2b18c3: Status 404 returned error can't find the container with id a0fb70bcd6b931a69e82d6a7c02aa939ad7afa8d4d472689600ad3574a2b18c3
Jul 22 12:09:56.816502 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:56.816447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4" event={"ID":"6f9b5c94-3ae0-4892-9191-fa6199179270","Type":"ContainerStarted","Data":"2cfa03b9ac0bb874cdf1e8f88305f91ce87d9b960b65f8f9b5cd1b9759ae2912"}
Jul 22 12:09:56.816911 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:56.816511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4" event={"ID":"6f9b5c94-3ae0-4892-9191-fa6199179270","Type":"ContainerStarted","Data":"a0fb70bcd6b931a69e82d6a7c02aa939ad7afa8d4d472689600ad3574a2b18c3"}
Jul 22 12:09:56.836609 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:56.836557    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4" podStartSLOduration=1.836532053 podStartE2EDuration="1.836532053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 12:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:09:56.835412584 +0000 UTC m=+2789.498059840" watchObservedRunningTime="2026-07-22 12:09:56.836532053 +0000 UTC m=+2789.499179310"
Jul 22 12:09:59.621300 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:09:59.621262    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:10:05.918823 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:05.918768    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:10:05.919489 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:05.918843    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:10:05.931631 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:05.931608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:10:06.881104 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:06.881072    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:10:20.189581 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:20.189547    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:10:28.111951 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:28.110116    2580 scope.go:117] "RemoveContainer" containerID="47c31ddc680140e23b9410455fd661e9184d3561db6a49bfc23276e17e53786a"
Jul 22 12:10:36.095811 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:36.095773    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:10:42.988119 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:42.988089    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"]
Jul 22 12:10:43.874335 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:43.874298    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"]
Jul 22 12:10:56.102248 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:56.102214    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:10:58.010133 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.010093    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d" podUID="4083aaad-37c6-4771-b294-a8d1669b849c" containerName="main" containerID="cri-o://8af5cab2a110b66d0bc852ba31c71a3e9d9df74a9ac3cd2068ee3af77c7735f9" gracePeriod=45
Jul 22 12:10:58.140046 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.139988    2580 generic.go:356] "Generic (PLEG): container finished" podID="4083aaad-37c6-4771-b294-a8d1669b849c" containerID="8af5cab2a110b66d0bc852ba31c71a3e9d9df74a9ac3cd2068ee3af77c7735f9" exitCode=0
Jul 22 12:10:58.140213 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.140073    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d" event={"ID":"4083aaad-37c6-4771-b294-a8d1669b849c","Type":"ContainerDied","Data":"8af5cab2a110b66d0bc852ba31c71a3e9d9df74a9ac3cd2068ee3af77c7735f9"}
Jul 22 12:10:58.282732 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.282704    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:10:58.347092 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347058    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4083aaad-37c6-4771-b294-a8d1669b849c-tls-certs\") pod \"4083aaad-37c6-4771-b294-a8d1669b849c\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") "
Jul 22 12:10:58.347278 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347129    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-home\") pod \"4083aaad-37c6-4771-b294-a8d1669b849c\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") "
Jul 22 12:10:58.347278 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347188    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4cb4\" (UniqueName: \"kubernetes.io/projected/4083aaad-37c6-4771-b294-a8d1669b849c-kube-api-access-w4cb4\") pod \"4083aaad-37c6-4771-b294-a8d1669b849c\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") "
Jul 22 12:10:58.347278 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-tmp-dir\") pod \"4083aaad-37c6-4771-b294-a8d1669b849c\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") "
Jul 22 12:10:58.347278 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347260    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-model-cache\") pod \"4083aaad-37c6-4771-b294-a8d1669b849c\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") "
Jul 22 12:10:58.347501 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347300    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-dshm\") pod \"4083aaad-37c6-4771-b294-a8d1669b849c\" (UID: \"4083aaad-37c6-4771-b294-a8d1669b849c\") "
Jul 22 12:10:58.347501 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347397    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-home" (OuterVolumeSpecName: "home") pod "4083aaad-37c6-4771-b294-a8d1669b849c" (UID: "4083aaad-37c6-4771-b294-a8d1669b849c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:10:58.347622 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347520    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4083aaad-37c6-4771-b294-a8d1669b849c" (UID: "4083aaad-37c6-4771-b294-a8d1669b849c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:10:58.347679 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347662    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:58.347736 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347680    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:58.347736 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.347702    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-model-cache" (OuterVolumeSpecName: "model-cache") pod "4083aaad-37c6-4771-b294-a8d1669b849c" (UID: "4083aaad-37c6-4771-b294-a8d1669b849c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:10:58.349545 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.349513    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4083aaad-37c6-4771-b294-a8d1669b849c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4083aaad-37c6-4771-b294-a8d1669b849c" (UID: "4083aaad-37c6-4771-b294-a8d1669b849c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:10:58.349690 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.349563    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-dshm" (OuterVolumeSpecName: "dshm") pod "4083aaad-37c6-4771-b294-a8d1669b849c" (UID: "4083aaad-37c6-4771-b294-a8d1669b849c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:10:58.349887 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.349869    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4083aaad-37c6-4771-b294-a8d1669b849c-kube-api-access-w4cb4" (OuterVolumeSpecName: "kube-api-access-w4cb4") pod "4083aaad-37c6-4771-b294-a8d1669b849c" (UID: "4083aaad-37c6-4771-b294-a8d1669b849c"). InnerVolumeSpecName "kube-api-access-w4cb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:10:58.448393 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.448358    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4083aaad-37c6-4771-b294-a8d1669b849c-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:58.448393 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.448386    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4cb4\" (UniqueName: \"kubernetes.io/projected/4083aaad-37c6-4771-b294-a8d1669b849c-kube-api-access-w4cb4\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:58.448393 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.448398    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:58.448662 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.448407    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4083aaad-37c6-4771-b294-a8d1669b849c-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:58.895236 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:58.895189    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4" podUID="6f9b5c94-3ae0-4892-9191-fa6199179270" containerName="main" containerID="cri-o://2cfa03b9ac0bb874cdf1e8f88305f91ce87d9b960b65f8f9b5cd1b9759ae2912" gracePeriod=45
Jul 22 12:10:59.146767 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.146645    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"
Jul 22 12:10:59.146767 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.146650    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d" event={"ID":"4083aaad-37c6-4771-b294-a8d1669b849c","Type":"ContainerDied","Data":"31d117d96560713959b2a661b667675de8c4942b1732454eeea927b6df066ce9"}
Jul 22 12:10:59.146767 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.146710    2580 scope.go:117] "RemoveContainer" containerID="8af5cab2a110b66d0bc852ba31c71a3e9d9df74a9ac3cd2068ee3af77c7735f9"
Jul 22 12:10:59.148651 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.148258    2580 generic.go:356] "Generic (PLEG): container finished" podID="6f9b5c94-3ae0-4892-9191-fa6199179270" containerID="2cfa03b9ac0bb874cdf1e8f88305f91ce87d9b960b65f8f9b5cd1b9759ae2912" exitCode=0
Jul 22 12:10:59.148651 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.148429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4" event={"ID":"6f9b5c94-3ae0-4892-9191-fa6199179270","Type":"ContainerDied","Data":"2cfa03b9ac0bb874cdf1e8f88305f91ce87d9b960b65f8f9b5cd1b9759ae2912"}
Jul 22 12:10:59.148651 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.148466    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4" event={"ID":"6f9b5c94-3ae0-4892-9191-fa6199179270","Type":"ContainerDied","Data":"a0fb70bcd6b931a69e82d6a7c02aa939ad7afa8d4d472689600ad3574a2b18c3"}
Jul 22 12:10:59.148651 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.148489    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a0fb70bcd6b931a69e82d6a7c02aa939ad7afa8d4d472689600ad3574a2b18c3"
Jul 22 12:10:59.173611 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.173579    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:10:59.185508 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.185479    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"]
Jul 22 12:10:59.191998 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.191971    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-fc3650/rate-test-model-fc3650-kserve-54f5485bbc-c7n8d"]
Jul 22 12:10:59.254365 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254330    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f9b5c94-3ae0-4892-9191-fa6199179270-tls-certs\") pod \"6f9b5c94-3ae0-4892-9191-fa6199179270\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") "
Jul 22 12:10:59.254538 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254389    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcjdw\" (UniqueName: \"kubernetes.io/projected/6f9b5c94-3ae0-4892-9191-fa6199179270-kube-api-access-lcjdw\") pod \"6f9b5c94-3ae0-4892-9191-fa6199179270\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") "
Jul 22 12:10:59.254538 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254420    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-dshm\") pod \"6f9b5c94-3ae0-4892-9191-fa6199179270\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") "
Jul 22 12:10:59.254538 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-model-cache\") pod \"6f9b5c94-3ae0-4892-9191-fa6199179270\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") "
Jul 22 12:10:59.254538 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254536    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-home\") pod \"6f9b5c94-3ae0-4892-9191-fa6199179270\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") "
Jul 22 12:10:59.254760 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254571    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-tmp-dir\") pod \"6f9b5c94-3ae0-4892-9191-fa6199179270\" (UID: \"6f9b5c94-3ae0-4892-9191-fa6199179270\") "
Jul 22 12:10:59.254811 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254771    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-home" (OuterVolumeSpecName: "home") pod "6f9b5c94-3ae0-4892-9191-fa6199179270" (UID: "6f9b5c94-3ae0-4892-9191-fa6199179270"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:10:59.254811 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254789    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f9b5c94-3ae0-4892-9191-fa6199179270" (UID: "6f9b5c94-3ae0-4892-9191-fa6199179270"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:10:59.254911 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254893    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f9b5c94-3ae0-4892-9191-fa6199179270" (UID: "6f9b5c94-3ae0-4892-9191-fa6199179270"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:10:59.255045 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.254996    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-model-cache\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:59.255267 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.255052    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-home\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:59.256810 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.256786    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9b5c94-3ae0-4892-9191-fa6199179270-kube-api-access-lcjdw" (OuterVolumeSpecName: "kube-api-access-lcjdw") pod "6f9b5c94-3ae0-4892-9191-fa6199179270" (UID: "6f9b5c94-3ae0-4892-9191-fa6199179270"). InnerVolumeSpecName "kube-api-access-lcjdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 12:10:59.256810 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.256799    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f9b5c94-3ae0-4892-9191-fa6199179270-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f9b5c94-3ae0-4892-9191-fa6199179270" (UID: "6f9b5c94-3ae0-4892-9191-fa6199179270"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 12:10:59.256810 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.256803    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-dshm" (OuterVolumeSpecName: "dshm") pod "6f9b5c94-3ae0-4892-9191-fa6199179270" (UID: "6f9b5c94-3ae0-4892-9191-fa6199179270"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 12:10:59.356525 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.356483    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-dshm\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:59.356525 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.356516    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f9b5c94-3ae0-4892-9191-fa6199179270-tmp-dir\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:59.356525 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.356526    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f9b5c94-3ae0-4892-9191-fa6199179270-tls-certs\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:59.356525 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.356534    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcjdw\" (UniqueName: \"kubernetes.io/projected/6f9b5c94-3ae0-4892-9191-fa6199179270-kube-api-access-lcjdw\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:10:59.738113 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:10:59.738076    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4083aaad-37c6-4771-b294-a8d1669b849c" path="/var/lib/kubelet/pods/4083aaad-37c6-4771-b294-a8d1669b849c/volumes"
Jul 22 12:11:00.154059 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:00.154024    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"
Jul 22 12:11:00.174858 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:00.174823    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"]
Jul 22 12:11:00.185706 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:00.185675    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ae7383/rate-test-model-ae7383-kserve-7688447b79-qwdk4"]
Jul 22 12:11:01.737880 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:01.737846    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9b5c94-3ae0-4892-9191-fa6199179270" path="/var/lib/kubelet/pods/6f9b5c94-3ae0-4892-9191-fa6199179270/volumes"
Jul 22 12:11:03.583315 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.583281    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"]
Jul 22 12:11:03.583705 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.583676    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9b5c94-3ae0-4892-9191-fa6199179270" containerName="main"
Jul 22 12:11:03.583705 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.583687    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9b5c94-3ae0-4892-9191-fa6199179270" containerName="main"
Jul 22 12:11:03.583705 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.583702    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4083aaad-37c6-4771-b294-a8d1669b849c" containerName="main"
Jul 22 12:11:03.583705 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.583708    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4083aaad-37c6-4771-b294-a8d1669b849c" containerName="main"
Jul 22 12:11:03.583839 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.583779    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4083aaad-37c6-4771-b294-a8d1669b849c" containerName="main"
Jul 22 12:11:03.583839 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.583789    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9b5c94-3ae0-4892-9191-fa6199179270" containerName="main"
Jul 22 12:11:03.588128 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.588112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"
Jul 22 12:11:03.595938 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.595913    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 12:11:03.597675 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.597649    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 12:11:03.598348 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.598327    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"]
Jul 22 12:11:03.694769 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.694732    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeaee54-a209-448b-b4bc-2ab6f123ae8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-fc3650-wz227\" (UID: \"2aeaee54-a209-448b-b4bc-2ab6f123ae8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"
Jul 22 12:11:03.795458 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.795421    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeaee54-a209-448b-b4bc-2ab6f123ae8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-fc3650-wz227\" (UID: \"2aeaee54-a209-448b-b4bc-2ab6f123ae8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"
Jul 22 12:11:03.796050 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.795995    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeaee54-a209-448b-b4bc-2ab6f123ae8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-fc3650-wz227\" (UID: \"2aeaee54-a209-448b-b4bc-2ab6f123ae8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"
Jul 22 12:11:03.899781 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:03.899696    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"
Jul 22 12:11:04.045337 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:04.045301    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"]
Jul 22 12:11:04.047807 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:11:04.047769    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aeaee54_a209_448b_b4bc_2ab6f123ae8b.slice/crio-0a38b6830e65d3ed772674fdb065831c0f70fe739d1d7e6f994c34df62a4e435 WatchSource:0}: Error finding container 0a38b6830e65d3ed772674fdb065831c0f70fe739d1d7e6f994c34df62a4e435: Status 404 returned error can't find the container with id 0a38b6830e65d3ed772674fdb065831c0f70fe739d1d7e6f994c34df62a4e435
Jul 22 12:11:04.176816 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:04.176731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227" event={"ID":"2aeaee54-a209-448b-b4bc-2ab6f123ae8b","Type":"ContainerStarted","Data":"0a38b6830e65d3ed772674fdb065831c0f70fe739d1d7e6f994c34df62a4e435"}
Jul 22 12:11:05.183712 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:05.183676    2580 generic.go:356] "Generic (PLEG): container finished" podID="2aeaee54-a209-448b-b4bc-2ab6f123ae8b" containerID="5b5bb31f45aa0f20304931b89239e03683dd6642bbca034ac09ee6e44ffc1a5a" exitCode=0
Jul 22 12:11:05.184144 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:05.183723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227" event={"ID":"2aeaee54-a209-448b-b4bc-2ab6f123ae8b","Type":"ContainerDied","Data":"5b5bb31f45aa0f20304931b89239e03683dd6642bbca034ac09ee6e44ffc1a5a"}
Jul 22 12:11:06.326160 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:06.326127    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"
Jul 22 12:11:06.418402 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:06.418366    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeaee54-a209-448b-b4bc-2ab6f123ae8b-maas-api-service-ca\") pod \"2aeaee54-a209-448b-b4bc-2ab6f123ae8b\" (UID: \"2aeaee54-a209-448b-b4bc-2ab6f123ae8b\") "
Jul 22 12:11:06.418722 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:06.418696    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aeaee54-a209-448b-b4bc-2ab6f123ae8b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2aeaee54-a209-448b-b4bc-2ab6f123ae8b" (UID: "2aeaee54-a209-448b-b4bc-2ab6f123ae8b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:11:06.519847 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:06.519757    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeaee54-a209-448b-b4bc-2ab6f123ae8b-maas-api-service-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:11:07.194978 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:07.194942    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227" event={"ID":"2aeaee54-a209-448b-b4bc-2ab6f123ae8b","Type":"ContainerDied","Data":"0a38b6830e65d3ed772674fdb065831c0f70fe739d1d7e6f994c34df62a4e435"}
Jul 22 12:11:07.195227 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:07.195017    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a38b6830e65d3ed772674fdb065831c0f70fe739d1d7e6f994c34df62a4e435"
Jul 22 12:11:07.195227 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:07.194951    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"
Jul 22 12:11:17.318828 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:17.318783    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:11:18.688931 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:18.688850    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"]
Jul 22 12:11:18.692130 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:18.692103    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-fc3650-wz227"]
Jul 22 12:11:19.737560 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:19.737528    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aeaee54-a209-448b-b4bc-2ab6f123ae8b" path="/var/lib/kubelet/pods/2aeaee54-a209-448b-b4bc-2ab6f123ae8b/volumes"
Jul 22 12:11:25.973571 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:25.973528    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"]
Jul 22 12:11:25.974511 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:25.974486    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeaee54-a209-448b-b4bc-2ab6f123ae8b" containerName="revoke-keys"
Jul 22 12:11:25.974628 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:25.974515    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeaee54-a209-448b-b4bc-2ab6f123ae8b" containerName="revoke-keys"
Jul 22 12:11:25.974745 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:25.974731    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aeaee54-a209-448b-b4bc-2ab6f123ae8b" containerName="revoke-keys"
Jul 22 12:11:25.979446 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:25.979413    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"
Jul 22 12:11:25.982045 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:25.981988    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"]
Jul 22 12:11:25.982249 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:25.982227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-m4wzf\""
Jul 22 12:11:25.982324 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:25.982235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 12:11:26.105636 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:26.105605    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeff2a4-830d-4288-a1ec-cca17848eb4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn\" (UID: \"2aeff2a4-830d-4288-a1ec-cca17848eb4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"
Jul 22 12:11:26.206942 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:26.206904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeff2a4-830d-4288-a1ec-cca17848eb4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn\" (UID: \"2aeff2a4-830d-4288-a1ec-cca17848eb4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"
Jul 22 12:11:26.207576 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:26.207554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeff2a4-830d-4288-a1ec-cca17848eb4c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn\" (UID: \"2aeff2a4-830d-4288-a1ec-cca17848eb4c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"
Jul 22 12:11:26.291947 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:26.291855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"
Jul 22 12:11:26.438712 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:26.438681    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"]
Jul 22 12:11:26.440694 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:11:26.440665    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aeff2a4_830d_4288_a1ec_cca17848eb4c.slice/crio-f0f278f31a593c6d44052c4fac1d563a031a1088d286a7e88fd2de5b0f8fc86b WatchSource:0}: Error finding container f0f278f31a593c6d44052c4fac1d563a031a1088d286a7e88fd2de5b0f8fc86b: Status 404 returned error can't find the container with id f0f278f31a593c6d44052c4fac1d563a031a1088d286a7e88fd2de5b0f8fc86b
Jul 22 12:11:27.301915 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:27.301882    2580 generic.go:356] "Generic (PLEG): container finished" podID="2aeff2a4-830d-4288-a1ec-cca17848eb4c" containerID="ad62ab6125b764dd62a8fe8122ab1f00ed4bda3fd8e7e6c23b1fecf1201c4bfe" exitCode=0
Jul 22 12:11:27.302320 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:27.301973    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn" event={"ID":"2aeff2a4-830d-4288-a1ec-cca17848eb4c","Type":"ContainerDied","Data":"ad62ab6125b764dd62a8fe8122ab1f00ed4bda3fd8e7e6c23b1fecf1201c4bfe"}
Jul 22 12:11:27.302320 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:27.302033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn" event={"ID":"2aeff2a4-830d-4288-a1ec-cca17848eb4c","Type":"ContainerStarted","Data":"f0f278f31a593c6d44052c4fac1d563a031a1088d286a7e88fd2de5b0f8fc86b"}
Jul 22 12:11:28.455969 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:28.455945    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"
Jul 22 12:11:28.629549 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:28.629510    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeff2a4-830d-4288-a1ec-cca17848eb4c-maas-api-service-ca\") pod \"2aeff2a4-830d-4288-a1ec-cca17848eb4c\" (UID: \"2aeff2a4-830d-4288-a1ec-cca17848eb4c\") "
Jul 22 12:11:28.629880 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:28.629857    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aeff2a4-830d-4288-a1ec-cca17848eb4c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2aeff2a4-830d-4288-a1ec-cca17848eb4c" (UID: "2aeff2a4-830d-4288-a1ec-cca17848eb4c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 12:11:28.731128 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:28.730978    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2aeff2a4-830d-4288-a1ec-cca17848eb4c-maas-api-service-ca\") on node \"ip-10-0-136-126.ec2.internal\" DevicePath \"\""
Jul 22 12:11:29.313405 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:29.313370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn" event={"ID":"2aeff2a4-830d-4288-a1ec-cca17848eb4c","Type":"ContainerDied","Data":"f0f278f31a593c6d44052c4fac1d563a031a1088d286a7e88fd2de5b0f8fc86b"}
Jul 22 12:11:29.313628 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:29.313420    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0f278f31a593c6d44052c4fac1d563a031a1088d286a7e88fd2de5b0f8fc86b"
Jul 22 12:11:29.313628 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:29.313375    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"
Jul 22 12:11:39.500697 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:39.500658    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5gvpt"]
Jul 22 12:11:41.065551 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:41.065511    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"]
Jul 22 12:11:41.068598 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:41.068570    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ae7383-ndxdn"]
Jul 22 12:11:41.738272 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:41.738238    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aeff2a4-830d-4288-a1ec-cca17848eb4c" path="/var/lib/kubelet/pods/2aeff2a4-830d-4288-a1ec-cca17848eb4c/volumes"
Jul 22 12:11:54.765909 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:54.765879    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rdzrl_b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb/manager/0.log"
Jul 22 12:11:54.900410 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:54.900384    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f7f7m_3f9bce89-eea1-48af-8119-d0f2ea2ed5ec/manager/1.log"
Jul 22 12:11:55.543300 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:55.543271    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm_f6d648ca-57e3-4ec9-a774-8a6a9c95cb72/copy-manifests/0.log"
Jul 22 12:11:55.551382 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:55.551359    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm_f6d648ca-57e3-4ec9-a774-8a6a9c95cb72/manager/0.log"
Jul 22 12:11:56.179042 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:56.179000    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745345-qdtzc_0f0c1775-1a7f-49ed-958f-27a5f6e3f764/cleanup/0.log"
Jul 22 12:11:56.302693 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:56.302658    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29745360-vrk4q_fba97201-3994-4b2b-868d-c8439182d22d/cleanup/0.log"
Jul 22 12:11:57.938503 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:57.938469    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lhtx2_8b432656-b391-4bca-b512-ee57b4dbd9cc/manager/0.log"
Jul 22 12:11:58.062382 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:58.062357    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bb5lf_b46b2061-7dc7-4d8f-bdd9-282466b7a2e5/manager/1.log"
Jul 22 12:11:58.311936 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:58.311846    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wz76x_76b794a5-9803-4671-9608-deebbe1ddbb1/registry-server/0.log"
Jul 22 12:11:58.443868 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:58.443832    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6bh4s_3947e3ed-ddb2-4e6a-baa5-dccfd609088a/manager/0.log"
Jul 22 12:11:58.572996 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:58.572969    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5gvpt_c397412c-8221-4cb8-a522-97d77953b8d5/limitador/0.log"
Jul 22 12:11:59.843939 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:11:59.843901    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dbsx2_57991e3a-2545-4b2f-a97e-4e6b40f38f16/payload-processing/0.log"
Jul 22 12:12:00.713322 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:00.713291    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fvcf8p_671e0fa9-0027-456e-922a-13754d6b9984/main/0.log"
Jul 22 12:12:00.963246 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:00.963190    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-527bs_105519bc-8ba3-490b-a656-095461cd98fb/main/0.log"
Jul 22 12:12:12.123082 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:12.123042    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lrgrw_2b291c26-0ec8-431a-8c98-1b33c9abc600/global-pull-secret-syncer/0.log"
Jul 22 12:12:12.258695 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:12.258657    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z25mq_04424bd6-9ee4-41be-b934-f966eb467d50/konnectivity-agent/0.log"
Jul 22 12:12:12.313845 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:12.313814    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-126.ec2.internal_5c6296955c2fb4ca1bbfcf5b3caef41f/haproxy/0.log"
Jul 22 12:12:17.675168 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:17.675138    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-lhtx2_8b432656-b391-4bca-b512-ee57b4dbd9cc/manager/0.log"
Jul 22 12:12:17.714300 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:17.714273    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bb5lf_b46b2061-7dc7-4d8f-bdd9-282466b7a2e5/manager/1.log"
Jul 22 12:12:17.714465 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:17.714374    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bb5lf_b46b2061-7dc7-4d8f-bdd9-282466b7a2e5/manager/0.log"
Jul 22 12:12:17.781724 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:17.781697    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wz76x_76b794a5-9803-4671-9608-deebbe1ddbb1/registry-server/0.log"
Jul 22 12:12:17.949338 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:17.949255    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6bh4s_3947e3ed-ddb2-4e6a-baa5-dccfd609088a/manager/0.log"
Jul 22 12:12:17.986462 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:17.986433    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5gvpt_c397412c-8221-4cb8-a522-97d77953b8d5/limitador/0.log"
Jul 22 12:12:19.837599 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:19.837570    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62e89161-a4b3-4bae-b2c4-af6143cadbd8/alertmanager/0.log"
Jul 22 12:12:19.868163 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:19.868124    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62e89161-a4b3-4bae-b2c4-af6143cadbd8/config-reloader/0.log"
Jul 22 12:12:19.897749 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:19.897726    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62e89161-a4b3-4bae-b2c4-af6143cadbd8/kube-rbac-proxy-web/0.log"
Jul 22 12:12:19.921141 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:19.921111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62e89161-a4b3-4bae-b2c4-af6143cadbd8/kube-rbac-proxy/0.log"
Jul 22 12:12:19.947168 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:19.947144    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62e89161-a4b3-4bae-b2c4-af6143cadbd8/kube-rbac-proxy-metric/0.log"
Jul 22 12:12:19.972931 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:19.972910    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62e89161-a4b3-4bae-b2c4-af6143cadbd8/prom-label-proxy/0.log"
Jul 22 12:12:19.998129 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:19.998057    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_62e89161-a4b3-4bae-b2c4-af6143cadbd8/init-config-reloader/0.log"
Jul 22 12:12:20.163236 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.163207    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c9c6d94b-qxgd8_3cc6f5d9-0870-44f6-98da-62fc24b2005c/metrics-server/0.log"
Jul 22 12:12:20.402116 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.402086    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xph6l_be638fa3-99e4-46a7-9efc-beba657e4850/node-exporter/0.log"
Jul 22 12:12:20.427110 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.427074    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xph6l_be638fa3-99e4-46a7-9efc-beba657e4850/kube-rbac-proxy/0.log"
Jul 22 12:12:20.452840 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.452816    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xph6l_be638fa3-99e4-46a7-9efc-beba657e4850/init-textfile/0.log"
Jul 22 12:12:20.482837 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.482807    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vfk7w_4a24ecd4-d305-411f-b243-ff5bb2018aaf/kube-rbac-proxy-main/0.log"
Jul 22 12:12:20.508323 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.508299    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vfk7w_4a24ecd4-d305-411f-b243-ff5bb2018aaf/kube-rbac-proxy-self/0.log"
Jul 22 12:12:20.532161 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.532099    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-vfk7w_4a24ecd4-d305-411f-b243-ff5bb2018aaf/openshift-state-metrics/0.log"
Jul 22 12:12:20.570437 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.570415    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efedb072-6df9-431d-a649-d94274b34136/prometheus/0.log"
Jul 22 12:12:20.594425 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.594403    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efedb072-6df9-431d-a649-d94274b34136/config-reloader/0.log"
Jul 22 12:12:20.618194 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.618170    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efedb072-6df9-431d-a649-d94274b34136/thanos-sidecar/0.log"
Jul 22 12:12:20.645786 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.645768    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efedb072-6df9-431d-a649-d94274b34136/kube-rbac-proxy-web/0.log"
Jul 22 12:12:20.670025 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.669976    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efedb072-6df9-431d-a649-d94274b34136/kube-rbac-proxy/0.log"
Jul 22 12:12:20.698313 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.698291    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efedb072-6df9-431d-a649-d94274b34136/kube-rbac-proxy-thanos/0.log"
Jul 22 12:12:20.724052 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.724030    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_efedb072-6df9-431d-a649-d94274b34136/init-config-reloader/0.log"
Jul 22 12:12:20.805418 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.805338    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-jrvwm_e447bdfe-3160-44ae-94a5-9e16846e5baf/prometheus-operator-admission-webhook/0.log"
Jul 22 12:12:20.918708 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.918681    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89fd88777-zgt7v_5c479ef6-8bcb-45fe-9a0d-9594e90c73c2/thanos-query/0.log"
Jul 22 12:12:20.942318 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.942292    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89fd88777-zgt7v_5c479ef6-8bcb-45fe-9a0d-9594e90c73c2/kube-rbac-proxy-web/0.log"
Jul 22 12:12:20.967069 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.967043    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89fd88777-zgt7v_5c479ef6-8bcb-45fe-9a0d-9594e90c73c2/kube-rbac-proxy/0.log"
Jul 22 12:12:20.988524 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:20.988502    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89fd88777-zgt7v_5c479ef6-8bcb-45fe-9a0d-9594e90c73c2/prom-label-proxy/0.log"
Jul 22 12:12:21.012898 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:21.012878    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89fd88777-zgt7v_5c479ef6-8bcb-45fe-9a0d-9594e90c73c2/kube-rbac-proxy-rules/0.log"
Jul 22 12:12:21.035654 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:21.035632    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-89fd88777-zgt7v_5c479ef6-8bcb-45fe-9a0d-9594e90c73c2/kube-rbac-proxy-metrics/0.log"
Jul 22 12:12:22.180997 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.180955    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"]
Jul 22 12:12:22.181445 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.181432    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeff2a4-830d-4288-a1ec-cca17848eb4c" containerName="revoke-keys"
Jul 22 12:12:22.181498 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.181448    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeff2a4-830d-4288-a1ec-cca17848eb4c" containerName="revoke-keys"
Jul 22 12:12:22.181533 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.181517    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aeff2a4-830d-4288-a1ec-cca17848eb4c" containerName="revoke-keys"
Jul 22 12:12:22.184933 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.184913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.187666 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.187649    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5cxcj\"/\"openshift-service-ca.crt\""
Jul 22 12:12:22.187770 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.187678    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5cxcj\"/\"default-dockercfg-c9d98\""
Jul 22 12:12:22.188940 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.188921    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5cxcj\"/\"kube-root-ca.crt\""
Jul 22 12:12:22.198294 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.198268    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"]
Jul 22 12:12:22.214432 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.214400    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-sys\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.214432 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.214435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-proc\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.214646 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.214452    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-lib-modules\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.214646 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.214567    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk66k\" (UniqueName: \"kubernetes.io/projected/cf0159ff-ed19-413d-be06-aded2ffe54cd-kube-api-access-pk66k\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.214646 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.214607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-podres\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.314996 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.314959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-sys\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.314996 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.314996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-proc\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.315274 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.315033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-lib-modules\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.315274 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.315106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk66k\" (UniqueName: \"kubernetes.io/projected/cf0159ff-ed19-413d-be06-aded2ffe54cd-kube-api-access-pk66k\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.315274 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.315111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-proc\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.315274 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.315134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-podres\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.315274 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.315111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-sys\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.315274 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.315227    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-podres\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.315274 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.315228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cf0159ff-ed19-413d-be06-aded2ffe54cd-lib-modules\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.317075 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.317055    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-h656p_db409ef1-f73e-4255-95ba-5db0fa69ca89/networking-console-plugin/0.log"
Jul 22 12:12:22.325053 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.325032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk66k\" (UniqueName: \"kubernetes.io/projected/cf0159ff-ed19-413d-be06-aded2ffe54cd-kube-api-access-pk66k\") pod \"perf-node-gather-daemonset-5j8kq\" (UID: \"cf0159ff-ed19-413d-be06-aded2ffe54cd\") " pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.495292 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.495199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:22.635304 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:22.635279    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"]
Jul 22 12:12:22.637633 ip-10-0-136-126 kubenswrapper[2580]: W0722 12:12:22.637602    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcf0159ff_ed19_413d_be06_aded2ffe54cd.slice/crio-2e40d1e47e409205b3cf8460c1b857e1dddfd8551f78127598f7116af30823f0 WatchSource:0}: Error finding container 2e40d1e47e409205b3cf8460c1b857e1dddfd8551f78127598f7116af30823f0: Status 404 returned error can't find the container with id 2e40d1e47e409205b3cf8460c1b857e1dddfd8551f78127598f7116af30823f0
Jul 22 12:12:23.599659 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:23.599626    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq" event={"ID":"cf0159ff-ed19-413d-be06-aded2ffe54cd","Type":"ContainerStarted","Data":"7e468f70bef3a9e0af4b5f2449fba5cc57cc5aeb39e1858c808f9689930e355f"}
Jul 22 12:12:23.600092 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:23.599673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq" event={"ID":"cf0159ff-ed19-413d-be06-aded2ffe54cd","Type":"ContainerStarted","Data":"2e40d1e47e409205b3cf8460c1b857e1dddfd8551f78127598f7116af30823f0"}
Jul 22 12:12:23.600092 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:23.599763    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:23.610059 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:23.610033    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-hlxqk_73dc3655-0cca-49d1-98d3-fa797388b04c/download-server/0.log"
Jul 22 12:12:23.621612 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:23.621560    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq" podStartSLOduration=1.6215453800000001 podStartE2EDuration="1.62154538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 12:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 12:12:23.619669016 +0000 UTC m=+2936.282316276" watchObservedRunningTime="2026-07-22 12:12:23.62154538 +0000 UTC m=+2936.284192638"
Jul 22 12:12:25.315637 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:25.315611    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8wvnx_4229844a-3cd0-48a0-9008-d0c66b82ca19/dns/0.log"
Jul 22 12:12:25.339516 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:25.339494    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8wvnx_4229844a-3cd0-48a0-9008-d0c66b82ca19/kube-rbac-proxy/0.log"
Jul 22 12:12:25.538584 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:25.538559    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lgcn4_8edc813e-e977-410e-82d2-647dd46ab2dd/dns-node-resolver/0.log"
Jul 22 12:12:26.177439 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:26.177408    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qxssw_3020fce0-be50-4058-9ef6-56113e710a41/node-ca/0.log"
Jul 22 12:12:27.618335 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:27.618292    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dbsx2_57991e3a-2545-4b2f-a97e-4e6b40f38f16/payload-processing/0.log"
Jul 22 12:12:28.471151 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:28.471122    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ql9tn_3493414e-2373-4eb3-a79c-97377bb82d94/serve-healthcheck-canary/0.log"
Jul 22 12:12:29.127063 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:29.127035    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8hrmm_54a6dde2-73c1-4b9f-a3f7-d121949aa201/kube-rbac-proxy/0.log"
Jul 22 12:12:29.150591 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:29.150564    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8hrmm_54a6dde2-73c1-4b9f-a3f7-d121949aa201/exporter/0.log"
Jul 22 12:12:29.176286 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:29.176257    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8hrmm_54a6dde2-73c1-4b9f-a3f7-d121949aa201/extractor/0.log"
Jul 22 12:12:29.616142 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:29.616117    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5cxcj/perf-node-gather-daemonset-5j8kq"
Jul 22 12:12:31.639164 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:31.639126    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-rdzrl_b6e6fdeb-e6c3-4148-bde4-cbb4b564aafb/manager/0.log"
Jul 22 12:12:31.773850 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:31.773810    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f7f7m_3f9bce89-eea1-48af-8119-d0f2ea2ed5ec/manager/0.log"
Jul 22 12:12:31.803552 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:31.803519    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-f7f7m_3f9bce89-eea1-48af-8119-d0f2ea2ed5ec/manager/1.log"
Jul 22 12:12:32.130342 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:32.130308    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm_f6d648ca-57e3-4ec9-a774-8a6a9c95cb72/manager/0.log"
Jul 22 12:12:32.156694 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:32.156669    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74f4ff9cd9-6kkgm_f6d648ca-57e3-4ec9-a774-8a6a9c95cb72/copy-manifests/0.log"
Jul 22 12:12:32.931959 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:32.931933    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dbsx2_57991e3a-2545-4b2f-a97e-4e6b40f38f16/payload-processing/0.log"
Jul 22 12:12:33.620606 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:33.620581    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55d777d8cf-xgqrf_02cdddf2-36e4-40c2-9e97-1277766ef6c3/manager/0.log"
Jul 22 12:12:34.490207 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:34.490177    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-dbsx2_57991e3a-2545-4b2f-a97e-4e6b40f38f16/payload-processing/0.log"
Jul 22 12:12:38.665997 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:38.665961    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-mr7n6_23269cf9-5626-4375-b784-2084c32074b7/migrator/0.log"
Jul 22 12:12:38.692572 ip-10-0-136-126 kubenswrapper[2580]: I0722 12:12:38.692544    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-mr7n6_23269cf9-5626-4375-b784-2084c32074b7/graceful-termination/0.log"