Jul 02 19:03:05.299906 ip-10-0-131-135 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:03:05.745932 ip-10-0-131-135 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:03:05.745932 ip-10-0-131-135 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:03:05.745932 ip-10-0-131-135 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:03:05.745932 ip-10-0-131-135 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:03:05.745932 ip-10-0-131-135 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:03:05.748766 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.748597    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:03:05.754660 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754641    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:03:05.754660 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754661    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754664    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754667    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754670    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754675    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754678    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754681    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754683    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754686    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754689    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754692    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754694    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754699    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754703    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754706    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754709    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754712    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754714    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754717    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754720    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:03:05.754736 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754723    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754726    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754728    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754731    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754733    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754736    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754739    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754741    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754744    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754747    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754750    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754753    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754755    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754758    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754760    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754763    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754765    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754768    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754771    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:03:05.755197 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754773    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754775    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754778    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754782    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754784    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754786    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754789    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754791    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754793    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754796    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754798    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754800    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754803    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754805    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754808    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754811    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754814    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754816    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754819    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754821    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:03:05.755678 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754824    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754827    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754830    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754833    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754837    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754840    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754843    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754846    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754849    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754851    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754854    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754857    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754861    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754864    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754867    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754869    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754872    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754875    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754878    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:03:05.756206 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754880    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754885    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754888    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754890    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754892    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754895    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754897    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754900    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754904    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754907    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754910    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754912    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754915    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754917    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754919    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754922    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754924    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754926    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754929    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.754932    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:03:05.756675 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755680    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755687    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755690    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755693    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755696    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755699    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755702    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755704    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755707    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755709    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755712    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755715    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755717    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755720    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755723    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755725    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755728    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755730    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755733    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755735    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:03:05.757171 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755738    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755742    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755744    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755747    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755749    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755752    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755755    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755758    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755760    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755762    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755765    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755768    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755770    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755772    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755775    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755777    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755780    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755783    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755786    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755788    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:03:05.757674 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755791    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755794    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755796    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755799    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755801    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755804    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755807    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755809    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755812    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755814    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755819    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755823    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755826    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755830    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755834    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755838    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755842    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755845    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755847    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:03:05.758172 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755850    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755853    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755856    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755858    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755860    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755863    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755865    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755868    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755870    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755873    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755875    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755878    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755880    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755883    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755886    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755889    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755892    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755894    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755896    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:03:05.758658 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755899    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755902    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755906    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755910    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755913    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755916    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755919    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755922    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755925    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755927    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755930    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755933    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755935    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755938    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755940    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755942    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755945    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755947    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755950    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:03:05.759138 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755953    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.755955    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756364    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756370    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756373    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756376    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756380    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756383    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756385    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756388    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756391    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756393    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756396    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756398    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756401    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756403    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756406    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756408    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756411    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756415    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:03:05.759723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756418    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756421    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756424    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756427    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756430    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756432    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756435    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756437    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756440    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756442    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756445    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756448    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756451    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756454    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756456    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756459    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756461    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756464    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756466    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:03:05.760208 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756470    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756472    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756475    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756477    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756480    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756482    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756485    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756487    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756490    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756492    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756495    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756497    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756500    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756502    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756505    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756507    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756510    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756512    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756516    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756519    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:03:05.760687 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756523    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756525    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756528    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756530    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756533    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756535    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756538    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756540    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756543    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756545    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756548    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756551    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756553    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756556    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756559    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756561    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756564    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756567    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756570    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:03:05.761202 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756572    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756575    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756577    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756579    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756582    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756584    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756586    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756589    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756591    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756594    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756596    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756614    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756617    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756620    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756622    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756625    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756627    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756630    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756632    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756635    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:03:05.761672 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756637    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756641    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.756645    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756722    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756739    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756746    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756751    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756756    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756759    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756766    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756771    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756774    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756777    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756781    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756784    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756788    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756804    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756808    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756812    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756815    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756818    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756822    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756825    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:03:05.762151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756828    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756831    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756834    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756838    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756841    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756844    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756847    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756851    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756854    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756857    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756860    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756863    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756867    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756870    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756873    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756876    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756878    2577 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756882    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756888    2577 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756891    2577 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756893    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756896    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756900    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756903    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:03:05.762748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756906    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756909    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756912    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756915    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756918    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756921    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756923    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756926    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756929    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756932    2577 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756935    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756938    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756941    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756944    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756949    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756952    2577 flags.go:64] FLAG: --help="false"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756954    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-131-135.ec2.internal"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756957    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756960    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756963    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756966    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756970    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756972    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:03:05.763321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756975    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756978    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756981    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756986    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756989    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756992    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756995    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.756997    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757000    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757003    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757006    2577 flags.go:64] FLAG: --lock-file=""
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757009    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757011    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757014    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757019    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757022    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757025    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757035    2577 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757039    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757042    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757045    2577 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757048    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757053    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757057    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757061    2577 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:03:05.763903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757064    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757067    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757070    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757073    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757076    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757079    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757082    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757089    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757092    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757094    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757099    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757102    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757108    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757111    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757114    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757117    2577 flags.go:64] FLAG: --port="10250"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757120    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757123    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-010c707f47f4667c8"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757126    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757129    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757131    2577 flags.go:64] FLAG: --register-node="true"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757134    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757138    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757140    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:03:05.764560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757143    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757146    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757149    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757152    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757155    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757158    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757160    2577 flags.go:64] FLAG: --runonce="false"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757166    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757169    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757172    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757175    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757177    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757180    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757183    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757187    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757190    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757192    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757195    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757199    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757202    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757205    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757208    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757214    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757216    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757219    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:03:05.765167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757224    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757226    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757229    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757232    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757234    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757237    2577 flags.go:64] FLAG: --v="2"
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757241    2577 flags.go:64] FLAG: --version="false"
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757245    2577 flags.go:64] FLAG: --vmodule=""
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757248    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757251    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757371    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757375    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757378    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757381    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757385    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757388    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757390    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757393    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757395    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757398    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757400    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757403    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:03:05.765791 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757405    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757408    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757411    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757415    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757417    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757421    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757425    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757428    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757431    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757434    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757436    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757439    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757441    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757444    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757446    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757449    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757451    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757454    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757456    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:03:05.766327 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757458    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757461    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757464    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757466    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757469    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757472    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757475    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757478    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757480    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757482    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757485    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757488    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757490    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757493    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757495    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757498    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757502    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757504    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757506    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757509    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:03:05.766801 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757512    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757514    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757518    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757521    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757524    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757527    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757529    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757532    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757534    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757537    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757539    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757542    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757544    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757547    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757549    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757552    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757554    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757558    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757560    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:03:05.767289 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757563    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757565    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757569    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757573    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757575    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757578    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757580    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757583    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757585    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757588    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757591    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757593    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757596    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757614    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757617    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757620    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757622    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757624    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757627    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757630    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:03:05.767758 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757632    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757635    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757637    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757640    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757642    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757645    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757647    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757649    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.757652    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.757661    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.765426    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.765445    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.765465    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.765475    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:03:05.768246 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765541    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765547    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765552    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765555    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765559    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765562    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765566    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765568    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765571    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765574    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765576    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765579    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765581    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765584    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765587    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765589    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765592    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765594    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765597    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:03:05.768585 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765616    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765619    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765622    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765625    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765627    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765630    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765632    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765635    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765639    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765643    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765654    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765657    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765659    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765662    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765665    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765668    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765670    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765673    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765675    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:03:05.769082 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765678    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765680    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765683    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765685    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765688    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765690    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765693    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765695    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765698    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765700    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765703    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765706    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765708    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765711    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765713    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765716    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765718    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765721    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765724    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765726    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:03:05.769582 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765728    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765732    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765736    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765740    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765748    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765751    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765759    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765762    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765765    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765767    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765770    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765773    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765775    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765777    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765780    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765782    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765784    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765787    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765789    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765792    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:03:05.776038 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765794    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765797    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765800    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765803    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765805    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765808    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765810    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765813    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765815    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765818    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765820    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765822    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765825    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765827    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765830    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765833    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765836    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765844    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765847    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:03:05.776822 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765849    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.765852    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.765857    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766011    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766017    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766020    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766023    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766026    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766029    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766032    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766037    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766039    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766042    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766045    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:03:05.777633 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766047    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766050    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766052    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766055    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766057    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766060    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766062    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766065    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766067    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766070    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766072    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766075    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766077    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766080    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766082    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766085    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766087    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766096    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766099    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766101    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:03:05.778054 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766104    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766106    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766109    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766111    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766114    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766116    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766119    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766121    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766125    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766128    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766131    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766135    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766137    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766140    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766143    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766145    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766148    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766150    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766152    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:03:05.778547 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766155    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766157    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766160    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766162    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766165    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766168    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766171    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766173    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766176    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766178    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766181    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766189    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766192    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766194    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766197    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766200    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766202    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766205    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766207    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:03:05.779069 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766209    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766212    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766214    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766217    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766219    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766221    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766224    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766226    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766229    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766231    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766234    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766236    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766239    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766241    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766244    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766246    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766249    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766251    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766254    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766257    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:03:05.779562 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766259    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766262    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766265    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766267    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766269    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766278    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766281    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766283    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766286    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:05.766288    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.766293    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.766434    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.769518    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.771308    2577 server.go:1019] "Starting client certificate rotation"
Jul 02 19:03:05.780067 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.771409    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:03:05.780443 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.771443    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:03:05.780443 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.775215    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:03:05.786349 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.786320    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:03:05.800210 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.800189    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:03:05.802861 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.802844    2577 log.go:25] "Validated CRI v1 image API"
Jul 02 19:03:05.803868 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.803851    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:03:05.805681 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.805662    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:03:05.809283 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.809255    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7ffb60ff-e218-407a-b0d5-d9b2a8ec8935:/dev/nvme0n1p3 be9502a5-6d7b-497e-b129-02388813f30a:/dev/nvme0n1p4]
Jul 02 19:03:05.809365 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.809284    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:03:05.813695 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.813556    2577 manager.go:216] Machine: {Timestamp:2026-07-02 19:03:05.813074233 +0000 UTC m=+0.381332681 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3070010 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec298307073bef902afbf3d95f25cb3c SystemUUID:ec298307-073b-ef90-2afb-f3d95f25cb3c BootID:085dadf0-4175-49e8-a439-98714f866a72 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:7a:93:40:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:7a:93:40:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:82:15:3d:16:47 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:03:05.813695 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.813680    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:03:05.813863 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.813793    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:03:05.817478 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.817448    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:03:05.817649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.817483    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-135.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:03:05.818347 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.818336    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:03:05.818376 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.818350    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:03:05.818376 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.818358    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:03:05.818376 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.818372    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:03:05.820067 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.820056    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:03:05.824221 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824205    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:03:05.824369 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824359    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:03:05.824408 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824392    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:03:05.824408 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824404    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:03:05.824468 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824418    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:03:05.824468 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824428    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:03:05.824468 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824455    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:03:05.824859 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824848    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:03:05.824894 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.824867    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:03:05.827584 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.827567    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:03:05.829926 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.829912    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:03:05.829977 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.829942    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:03:05.831367 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831355    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:03:05.831403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831371    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:03:05.831403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831377    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:03:05.831403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831382    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:03:05.831403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831390    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:03:05.831403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831396    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:03:05.831403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831404    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:03:05.831571 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831409    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:03:05.831571 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831416    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:03:05.831571 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831421    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:03:05.831571 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831430    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:03:05.831571 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.831436    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:03:05.832366 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.832356    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:03:05.832366 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.832366    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:03:05.835563 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.835549    2577 server.go:1268] "Started kubelet"
Jul 02 19:03:05.840948 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.840699    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:03:05.841057 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.840962    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:03:05.841512 ip-10-0-131-135 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:03:05.841963 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.835709    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:03:05.845230 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.845088    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:03:05.845928 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.845910    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:03:05.846033 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.845996    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:03:05.846246 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.846222    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:03:05.846331 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.846304    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-135.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:03:05.847320 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.847300    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:03:05.848935 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.847886    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-135.ec2.internal.18be8e521e80da28  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-135.ec2.internal,UID:ip-10-0-131-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-135.ec2.internal,},FirstTimestamp:2026-07-02 19:03:05.835518504 +0000 UTC m=+0.403776951,LastTimestamp:2026-07-02 19:03:05.835518504 +0000 UTC m=+0.403776951,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-135.ec2.internal,}"
Jul 02 19:03:05.852957 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.852935    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:03:05.852957 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.852941    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:03:05.853118 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.853049    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:05.853779 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.853735    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:03:05.853779 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.853747    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:03:05.853779 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.853762    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:03:05.853937 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.853863    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:03:05.853937 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.853873    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:03:05.854812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.854797    2577 factory.go:55] Registering systemd factory
Jul 02 19:03:05.854812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.854813    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:03:05.855162 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.855147    2577 factory.go:153] Registering CRI-O factory
Jul 02 19:03:05.855233 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.855165    2577 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:03:05.855233 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.855222    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:03:05.855413 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.855243    2577 factory.go:103] Registering Raw factory
Jul 02 19:03:05.855413 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.855254    2577 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:03:05.855925 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.855906    2577 manager.go:349] Starting recovery of all containers
Jul 02 19:03:05.858681 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.858657    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-135.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 19:03:05.858803 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.858782    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 19:03:05.865957 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.865775    2577 manager.go:354] Recovery completed
Jul 02 19:03:05.870764 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.870751    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:03:05.872762 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.872741    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:03:05.872857 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.872776    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:03:05.872857 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.872791    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:03:05.873305 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.873291    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:03:05.873305 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.873303    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:03:05.873413 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.873312    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:03:05.873413 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.873319    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:03:05.874144 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.874128    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:03:05.874215 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.874157    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:03:05.874215 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.874166    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:03:05.874756 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.874719    2577 policy_none.go:49] "None policy: Start"
Jul 02 19:03:05.874811 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.874762    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:03:05.874811 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.874777    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:03:05.875345 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.875030    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-135.ec2.internal.18be8e5220b9227c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-135.ec2.internal,UID:ip-10-0-131-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-135.ec2.internal,},FirstTimestamp:2026-07-02 19:03:05.872761468 +0000 UTC m=+0.441019920,LastTimestamp:2026-07-02 19:03:05.872761468 +0000 UTC m=+0.441019920,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-135.ec2.internal,}"
Jul 02 19:03:05.876043 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.876020    2577 policy_none.go:47] "Start"
Jul 02 19:03:05.884541 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.884466    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-135.ec2.internal.18be8e5220b97af8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-135.ec2.internal,UID:ip-10-0-131-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-135.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-135.ec2.internal,},FirstTimestamp:2026-07-02 19:03:05.87278412 +0000 UTC m=+0.441042566,LastTimestamp:2026-07-02 19:03:05.87278412 +0000 UTC m=+0.441042566,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-135.ec2.internal,}"
Jul 02 19:03:05.886152 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.886133    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-562vn"
Jul 02 19:03:05.886816 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.886750    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-135.ec2.internal.18be8e5220b9a623  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-135.ec2.internal,UID:ip-10-0-131-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-135.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-135.ec2.internal,},FirstTimestamp:2026-07-02 19:03:05.872795171 +0000 UTC m=+0.441053618,LastTimestamp:2026-07-02 19:03:05.872795171 +0000 UTC m=+0.441053618,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-135.ec2.internal,}"
Jul 02 19:03:05.896219 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.896196    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-562vn"
Jul 02 19:03:05.896870 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.896781    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-131-135.ec2.internal.18be8e5220b9227c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-135.ec2.internal.18be8e5220b9227c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-135.ec2.internal,UID:ip-10-0-131-135.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-135.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-135.ec2.internal,},FirstTimestamp:2026-07-02 19:03:05.872761468 +0000 UTC m=+0.441019920,LastTimestamp:2026-07-02 19:03:05.874143278 +0000 UTC m=+0.442401724,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-135.ec2.internal,}"
Jul 02 19:03:05.918303 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.918284    2577 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.918322    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.918336    2577 server.go:87] "Starting device plugin registration server"
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.918647    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.918662    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.918755    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.918873    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.918880    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.919536    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:03:05.931739 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.919590    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:05.966165 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.966123    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:03:05.967553 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.967537    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:03:05.967666 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.967581    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:03:05.967666 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.967632    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:03:05.967772 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:05.967676    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 19:03:05.970195 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:05.970171    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:03:06.019270 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.019242    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:03:06.020276 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.020259    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:03:06.020387 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.020291    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:03:06.020387 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.020301    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:03:06.020387 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.020327    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.030668 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.030643    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.030726 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.030673    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-135.ec2.internal\": node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.068524 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.068479    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal"]
Jul 02 19:03:06.068653 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.068589    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:03:06.069625 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.069584    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:03:06.069704 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.069639    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:03:06.069704 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.069653    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:03:06.071238 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.071225    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:03:06.071370 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.071354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.071410 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.071393    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:03:06.072039 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.072024    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:03:06.072103 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.072051    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:03:06.072103 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.072053    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:03:06.072103 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.072077    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:03:06.072103 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.072087    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:03:06.072223 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.072061    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:03:06.073276 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.073261    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.073319 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.073296    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:03:06.074045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.074027    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:03:06.074045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.074049    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:03:06.074181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.074063    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:03:06.078778 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.078747    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.098550 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.098523    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-135.ec2.internal\" not found" node="ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.103340 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.103319    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-135.ec2.internal\" not found" node="ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.155545 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.155509    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b9d5e80a9c624391d0c3c32b810d9cd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-135.ec2.internal\" (UID: \"6b9d5e80a9c624391d0c3c32b810d9cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.155545 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.155546    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b6d0ca35ebc66c3a23d42e458d5d375-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal\" (UID: \"9b6d0ca35ebc66c3a23d42e458d5d375\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.155766 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.155572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b6d0ca35ebc66c3a23d42e458d5d375-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal\" (UID: \"9b6d0ca35ebc66c3a23d42e458d5d375\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.179585 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.179548    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.255741 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.255708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b9d5e80a9c624391d0c3c32b810d9cd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-135.ec2.internal\" (UID: \"6b9d5e80a9c624391d0c3c32b810d9cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.255832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.255751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b6d0ca35ebc66c3a23d42e458d5d375-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal\" (UID: \"9b6d0ca35ebc66c3a23d42e458d5d375\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.255832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.255769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b6d0ca35ebc66c3a23d42e458d5d375-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal\" (UID: \"9b6d0ca35ebc66c3a23d42e458d5d375\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.255832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.255813    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b6d0ca35ebc66c3a23d42e458d5d375-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal\" (UID: \"9b6d0ca35ebc66c3a23d42e458d5d375\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.255924 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.255814    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6b9d5e80a9c624391d0c3c32b810d9cd-config\") pod \"kube-apiserver-proxy-ip-10-0-131-135.ec2.internal\" (UID: \"6b9d5e80a9c624391d0c3c32b810d9cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.255924 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.255814    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b6d0ca35ebc66c3a23d42e458d5d375-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal\" (UID: \"9b6d0ca35ebc66c3a23d42e458d5d375\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.280030 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.279949    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.380713 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.380675    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.401820 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.401779    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.406885 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.406864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:06.481147 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.481101    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.581799 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.581710    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.682272 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.682230    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.770945 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.770904    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:03:06.771589 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.771092    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:03:06.783243 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.783215    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.883556 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.883529    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:06.898698 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.898656    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 18:58:07 +0000 UTC" deadline="2028-04-05 22:27:04.476403198 +0000 UTC"
Jul 02 19:03:06.898698 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.898688    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15435h23m57.577718422s"
Jul 02 19:03:06.964353 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:06.964318    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b9d5e80a9c624391d0c3c32b810d9cd.slice/crio-102d8283b5343bbb9a966ded6f292708a052376c8d9ff72dce26c5bebb227a40 WatchSource:0}: Error finding container 102d8283b5343bbb9a966ded6f292708a052376c8d9ff72dce26c5bebb227a40: Status 404 returned error can't find the container with id 102d8283b5343bbb9a966ded6f292708a052376c8d9ff72dce26c5bebb227a40
Jul 02 19:03:06.964741 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:06.964718    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6d0ca35ebc66c3a23d42e458d5d375.slice/crio-c74a77903ea0068cb82d3bd3961f2e3989cfb63ad4d1eedeb13883198f93cb55 WatchSource:0}: Error finding container c74a77903ea0068cb82d3bd3961f2e3989cfb63ad4d1eedeb13883198f93cb55: Status 404 returned error can't find the container with id c74a77903ea0068cb82d3bd3961f2e3989cfb63ad4d1eedeb13883198f93cb55
Jul 02 19:03:06.969185 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.969164    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:03:06.970731 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.970695    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal" event={"ID":"9b6d0ca35ebc66c3a23d42e458d5d375","Type":"ContainerStarted","Data":"c74a77903ea0068cb82d3bd3961f2e3989cfb63ad4d1eedeb13883198f93cb55"}
Jul 02 19:03:06.971620 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:06.971582    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal" event={"ID":"6b9d5e80a9c624391d0c3c32b810d9cd","Type":"ContainerStarted","Data":"102d8283b5343bbb9a966ded6f292708a052376c8d9ff72dce26c5bebb227a40"}
Jul 02 19:03:06.984225 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:06.984197    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:07.078852 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:07.078821    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:03:07.080042 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:07.080020    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:03:07.080123 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:07.080066    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:03:07.080123 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:07.080077    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:03:07.085317 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:07.085299    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:07.138648 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:07.138553    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:03:07.185679 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:07.185651    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:08.549589 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:08.549556    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:08.610779 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:08.610751    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:03:08.649692 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:08.649649    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-135.ec2.internal\" not found"
Jul 02 19:03:08.668215 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:08.668137    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:03:08.716724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:08.716688    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:08.726798 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:08.726763    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:03:08.728028 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:08.728002    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal"
Jul 02 19:03:08.746858 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:08.746810    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:03:09.043789 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.043760    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:03:09.088875 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.088812    2577 apiserver.go:52] "Watching apiserver"
Jul 02 19:03:09.097055 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.097011    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:03:09.098356 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.098322    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-6kxck","kube-system/global-pull-secret-syncer-hzv6h","kube-system/konnectivity-agent-p2rbw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b","openshift-cluster-node-tuning-operator/tuned-vdbvp","openshift-dns/node-resolver-dxxf5","openshift-image-registry/node-ca-t4gth","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal","openshift-multus/multus-additional-cni-plugins-4tcsk","kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal","openshift-multus/multus-xx9dx","openshift-multus/network-metrics-daemon-bfvmt","openshift-network-diagnostics/network-check-target-z4sw2","openshift-network-operator/iptables-alerter-4q7gj"]
Jul 02 19:03:09.100137 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.100112    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.101455 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.101416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:09.101569 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.101499    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:09.102922 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.102898    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:03:09.102922 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.102917    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:03:09.103115 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.103102    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:03:09.103324 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.103300    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tg52x\""
Jul 02 19:03:09.104361 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.104344    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:09.105651 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.105627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.106752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.106723    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:03:09.107274 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.107255    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.108273 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.108025    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-slcjc\""
Jul 02 19:03:09.108273 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.108111    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:03:09.108273 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.108127    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:03:09.108273 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.108182    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:03:09.108540 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.108524    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cj2xk\""
Jul 02 19:03:09.108594 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.108564    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:03:09.108891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.108875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.109651 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.109635    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f4vbc\""
Jul 02 19:03:09.109712 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.109666    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:03:09.109890 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.109872    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:03:09.110357 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.110320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.111467 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.111452    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:03:09.111550 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.111498    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hzbsj\""
Jul 02 19:03:09.111732 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.111714    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:03:09.111780 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.111724    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.113740 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.112877    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:03:09.113740 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.112945    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-sj9gc\""
Jul 02 19:03:09.113740 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.113160    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:03:09.113740 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.113357    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:03:09.113740 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.113566    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:03:09.113740 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.113672    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:03:09.114941 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.114921    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.115041 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.115007    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:09.120521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.118957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.120521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.119075    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:03:09.120521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.119380    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:03:09.120521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.119454    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:03:09.120521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.119490    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jfmgw\""
Jul 02 19:03:09.120521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.119668    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:03:09.120521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.119927    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:03:09.120521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.120020    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:03:09.121612 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.121064    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:03:09.121612 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.121352    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.121948 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.121926    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:03:09.122257 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.122236    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bxdk7\""
Jul 02 19:03:09.122389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.122372    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:03:09.122479 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.122375    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:03:09.123346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.123330    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:09.123439 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.123406    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:09.124258 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.124105    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:03:09.124258 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.124121    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7szr2\""
Jul 02 19:03:09.128285 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.128257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-var-lib-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.128367 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.128346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5d5s\" (UniqueName: \"kubernetes.io/projected/815397ea-555b-44c9-9e18-b13257c730f2-kube-api-access-g5d5s\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.128581 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.128550    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-cni-bin\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.128707 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.128693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-daemon-config\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.128901 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.128873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00867870-1f40-4cd7-8cc0-a546762120e4-host-slash\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.129067 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-system-cni-dir\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.129223 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.129387 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.129525 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-host\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.129702 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.129702 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-socket-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e387eae1-972b-4da2-837a-d91259bd1775-ovn-node-metrics-cert\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129871    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cf2cc53-d9b7-4938-b30a-53971958348b-serviceca\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-cni-bin\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-var-lib-kubelet\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-run-ovn-kubernetes\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-ovnkube-script-lib\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.129995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-system-cni-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqpmm\" (UniqueName: \"kubernetes.io/projected/18ae258e-6d75-4b77-bb56-b04e1a9c9138-kube-api-access-pqpmm\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.130087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-etc-kubernetes\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130578    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysctl-d\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-run\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-lib-modules\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v625v\" (UniqueName: \"kubernetes.io/projected/00867870-1f40-4cd7-8cc0-a546762120e4-kube-api-access-v625v\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-sys-fs\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-run-netns\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-log-socket\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.130785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.130754    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-modprobe-d\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.132794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51685037-4e29-498f-b7d1-c5ec0ae703dc-hosts-file\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.132827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-os-release\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.132869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-kubelet\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.132893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-systemd-units\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.132912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-ovn\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.132930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18ae258e-6d75-4b77-bb56-b04e1a9c9138-cni-binary-copy\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.132953    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-cni-multus\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.132981    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-sys\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vcgc\" (UniqueName: \"kubernetes.io/projected/51685037-4e29-498f-b7d1-c5ec0ae703dc-kube-api-access-5vcgc\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133051    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-etc-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-socket-dir-parent\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133144    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-k8s-cni-cncf-io\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-node-log\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.133212 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133199    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/daad7711-32e7-4070-ba51-dfba7bcac052-agent-certs\") pod \"konnectivity-agent-p2rbw\" (UID: \"daad7711-32e7-4070-ba51-dfba7bcac052\") " pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kftq\" (UniqueName: \"kubernetes.io/projected/5a9c5da6-0d4f-4cd6-80e7-95627aead375-kube-api-access-9kftq\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-env-overrides\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-kubernetes\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-systemd\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-cni-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133376    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-cnibin\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-conf-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133462    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a9c5da6-0d4f-4cd6-80e7-95627aead375-tmp\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00867870-1f40-4cd7-8cc0-a546762120e4-iptables-alerter-script\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133511    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-device-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws8x6\" (UniqueName: \"kubernetes.io/projected/faf38419-9534-4231-a8b5-d4ed655b1a51-kube-api-access-ws8x6\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-slash\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysctl-conf\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.133940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-tuned\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq8t5\" (UniqueName: \"kubernetes.io/projected/e387eae1-972b-4da2-837a-d91259bd1775-kube-api-access-vq8t5\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-os-release\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-netns\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-kubelet\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-multus-certs\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-systemd\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133813    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51685037-4e29-498f-b7d1-c5ec0ae703dc-tmp-dir\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-cni-netd\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-ovnkube-config\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-hostroot\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.133944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cf2cc53-d9b7-4938-b30a-53971958348b-host\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.134011    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/daad7711-32e7-4070-ba51-dfba7bcac052-konnectivity-ca\") pod \"konnectivity-agent-p2rbw\" (UID: \"daad7711-32e7-4070-ba51-dfba7bcac052\") " pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.134047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9660efa6-60d1-4a9f-92e5-8a51085714cf-dbus\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.134078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-registration-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.134103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-cnibin\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.134123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldz46\" (UniqueName: \"kubernetes.io/projected/9cf2cc53-d9b7-4938-b30a-53971958348b-kube-api-access-ldz46\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.134505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.134150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysconfig\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.135103 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.134169    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9660efa6-60d1-4a9f-92e5-8a51085714cf-kubelet-config\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.139867 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.136198    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:03:09.158635 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.158577    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-slhzm"
Jul 02 19:03:09.165032 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.165008    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-slhzm"
Jul 02 19:03:09.218719 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.218688    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:03:09.234389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vcgc\" (UniqueName: \"kubernetes.io/projected/51685037-4e29-498f-b7d1-c5ec0ae703dc-kube-api-access-5vcgc\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.234389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234392    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234413    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-etc-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-socket-dir-parent\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-k8s-cni-cncf-io\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234547    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-socket-dir-parent\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234523    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-etc-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234529    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-k8s-cni-cncf-io\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-node-log\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/daad7711-32e7-4070-ba51-dfba7bcac052-agent-certs\") pod \"konnectivity-agent-p2rbw\" (UID: \"daad7711-32e7-4070-ba51-dfba7bcac052\") " pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:09.234649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234654    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-node-log\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.234997 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kftq\" (UniqueName: \"kubernetes.io/projected/5a9c5da6-0d4f-4cd6-80e7-95627aead375-kube-api-access-9kftq\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.234997 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-env-overrides\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.235337 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-kubernetes\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.235485 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-systemd\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.235601 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-cni-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.235718 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235118    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-cni-binary-copy\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.235835 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235285    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-env-overrides\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.235835 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235761    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-cnibin\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.235835 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.234863    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-kubernetes\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.235835 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235541    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-systemd\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.235835 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235705    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-cnibin\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.235835 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-conf-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235761    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-cni-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235021    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a9c5da6-0d4f-4cd6-80e7-95627aead375-tmp\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235900    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-conf-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00867870-1f40-4cd7-8cc0-a546762120e4-iptables-alerter-script\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.235973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-device-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236088    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-device-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws8x6\" (UniqueName: \"kubernetes.io/projected/faf38419-9534-4231-a8b5-d4ed655b1a51-kube-api-access-ws8x6\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-slash\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysctl-conf\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.236253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-tuned\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq8t5\" (UniqueName: \"kubernetes.io/projected/e387eae1-972b-4da2-837a-d91259bd1775-kube-api-access-vq8t5\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-os-release\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-netns\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236343    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236393    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-kubelet\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-kubelet\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-multus-certs\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-systemd\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.236883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.236464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51685037-4e29-498f-b7d1-c5ec0ae703dc-tmp-dir\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.237536 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237508    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/00867870-1f40-4cd7-8cc0-a546762120e4-iptables-alerter-script\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.237632 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237608    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-systemd\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.237684 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237651    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51685037-4e29-498f-b7d1-c5ec0ae703dc-tmp-dir\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.237768 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237695    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-os-release\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.237768 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237751    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-slash\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.237882 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237828    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-netns\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.237939 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237917    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-run-multus-certs\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.237995 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-cni-netd\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.238052 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.237992    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-ovnkube-config\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.238097 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-hostroot\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.238148 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cf2cc53-d9b7-4938-b30a-53971958348b-host\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.238199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/daad7711-32e7-4070-ba51-dfba7bcac052-konnectivity-ca\") pod \"konnectivity-agent-p2rbw\" (UID: \"daad7711-32e7-4070-ba51-dfba7bcac052\") " pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:09.238199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9660efa6-60d1-4a9f-92e5-8a51085714cf-dbus\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.238300 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-registration-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.238300 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238221    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysctl-conf\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.238300 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-cnibin\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.238440 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldz46\" (UniqueName: \"kubernetes.io/projected/9cf2cc53-d9b7-4938-b30a-53971958348b-kube-api-access-ldz46\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.238440 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:09.238440 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysconfig\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.238440 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9660efa6-60d1-4a9f-92e5-8a51085714cf-kubelet-config\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.238624 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-var-lib-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.238624 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5d5s\" (UniqueName: \"kubernetes.io/projected/815397ea-555b-44c9-9e18-b13257c730f2-kube-api-access-g5d5s\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.238624 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-cni-bin\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.238624 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238564    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-daemon-config\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.238624 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00867870-1f40-4cd7-8cc0-a546762120e4-host-slash\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-system-cni-dir\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-host\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-socket-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238827    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e387eae1-972b-4da2-837a-d91259bd1775-ovn-node-metrics-cert\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238863    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-ovnkube-config\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cf2cc53-d9b7-4938-b30a-53971958348b-serviceca\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.238915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-cni-bin\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-var-lib-kubelet\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238951    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-hostroot\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.238971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-run-ovn-kubernetes\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239011    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9cf2cc53-d9b7-4938-b30a-53971958348b-host\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239028    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-run-ovn-kubernetes\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-ovnkube-script-lib\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239087    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-system-cni-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqpmm\" (UniqueName: \"kubernetes.io/projected/18ae258e-6d75-4b77-bb56-b04e1a9c9138-kube-api-access-pqpmm\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-etc-kubernetes\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcv94\" (UniqueName: \"kubernetes.io/projected/6a134df9-1516-4edc-a2a5-fa06815a4339-kube-api-access-tcv94\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysctl-d\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-run\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-lib-modules\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.240199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239607    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a9c5da6-0d4f-4cd6-80e7-95627aead375-tmp\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v625v\" (UniqueName: \"kubernetes.io/projected/00867870-1f40-4cd7-8cc0-a546762120e4-kube-api-access-v625v\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-sys-fs\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239687    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/00867870-1f40-4cd7-8cc0-a546762120e4-host-slash\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-run-netns\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239754    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-registration-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239805    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/daad7711-32e7-4070-ba51-dfba7bcac052-agent-certs\") pod \"konnectivity-agent-p2rbw\" (UID: \"daad7711-32e7-4070-ba51-dfba7bcac052\") " pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239856    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-cnibin\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-log-socket\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.239948    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-etc-kubernetes\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240028    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-run\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240084    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9660efa6-60d1-4a9f-92e5-8a51085714cf-dbus\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-modprobe-d\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240601    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/18ae258e-6d75-4b77-bb56-b04e1a9c9138-multus-daemon-config\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240621    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/daad7711-32e7-4070-ba51-dfba7bcac052-konnectivity-ca\") pod \"konnectivity-agent-p2rbw\" (UID: \"daad7711-32e7-4070-ba51-dfba7bcac052\") " pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240754    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-log-socket\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240865    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9660efa6-60d1-4a9f-92e5-8a51085714cf-kubelet-config\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.240976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240914    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-var-lib-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.241812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240936    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.241812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.240975    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-system-cni-dir\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.241812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.241041    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-cni-netd\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.241812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.241092    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysconfig\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.241812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.241387    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.241812 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.241424    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:09.241812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.241508    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-host\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.241812 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.241655    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret podName:9660efa6-60d1-4a9f-92e5-8a51085714cf nodeName:}" failed. No retries permitted until 2026-07-02 19:03:09.741631729 +0000 UTC m=+3.046652264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret") pod "global-pull-secret-syncer-hzv6h" (UID: "9660efa6-60d1-4a9f-92e5-8a51085714cf") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:09.242198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.241976    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-lib-modules\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.242198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242010    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-modprobe-d\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.242198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242026    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-cni-bin\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.242198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242031    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-socket-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.242390 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242243    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-sys-fs\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.242390 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242340    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-run-netns\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.242492 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242431    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-sysctl-d\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.242492 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242443    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9cf2cc53-d9b7-4938-b30a-53971958348b-serviceca\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.242492 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242478    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/815397ea-555b-44c9-9e18-b13257c730f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.242637 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51685037-4e29-498f-b7d1-c5ec0ae703dc-hosts-file\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.242637 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-os-release\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.242637 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-kubelet\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.242780 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-systemd-units\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.242780 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242683    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e387eae1-972b-4da2-837a-d91259bd1775-ovnkube-script-lib\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.242780 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-ovn\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.242780 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18ae258e-6d75-4b77-bb56-b04e1a9c9138-cni-binary-copy\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.242780 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242739    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-openvswitch\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.242780 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-cni-multus\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.243074 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-sys\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.243074 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.242991    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/faf38419-9534-4231-a8b5-d4ed655b1a51-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.243074 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243002    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-cni-bin\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.243074 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243037    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-systemd-units\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.243314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243073    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-system-cni-dir\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.243314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243091    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-sys\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.243314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243134    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-kubelet\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.243314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243143    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.243314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243199    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e387eae1-972b-4da2-837a-d91259bd1775-run-ovn\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.243314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243236    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/51685037-4e29-498f-b7d1-c5ec0ae703dc-hosts-file\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.243314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243272    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faf38419-9534-4231-a8b5-d4ed655b1a51-os-release\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.243314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243287    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a9c5da6-0d4f-4cd6-80e7-95627aead375-var-lib-kubelet\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.243655 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243321    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/18ae258e-6d75-4b77-bb56-b04e1a9c9138-cni-binary-copy\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.243655 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243360    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/18ae258e-6d75-4b77-bb56-b04e1a9c9138-host-var-lib-cni-multus\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.244310 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.243759    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:03:09.244310 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.243788    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:03:09.244310 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.243801    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b4g4x for pod openshift-network-diagnostics/network-check-target-z4sw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:09.244310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.243953    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5a9c5da6-0d4f-4cd6-80e7-95627aead375-etc-tuned\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.244310 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.244001    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x podName:e1abd119-a937-4946-bb1e-be233927c694 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:09.743984464 +0000 UTC m=+3.049004978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b4g4x" (UniqueName: "kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x") pod "network-check-target-z4sw2" (UID: "e1abd119-a937-4946-bb1e-be233927c694") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:09.244855 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.244714    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e387eae1-972b-4da2-837a-d91259bd1775-ovn-node-metrics-cert\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.248529 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.248505    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kftq\" (UniqueName: \"kubernetes.io/projected/5a9c5da6-0d4f-4cd6-80e7-95627aead375-kube-api-access-9kftq\") pod \"tuned-vdbvp\" (UID: \"5a9c5da6-0d4f-4cd6-80e7-95627aead375\") " pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.249142 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.249120    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq8t5\" (UniqueName: \"kubernetes.io/projected/e387eae1-972b-4da2-837a-d91259bd1775-kube-api-access-vq8t5\") pod \"ovnkube-node-6kxck\" (UID: \"e387eae1-972b-4da2-837a-d91259bd1775\") " pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.249219 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.249147    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vcgc\" (UniqueName: \"kubernetes.io/projected/51685037-4e29-498f-b7d1-c5ec0ae703dc-kube-api-access-5vcgc\") pod \"node-resolver-dxxf5\" (UID: \"51685037-4e29-498f-b7d1-c5ec0ae703dc\") " pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.249219 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.249186    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldz46\" (UniqueName: \"kubernetes.io/projected/9cf2cc53-d9b7-4938-b30a-53971958348b-kube-api-access-ldz46\") pod \"node-ca-t4gth\" (UID: \"9cf2cc53-d9b7-4938-b30a-53971958348b\") " pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.250216 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.250190    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5d5s\" (UniqueName: \"kubernetes.io/projected/815397ea-555b-44c9-9e18-b13257c730f2-kube-api-access-g5d5s\") pod \"aws-ebs-csi-driver-node-k424b\" (UID: \"815397ea-555b-44c9-9e18-b13257c730f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.252664 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.252617    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws8x6\" (UniqueName: \"kubernetes.io/projected/faf38419-9534-4231-a8b5-d4ed655b1a51-kube-api-access-ws8x6\") pod \"multus-additional-cni-plugins-4tcsk\" (UID: \"faf38419-9534-4231-a8b5-d4ed655b1a51\") " pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.252885 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.252864    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v625v\" (UniqueName: \"kubernetes.io/projected/00867870-1f40-4cd7-8cc0-a546762120e4-kube-api-access-v625v\") pod \"iptables-alerter-4q7gj\" (UID: \"00867870-1f40-4cd7-8cc0-a546762120e4\") " pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.252976 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.252945    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqpmm\" (UniqueName: \"kubernetes.io/projected/18ae258e-6d75-4b77-bb56-b04e1a9c9138-kube-api-access-pqpmm\") pod \"multus-xx9dx\" (UID: \"18ae258e-6d75-4b77-bb56-b04e1a9c9138\") " pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.343757 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.343674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:09.343757 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.343743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcv94\" (UniqueName: \"kubernetes.io/projected/6a134df9-1516-4edc-a2a5-fa06815a4339-kube-api-access-tcv94\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:09.344024 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.343823    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:09.344024 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.343907    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs podName:6a134df9-1516-4edc-a2a5-fa06815a4339 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:09.843888274 +0000 UTC m=+3.148908789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs") pod "network-metrics-daemon-bfvmt" (UID: "6a134df9-1516-4edc-a2a5-fa06815a4339") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:09.353136 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.353106    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcv94\" (UniqueName: \"kubernetes.io/projected/6a134df9-1516-4edc-a2a5-fa06815a4339-kube-api-access-tcv94\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:09.423279 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.423236    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-t4gth"
Jul 02 19:03:09.428361 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.428332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:09.436426 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.436386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b"
Jul 02 19:03:09.443265 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.443235    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vdbvp"
Jul 02 19:03:09.450374 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.450342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dxxf5"
Jul 02 19:03:09.456271 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.456243    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4tcsk"
Jul 02 19:03:09.463273 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.463245    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:09.470306 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.470283    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4q7gj"
Jul 02 19:03:09.475187 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.475165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xx9dx"
Jul 02 19:03:09.746924 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.746828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:09.746924 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.746902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:09.747147 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.747006    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:09.747147 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.747022    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:03:09.747147 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.747051    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:03:09.747147 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.747062    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b4g4x for pod openshift-network-diagnostics/network-check-target-z4sw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:09.747147 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.747098    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret podName:9660efa6-60d1-4a9f-92e5-8a51085714cf nodeName:}" failed. No retries permitted until 2026-07-02 19:03:10.747066478 +0000 UTC m=+4.052087008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret") pod "global-pull-secret-syncer-hzv6h" (UID: "9660efa6-60d1-4a9f-92e5-8a51085714cf") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:09.747147 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.747124    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x podName:e1abd119-a937-4946-bb1e-be233927c694 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:10.747107264 +0000 UTC m=+4.052127800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4g4x" (UniqueName: "kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x") pod "network-check-target-z4sw2" (UID: "e1abd119-a937-4946-bb1e-be233927c694") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:09.847233 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:09.847198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:09.847414 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.847372    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:09.847459 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:09.847440    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs podName:6a134df9-1516-4edc-a2a5-fa06815a4339 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:10.847423112 +0000 UTC m=+4.152443627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs") pod "network-metrics-daemon-bfvmt" (UID: "6a134df9-1516-4edc-a2a5-fa06815a4339") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:10.150275 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:10.150232    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf2cc53_d9b7_4938_b30a_53971958348b.slice/crio-693603a59024ea527692224dbbc27231a13aa7b34d0a14b5b45fdc02ebcf827e WatchSource:0}: Error finding container 693603a59024ea527692224dbbc27231a13aa7b34d0a14b5b45fdc02ebcf827e: Status 404 returned error can't find the container with id 693603a59024ea527692224dbbc27231a13aa7b34d0a14b5b45fdc02ebcf827e
Jul 02 19:03:10.151271 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:10.151244    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaad7711_32e7_4070_ba51_dfba7bcac052.slice/crio-3280e52d153b5ac55d43926d280db37fcf7e521c58f08c2e2e5942f36413ef1c WatchSource:0}: Error finding container 3280e52d153b5ac55d43926d280db37fcf7e521c58f08c2e2e5942f36413ef1c: Status 404 returned error can't find the container with id 3280e52d153b5ac55d43926d280db37fcf7e521c58f08c2e2e5942f36413ef1c
Jul 02 19:03:10.167729 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.167295    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:58:09 +0000 UTC" deadline="2028-01-15 20:34:28.296881428 +0000 UTC"
Jul 02 19:03:10.167729 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.167542    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13489h31m18.129346807s"
Jul 02 19:03:10.173827 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:10.169435    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a9c5da6_0d4f_4cd6_80e7_95627aead375.slice/crio-4e358754445e0ceeb371dd9def18ede40f6263a218789d2f56567f47051dccf4 WatchSource:0}: Error finding container 4e358754445e0ceeb371dd9def18ede40f6263a218789d2f56567f47051dccf4: Status 404 returned error can't find the container with id 4e358754445e0ceeb371dd9def18ede40f6263a218789d2f56567f47051dccf4
Jul 02 19:03:10.177074 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:10.177044    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00867870_1f40_4cd7_8cc0_a546762120e4.slice/crio-bbc41989fdb11b73375859212bebb9597ac1ee58c84480f9b3fb63a3b48375f0 WatchSource:0}: Error finding container bbc41989fdb11b73375859212bebb9597ac1ee58c84480f9b3fb63a3b48375f0: Status 404 returned error can't find the container with id bbc41989fdb11b73375859212bebb9597ac1ee58c84480f9b3fb63a3b48375f0
Jul 02 19:03:10.231742 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.231712    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:10.231917 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.231863    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:10.238983 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.238952    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4q7gj" event={"ID":"00867870-1f40-4cd7-8cc0-a546762120e4","Type":"ContainerStarted","Data":"bbc41989fdb11b73375859212bebb9597ac1ee58c84480f9b3fb63a3b48375f0"}
Jul 02 19:03:10.240227 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.240199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dxxf5" event={"ID":"51685037-4e29-498f-b7d1-c5ec0ae703dc","Type":"ContainerStarted","Data":"57773a03aa56c8bd9f4a2b7b490c78f12444b624d891bc224eaf08e800d2daa7"}
Jul 02 19:03:10.241398 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.241374    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b" event={"ID":"815397ea-555b-44c9-9e18-b13257c730f2","Type":"ContainerStarted","Data":"e41ccd4de8b8b48965a4710a02fc3366156143a1bae8af4539861052d479aeb6"}
Jul 02 19:03:10.242749 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.242657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"a84aaf5ed368fed517618b2802e013879987fcf1b421f77de19edda97aed429e"}
Jul 02 19:03:10.243806 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.243782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xx9dx" event={"ID":"18ae258e-6d75-4b77-bb56-b04e1a9c9138","Type":"ContainerStarted","Data":"48428df4ed037e8506e1aadb4af7ac8721800ee5f956b2188c38c8dfcf9e7f2b"}
Jul 02 19:03:10.245064 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.245044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" event={"ID":"faf38419-9534-4231-a8b5-d4ed655b1a51","Type":"ContainerStarted","Data":"f32d9bf1ef8656ed5eb398c9c671110c33b13931342a7a9fa5957cf3b6163c68"}
Jul 02 19:03:10.246300 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.246275    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vdbvp" event={"ID":"5a9c5da6-0d4f-4cd6-80e7-95627aead375","Type":"ContainerStarted","Data":"4e358754445e0ceeb371dd9def18ede40f6263a218789d2f56567f47051dccf4"}
Jul 02 19:03:10.250679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.248433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p2rbw" event={"ID":"daad7711-32e7-4070-ba51-dfba7bcac052","Type":"ContainerStarted","Data":"3280e52d153b5ac55d43926d280db37fcf7e521c58f08c2e2e5942f36413ef1c"}
Jul 02 19:03:10.252762 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.252731    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t4gth" event={"ID":"9cf2cc53-d9b7-4938-b30a-53971958348b","Type":"ContainerStarted","Data":"693603a59024ea527692224dbbc27231a13aa7b34d0a14b5b45fdc02ebcf827e"}
Jul 02 19:03:10.754755 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.754672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:10.754755 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.754743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:10.754987 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.754906    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:03:10.754987 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.754926    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:03:10.754987 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.754941    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b4g4x for pod openshift-network-diagnostics/network-check-target-z4sw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:10.755127 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.755002    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x podName:e1abd119-a937-4946-bb1e-be233927c694 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:12.754983356 +0000 UTC m=+6.060003874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4g4x" (UniqueName: "kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x") pod "network-check-target-z4sw2" (UID: "e1abd119-a937-4946-bb1e-be233927c694") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:10.755442 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.755423    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:10.755521 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.755482    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret podName:9660efa6-60d1-4a9f-92e5-8a51085714cf nodeName:}" failed. No retries permitted until 2026-07-02 19:03:12.755466262 +0000 UTC m=+6.060486779 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret") pod "global-pull-secret-syncer-hzv6h" (UID: "9660efa6-60d1-4a9f-92e5-8a51085714cf") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:10.856357 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:10.856208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:10.856515 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.856366    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:10.856515 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:10.856427    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs podName:6a134df9-1516-4edc-a2a5-fa06815a4339 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:12.856410323 +0000 UTC m=+6.161430836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs") pod "network-metrics-daemon-bfvmt" (UID: "6a134df9-1516-4edc-a2a5-fa06815a4339") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:11.167923 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:11.167853    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 18:58:09 +0000 UTC" deadline="2028-03-29 07:12:43.14831588 +0000 UTC"
Jul 02 19:03:11.167923 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:11.167921    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15252h9m31.980399764s"
Jul 02 19:03:11.233218 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:11.232439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:11.233218 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:11.232479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:11.233218 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:11.232583    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:11.233218 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:11.232960    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:11.267899 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:11.267422    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b6d0ca35ebc66c3a23d42e458d5d375" containerID="26a4c5ebf866d43c93f284f58ca9a9b2e6b7c0814cbcf51d0c0692beacc78020" exitCode=0
Jul 02 19:03:11.267899 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:11.267726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal" event={"ID":"9b6d0ca35ebc66c3a23d42e458d5d375","Type":"ContainerDied","Data":"26a4c5ebf866d43c93f284f58ca9a9b2e6b7c0814cbcf51d0c0692beacc78020"}
Jul 02 19:03:11.278554 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:11.278425    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal" event={"ID":"6b9d5e80a9c624391d0c3c32b810d9cd","Type":"ContainerStarted","Data":"91127c6f5feb8480abc50e09ba8a7d18938713c588f27f69284662d457a3644c"}
Jul 02 19:03:12.232005 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:12.231407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:12.232005 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.231535    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:12.297811 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:12.297655    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal" event={"ID":"9b6d0ca35ebc66c3a23d42e458d5d375","Type":"ContainerStarted","Data":"c380e3eb3bcd55bc50f2da34d62bec1303a5c7fdb45e2143c0976f4777665ba8"}
Jul 02 19:03:12.315407 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:12.314705    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-135.ec2.internal" podStartSLOduration=4.314682529 podStartE2EDuration="4.314682529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:11.304755084 +0000 UTC m=+4.609775621" watchObservedRunningTime="2026-07-02 19:03:12.314682529 +0000 UTC m=+5.619703066"
Jul 02 19:03:12.773556 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:12.773512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:12.773817 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:12.773600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:12.773817 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.773796    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:03:12.773817 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.773815    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:03:12.774042 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.773828    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b4g4x for pod openshift-network-diagnostics/network-check-target-z4sw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:12.774042 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.773906    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x podName:e1abd119-a937-4946-bb1e-be233927c694 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:16.773887356 +0000 UTC m=+10.078907889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4g4x" (UniqueName: "kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x") pod "network-check-target-z4sw2" (UID: "e1abd119-a937-4946-bb1e-be233927c694") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:12.774042 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.773979    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:12.774042 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.774012    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret podName:9660efa6-60d1-4a9f-92e5-8a51085714cf nodeName:}" failed. No retries permitted until 2026-07-02 19:03:16.774002456 +0000 UTC m=+10.079022975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret") pod "global-pull-secret-syncer-hzv6h" (UID: "9660efa6-60d1-4a9f-92e5-8a51085714cf") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:12.874657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:12.874616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:12.874869 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.874809    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:12.874937 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:12.874895    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs podName:6a134df9-1516-4edc-a2a5-fa06815a4339 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:16.874873589 +0000 UTC m=+10.179894107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs") pod "network-metrics-daemon-bfvmt" (UID: "6a134df9-1516-4edc-a2a5-fa06815a4339") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:13.234154 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:13.234072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:13.234591 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:13.234206    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:13.234591 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:13.234581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:13.234758 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:13.234688    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:14.231184 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:14.231144    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:14.231356 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:14.231267    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:15.232042 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:15.232006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:15.232432 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:15.232054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:15.232432 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:15.232163    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:15.232432 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:15.232300    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:16.231869 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:16.231824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:16.232043 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.231984    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:16.806628 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:16.806593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:16.807108 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:16.806661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:16.807108 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.806737    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:16.807108 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.806788    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:03:16.807108 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.806806    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:03:16.807108 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.806818    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b4g4x for pod openshift-network-diagnostics/network-check-target-z4sw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:16.807108 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.806819    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret podName:9660efa6-60d1-4a9f-92e5-8a51085714cf nodeName:}" failed. No retries permitted until 2026-07-02 19:03:24.806798496 +0000 UTC m=+18.111819023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret") pod "global-pull-secret-syncer-hzv6h" (UID: "9660efa6-60d1-4a9f-92e5-8a51085714cf") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:16.807108 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.806897    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x podName:e1abd119-a937-4946-bb1e-be233927c694 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:24.80688096 +0000 UTC m=+18.111901488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4g4x" (UniqueName: "kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x") pod "network-check-target-z4sw2" (UID: "e1abd119-a937-4946-bb1e-be233927c694") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:16.907287 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:16.907251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:16.907489 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.907383    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:16.907489 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:16.907453    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs podName:6a134df9-1516-4edc-a2a5-fa06815a4339 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:24.907435679 +0000 UTC m=+18.212456193 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs") pod "network-metrics-daemon-bfvmt" (UID: "6a134df9-1516-4edc-a2a5-fa06815a4339") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:17.232945 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:17.232629    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:17.232945 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:17.232753    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:17.232945 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:17.232789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:17.232945 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:17.232879    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:18.232117 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:18.232026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:18.232566 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:18.232143    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:19.231658 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:19.231611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:19.231872 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:19.231735    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:19.231872 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:19.231805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:19.231993 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:19.231934    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:20.231444 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:20.231400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:20.231832 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:20.231562    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:21.231993 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:21.231954    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:21.232468 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:21.232096    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:21.232468 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:21.232171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:21.232468 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:21.232289    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:22.231881 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:22.231737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:22.232076 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:22.231921    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:23.232121 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:23.232082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:23.232561 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:23.232134    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:23.232561 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:23.232227    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:23.232561 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:23.232382    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:24.231658 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:24.231626    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:24.231888 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.231737    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:24.867149 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:24.867117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:24.867600 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:24.867177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:24.867600 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.867276    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:24.867600 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.867303    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:03:24.867600 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.867321    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:03:24.867600 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.867333    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b4g4x for pod openshift-network-diagnostics/network-check-target-z4sw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:24.867600 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.867345    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret podName:9660efa6-60d1-4a9f-92e5-8a51085714cf nodeName:}" failed. No retries permitted until 2026-07-02 19:03:40.867328553 +0000 UTC m=+34.172349083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret") pod "global-pull-secret-syncer-hzv6h" (UID: "9660efa6-60d1-4a9f-92e5-8a51085714cf") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:24.867600 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.867391    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x podName:e1abd119-a937-4946-bb1e-be233927c694 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:40.867375344 +0000 UTC m=+34.172395878 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4g4x" (UniqueName: "kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x") pod "network-check-target-z4sw2" (UID: "e1abd119-a937-4946-bb1e-be233927c694") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:24.968660 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:24.968016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:24.968660 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.968177    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:24.968660 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:24.968238    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs podName:6a134df9-1516-4edc-a2a5-fa06815a4339 nodeName:}" failed. No retries permitted until 2026-07-02 19:03:40.968220892 +0000 UTC m=+34.273241413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs") pod "network-metrics-daemon-bfvmt" (UID: "6a134df9-1516-4edc-a2a5-fa06815a4339") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:25.231914 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.231707    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:25.232089 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.231753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:25.232089 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:25.232018    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:25.232089 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:25.232054    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:25.327223 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.326930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dxxf5" event={"ID":"51685037-4e29-498f-b7d1-c5ec0ae703dc","Type":"ContainerStarted","Data":"4ffc43a67521a9a76694ec20da763cffd3d0b070a4a7a6028f3799db7e5c4b67"}
Jul 02 19:03:25.328541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.328513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b" event={"ID":"815397ea-555b-44c9-9e18-b13257c730f2","Type":"ContainerStarted","Data":"2e3e1c3f574d1792decaccd2b78c4049d3383f832792e8299b606dafe6cc6117"}
Jul 02 19:03:25.330237 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.330210    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xx9dx" event={"ID":"18ae258e-6d75-4b77-bb56-b04e1a9c9138","Type":"ContainerStarted","Data":"f4ab1b4f913d93c37edd4c205e6c25d1f52b237c017b6ea1469b6d3b5b7a40aa"}
Jul 02 19:03:25.331943 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.331922    2577 generic.go:356] "Generic (PLEG): container finished" podID="faf38419-9534-4231-a8b5-d4ed655b1a51" containerID="847a7f28bb4438abae9491b308b1f86ba601a0828eeac1016164ba64676d309d" exitCode=0
Jul 02 19:03:25.332050 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.332004    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" event={"ID":"faf38419-9534-4231-a8b5-d4ed655b1a51","Type":"ContainerDied","Data":"847a7f28bb4438abae9491b308b1f86ba601a0828eeac1016164ba64676d309d"}
Jul 02 19:03:25.333555 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.333523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vdbvp" event={"ID":"5a9c5da6-0d4f-4cd6-80e7-95627aead375","Type":"ContainerStarted","Data":"d076ec53b0025b16cdc7b4caf21596515012ade29dc727f8917b64a7535e290d"}
Jul 02 19:03:25.335167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.335134    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p2rbw" event={"ID":"daad7711-32e7-4070-ba51-dfba7bcac052","Type":"ContainerStarted","Data":"564446fe25cf5051f4d62c7e6e9018c850b2e7d43faf0f6026bebc6eb05053d6"}
Jul 02 19:03:25.337105 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.337080    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-t4gth" event={"ID":"9cf2cc53-d9b7-4938-b30a-53971958348b","Type":"ContainerStarted","Data":"a336c400d20705776d78800e8c8ece3e51dae33950b1eb5e177d26565bee2b37"}
Jul 02 19:03:25.344526 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.344482    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dxxf5" podStartSLOduration=3.68757078 podStartE2EDuration="18.344469559s" totalImagesPullingTime="14.656898779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:25.343907497 +0000 UTC m=+18.648928035" watchObservedRunningTime="2026-07-02 19:03:25.344469559 +0000 UTC m=+18.649490095"
Jul 02 19:03:25.344658 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.344607    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-135.ec2.internal" podStartSLOduration=17.344599715 podStartE2EDuration="17.344599715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:12.315794877 +0000 UTC m=+5.620815414" watchObservedRunningTime="2026-07-02 19:03:25.344599715 +0000 UTC m=+18.649620253"
Jul 02 19:03:25.381268 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.381206    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p2rbw" podStartSLOduration=3.791710707 podStartE2EDuration="18.381190186s" totalImagesPullingTime="14.589479479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:25.380896116 +0000 UTC m=+18.685916651" watchObservedRunningTime="2026-07-02 19:03:25.381190186 +0000 UTC m=+18.686210759"
Jul 02 19:03:25.397664 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.397607    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vdbvp" podStartSLOduration=3.73868972 podStartE2EDuration="18.397591826s" totalImagesPullingTime="14.658902106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:25.397150511 +0000 UTC m=+18.702171038" watchObservedRunningTime="2026-07-02 19:03:25.397591826 +0000 UTC m=+18.702612361"
Jul 02 19:03:25.418349 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:25.418296    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xx9dx" podStartSLOduration=3.718211663 podStartE2EDuration="18.418279642s" totalImagesPullingTime="14.700067979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:25.41818099 +0000 UTC m=+18.723201526" watchObservedRunningTime="2026-07-02 19:03:25.418279642 +0000 UTC m=+18.723300175"
Jul 02 19:03:26.232018 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:26.231986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:26.232652 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:26.232085    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:26.341868 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:26.341809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4q7gj" event={"ID":"00867870-1f40-4cd7-8cc0-a546762120e4","Type":"ContainerStarted","Data":"2b466187111f4cd8ccb98b66e4a27191112718049dfe2100ce5dc2347d4071f7"}
Jul 02 19:03:26.364932 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:26.364867    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-t4gth" podStartSLOduration=4.760636929 podStartE2EDuration="19.364827964s" totalImagesPullingTime="14.604191035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:25.435110707 +0000 UTC m=+18.740131242" watchObservedRunningTime="2026-07-02 19:03:26.364827964 +0000 UTC m=+19.669848500"
Jul 02 19:03:27.232063 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:27.232027    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:27.232595 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:27.232144    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:27.232595 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:27.232188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:27.232595 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:27.232256    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:28.231625 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:28.231585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:28.231804 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:28.231717    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:29.231541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:29.231505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:29.232099 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:29.231555    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:29.232099 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:29.231635    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:29.232099 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:29.231765    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:29.371403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:29.371369    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:29.372307 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:29.372280    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:29.388267 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:29.388223    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4q7gj" podStartSLOduration=7.732114205 podStartE2EDuration="22.388207422s" totalImagesPullingTime="14.656093217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:26.365161765 +0000 UTC m=+19.670182300" watchObservedRunningTime="2026-07-02 19:03:29.388207422 +0000 UTC m=+22.693227963"
Jul 02 19:03:30.231393 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:30.231171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:30.231577 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:30.231543    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:30.351177 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:30.351135    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:30.351594 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:30.351578    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p2rbw"
Jul 02 19:03:31.232126 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:31.232097    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:31.232556 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:31.232205    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:31.232556 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:31.232278    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:31.232556 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:31.232398    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:32.231357 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:32.231325    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:32.231583 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:32.231428    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:33.231474 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:33.231434    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:33.231474 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:33.231455    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:33.231936 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:33.231548    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:33.231936 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:33.231698    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:33.453629 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:33.453591    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:03:34.196983 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.196673    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:03:33.453611693Z","UUID":"04e2e73e-b840-4b98-9686-1b2a51861f9e","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:03:34.198724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.198692    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:03:34.198724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.198731    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:03:34.231280 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.231246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:34.231440 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:34.231351    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:34.362088 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.362050    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b" event={"ID":"815397ea-555b-44c9-9e18-b13257c730f2","Type":"ContainerStarted","Data":"d520a3375b64132f6ba934cce6429c0dc2324c1312689001022868146469ee10"}
Jul 02 19:03:34.365543 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.365505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"6668f80c0624cb4e4988d46fc22fc74745a481377af0fa37b6aa161ebf6379d5"}
Jul 02 19:03:34.365697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.365598    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"64a9965869e031e8e407faa7e0dd84f41918733d0deaace04ee4f703d904e907"}
Jul 02 19:03:34.365697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.365649    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"e1fd5d61ad2a1937ff99ff89995a77a7a7007839826cc74b06155ddabfc14b41"}
Jul 02 19:03:34.365802 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.365694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"055aff55bbfce82cf92b99fa176182c9c912fcf16da6319c610c6860cf39a3df"}
Jul 02 19:03:34.365802 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.365755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"cb4c2c7272693cf4735961a8d654aa46df923d940ad85f056d4565bfa0d67d11"}
Jul 02 19:03:34.365802 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.365801    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"40934f260df295045e1fe01105041b2907cbdbbfcd336c46aa185ef4325b24d4"}
Jul 02 19:03:34.367787 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.367761    2577 generic.go:356] "Generic (PLEG): container finished" podID="faf38419-9534-4231-a8b5-d4ed655b1a51" containerID="ea967e204a029f9b0f60fb823dc21103578e6a4522928aff6379a21759a5f4f3" exitCode=0
Jul 02 19:03:34.367949 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:34.367813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" event={"ID":"faf38419-9534-4231-a8b5-d4ed655b1a51","Type":"ContainerDied","Data":"ea967e204a029f9b0f60fb823dc21103578e6a4522928aff6379a21759a5f4f3"}
Jul 02 19:03:35.231599 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:35.231553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:35.231798 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:35.231703    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:35.231798 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:35.231747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:35.231896 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:35.231855    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:35.372492 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:35.372458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b" event={"ID":"815397ea-555b-44c9-9e18-b13257c730f2","Type":"ContainerStarted","Data":"c8c0fa197241e1b4db7f06b604947ab8629d55e75ba906fa7d56dfd31afa69fe"}
Jul 02 19:03:35.390312 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:35.390265    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k424b" podStartSLOduration=4.338144883 podStartE2EDuration="28.390249947s" totalImagesPullingTime="24.052105064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:35.389763493 +0000 UTC m=+28.694784021" watchObservedRunningTime="2026-07-02 19:03:35.390249947 +0000 UTC m=+28.695270483"
Jul 02 19:03:36.231654 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:36.231621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:36.231826 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:36.231725    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:36.376550 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:36.376462    2577 generic.go:356] "Generic (PLEG): container finished" podID="faf38419-9534-4231-a8b5-d4ed655b1a51" containerID="0ef0db6167bd555a62a69463aa8b2f12729bd3623fdba57271c12b1c22f3d62f" exitCode=0
Jul 02 19:03:36.377153 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:36.376544    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" event={"ID":"faf38419-9534-4231-a8b5-d4ed655b1a51","Type":"ContainerDied","Data":"0ef0db6167bd555a62a69463aa8b2f12729bd3623fdba57271c12b1c22f3d62f"}
Jul 02 19:03:36.382930 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:36.382890    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"31cae49a328e65fb5f818942ae638ca00758ccdeadcfdaf679f98ecb60fea797"}
Jul 02 19:03:37.232619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:37.232581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:37.232788 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:37.232690    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:37.232788 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:37.232737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:37.232898 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:37.232834    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:38.231395 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:38.231358    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:38.231907 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:38.231465    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:38.389269 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:38.389238    2577 generic.go:356] "Generic (PLEG): container finished" podID="faf38419-9534-4231-a8b5-d4ed655b1a51" containerID="46afb69ee7961eefdf59fe8ad3c35e817b972fd4b38de5143cc13cc8ca29cda6" exitCode=0
Jul 02 19:03:38.389269 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:38.389285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" event={"ID":"faf38419-9534-4231-a8b5-d4ed655b1a51","Type":"ContainerDied","Data":"46afb69ee7961eefdf59fe8ad3c35e817b972fd4b38de5143cc13cc8ca29cda6"}
Jul 02 19:03:39.231599 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:39.231407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:39.232125 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:39.231485    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:39.232125 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:39.231698    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:39.232125 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:39.231793    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:39.395525 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:39.395487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" event={"ID":"e387eae1-972b-4da2-837a-d91259bd1775","Type":"ContainerStarted","Data":"fc4bea570fabb7ee7bb7b60b72d7062085f90d8e6300c4e47bf8610e2b54dde5"}
Jul 02 19:03:39.395822 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:39.395800    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:39.414944 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:39.414915    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:39.424444 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:39.424392    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck" podStartSLOduration=9.258279235 podStartE2EDuration="32.424375087s" totalImagesPullingTime="23.166095852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:39.423544963 +0000 UTC m=+32.728565502" watchObservedRunningTime="2026-07-02 19:03:39.424375087 +0000 UTC m=+32.729395620"
Jul 02 19:03:40.231419 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.231382    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:40.231677 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.231522    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:40.377309 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.377265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z4sw2"]
Jul 02 19:03:40.379932 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.379902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hzv6h"]
Jul 02 19:03:40.380111 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.380008    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:40.380190 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.380165    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:40.393287 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.393251    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bfvmt"]
Jul 02 19:03:40.393457 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.393369    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:40.393521 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.393482    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:40.398905 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.398872    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:40.399067 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.398983    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:40.399511 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.399487    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:40.399633 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.399563    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:40.420228 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.420194    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:03:40.885440 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.885403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:40.885686 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.885492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:40.885686 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.885600    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:03:40.885686 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.885608    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:40.885686 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.885627    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:03:40.885686 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.885641    2577 projected.go:196] Error preparing data for projected volume kube-api-access-b4g4x for pod openshift-network-diagnostics/network-check-target-z4sw2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:40.885686 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.885682    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret podName:9660efa6-60d1-4a9f-92e5-8a51085714cf nodeName:}" failed. No retries permitted until 2026-07-02 19:04:12.885664144 +0000 UTC m=+66.190684683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret") pod "global-pull-secret-syncer-hzv6h" (UID: "9660efa6-60d1-4a9f-92e5-8a51085714cf") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:03:40.885986 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.885703    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x podName:e1abd119-a937-4946-bb1e-be233927c694 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:12.885692685 +0000 UTC m=+66.190713212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4g4x" (UniqueName: "kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x") pod "network-check-target-z4sw2" (UID: "e1abd119-a937-4946-bb1e-be233927c694") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:03:40.985885 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:40.985829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:40.986068 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.986042    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:40.986135 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:40.986120    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs podName:6a134df9-1516-4edc-a2a5-fa06815a4339 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:12.986097537 +0000 UTC m=+66.291118053 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs") pod "network-metrics-daemon-bfvmt" (UID: "6a134df9-1516-4edc-a2a5-fa06815a4339") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:03:42.231673 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:42.231638    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:42.232107 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:42.231690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:42.232107 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:42.231691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:42.232107 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:42.231782    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:42.232107 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:42.231876    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:42.232107 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:42.231951    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:44.231674 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:44.231481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:44.232068 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:44.231533    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:44.232068 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:44.231744    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:44.232068 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:44.231533    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:44.232068 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:44.231820    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:44.232068 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:44.231944    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:44.411381 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:44.411345    2577 generic.go:356] "Generic (PLEG): container finished" podID="faf38419-9534-4231-a8b5-d4ed655b1a51" containerID="b88e61c67749705bf7b00b5935f8330792c192946e985049633ec153ecf7fff5" exitCode=0
Jul 02 19:03:44.411565 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:44.411391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" event={"ID":"faf38419-9534-4231-a8b5-d4ed655b1a51","Type":"ContainerDied","Data":"b88e61c67749705bf7b00b5935f8330792c192946e985049633ec153ecf7fff5"}
Jul 02 19:03:45.416793 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:45.416754    2577 generic.go:356] "Generic (PLEG): container finished" podID="faf38419-9534-4231-a8b5-d4ed655b1a51" containerID="4a7443b9afa99a3167880aa5171373cc034683a302c57df546c3a0d6aa7fc45b" exitCode=0
Jul 02 19:03:45.417293 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:45.416806    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" event={"ID":"faf38419-9534-4231-a8b5-d4ed655b1a51","Type":"ContainerDied","Data":"4a7443b9afa99a3167880aa5171373cc034683a302c57df546c3a0d6aa7fc45b"}
Jul 02 19:03:46.231747 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:46.231704    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:46.231961 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:46.231761    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:46.231961 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:46.231867    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:46.231961 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:46.231874    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hzv6h" podUID="9660efa6-60d1-4a9f-92e5-8a51085714cf"
Jul 02 19:03:46.231961 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:46.231953    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfvmt" podUID="6a134df9-1516-4edc-a2a5-fa06815a4339"
Jul 02 19:03:46.232098 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:46.232022    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z4sw2" podUID="e1abd119-a937-4946-bb1e-be233927c694"
Jul 02 19:03:46.422593 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:46.422556    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" event={"ID":"faf38419-9534-4231-a8b5-d4ed655b1a51","Type":"ContainerStarted","Data":"59017f7e8e46a1fa7ff9a55bc93f0a740d834f3f71251630aa3e152d42488752"}
Jul 02 19:03:46.446797 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:46.446745    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4tcsk" podStartSLOduration=9.249567172 podStartE2EDuration="39.446728013s" totalImagesPullingTime="30.197160841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:46.445124759 +0000 UTC m=+39.750145285" watchObservedRunningTime="2026-07-02 19:03:46.446728013 +0000 UTC m=+39.751748551"
Jul 02 19:03:46.994757 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:46.994729    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-135.ec2.internal" event="NodeReady"
Jul 02 19:03:46.994961 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:46.994876    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:03:47.034941 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.034909    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c46f86cf8-65ndd"]
Jul 02 19:03:47.058465 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.058436    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zmjh9"]
Jul 02 19:03:47.058614 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.058562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.061773 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.061672    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 19:03:47.061773 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.061691    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 19:03:47.061773 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.061675    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 19:03:47.063870 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.063255    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n6mp5\""
Jul 02 19:03:47.072193 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.072171    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 19:03:47.074533 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.074515    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cphb5"]
Jul 02 19:03:47.074633 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.074619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.077680 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.077656    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s5tjt\""
Jul 02 19:03:47.077809 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.077696    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:03:47.077809 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.077717    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:03:47.096888 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.096855    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c46f86cf8-65ndd"]
Jul 02 19:03:47.096888 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.096897    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zmjh9"]
Jul 02 19:03:47.097072 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.096922    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cphb5"]
Jul 02 19:03:47.097072 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.096935    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cphb5"
Jul 02 19:03:47.099767 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.099746    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:03:47.099767 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.099767    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mg9mb\""
Jul 02 19:03:47.099925 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.099819    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:03:47.099925 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.099744    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:03:47.230101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fda4583-47ac-4729-8968-08d0f1c9473c-cert\") pod \"ingress-canary-cphb5\" (UID: \"1fda4583-47ac-4729-8968-08d0f1c9473c\") " pod="openshift-ingress-canary/ingress-canary-cphb5"
Jul 02 19:03:47.230299 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9018a08-409d-419f-aec9-99e32e873a2a-config-volume\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.230299 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4993a986-db9e-489c-b790-16a1bc2b6c8c-ca-trust-extracted\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.230299 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230173    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqwjl\" (UniqueName: \"kubernetes.io/projected/1fda4583-47ac-4729-8968-08d0f1c9473c-kube-api-access-nqwjl\") pod \"ingress-canary-cphb5\" (UID: \"1fda4583-47ac-4729-8968-08d0f1c9473c\") " pod="openshift-ingress-canary/ingress-canary-cphb5"
Jul 02 19:03:47.230299 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.230299 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230211    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9018a08-409d-419f-aec9-99e32e873a2a-tmp-dir\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.230299 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230243    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-image-registry-private-configuration\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.230299 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.230619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-certificates\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.230619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-bound-sa-token\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.230619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-trusted-ca\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.230619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n6xf\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-kube-api-access-8n6xf\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.230619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230384    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zr7s\" (UniqueName: \"kubernetes.io/projected/b9018a08-409d-419f-aec9-99e32e873a2a-kube-api-access-9zr7s\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.230619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.230403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-installation-pull-secrets\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.331544 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-image-registry-private-configuration\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.331752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.331752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-certificates\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.331752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-bound-sa-token\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.331752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-trusted-ca\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.331752 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.331682    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:03:47.331752 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.331706    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46f86cf8-65ndd: secret "image-registry-tls" not found
Jul 02 19:03:47.332061 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.331766    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls podName:4993a986-db9e-489c-b790-16a1bc2b6c8c nodeName:}" failed. No retries permitted until 2026-07-02 19:03:47.83174539 +0000 UTC m=+41.136765905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls") pod "image-registry-6c46f86cf8-65ndd" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c") : secret "image-registry-tls" not found
Jul 02 19:03:47.332061 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n6xf\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-kube-api-access-8n6xf\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.332061 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zr7s\" (UniqueName: \"kubernetes.io/projected/b9018a08-409d-419f-aec9-99e32e873a2a-kube-api-access-9zr7s\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.332061 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-installation-pull-secrets\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.332061 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.331966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fda4583-47ac-4729-8968-08d0f1c9473c-cert\") pod \"ingress-canary-cphb5\" (UID: \"1fda4583-47ac-4729-8968-08d0f1c9473c\") " pod="openshift-ingress-canary/ingress-canary-cphb5"
Jul 02 19:03:47.332061 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9018a08-409d-419f-aec9-99e32e873a2a-config-volume\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.332309 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4993a986-db9e-489c-b790-16a1bc2b6c8c-ca-trust-extracted\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.332309 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqwjl\" (UniqueName: \"kubernetes.io/projected/1fda4583-47ac-4729-8968-08d0f1c9473c-kube-api-access-nqwjl\") pod \"ingress-canary-cphb5\" (UID: \"1fda4583-47ac-4729-8968-08d0f1c9473c\") " pod="openshift-ingress-canary/ingress-canary-cphb5"
Jul 02 19:03:47.332309 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.332309 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9018a08-409d-419f-aec9-99e32e873a2a-tmp-dir\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.332584 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332562    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9018a08-409d-419f-aec9-99e32e873a2a-tmp-dir\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.332662 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.332649    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:47.332703 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332679    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b9018a08-409d-419f-aec9-99e32e873a2a-config-volume\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.332799 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.332709    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls podName:b9018a08-409d-419f-aec9-99e32e873a2a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:47.832692523 +0000 UTC m=+41.137713037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls") pod "dns-default-zmjh9" (UID: "b9018a08-409d-419f-aec9-99e32e873a2a") : secret "dns-default-metrics-tls" not found
Jul 02 19:03:47.332799 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332784    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-certificates\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.332990 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.332974    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4993a986-db9e-489c-b790-16a1bc2b6c8c-ca-trust-extracted\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.333319 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.333301    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-trusted-ca\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.336490 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.336462    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-image-registry-private-configuration\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.336605 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.336468    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fda4583-47ac-4729-8968-08d0f1c9473c-cert\") pod \"ingress-canary-cphb5\" (UID: \"1fda4583-47ac-4729-8968-08d0f1c9473c\") " pod="openshift-ingress-canary/ingress-canary-cphb5"
Jul 02 19:03:47.336605 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.336463    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-installation-pull-secrets\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.343126 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.343099    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zr7s\" (UniqueName: \"kubernetes.io/projected/b9018a08-409d-419f-aec9-99e32e873a2a-kube-api-access-9zr7s\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.343295 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.343274    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-bound-sa-token\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.343569 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.343550    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n6xf\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-kube-api-access-8n6xf\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.343610 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.343557    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqwjl\" (UniqueName: \"kubernetes.io/projected/1fda4583-47ac-4729-8968-08d0f1c9473c-kube-api-access-nqwjl\") pod \"ingress-canary-cphb5\" (UID: \"1fda4583-47ac-4729-8968-08d0f1c9473c\") " pod="openshift-ingress-canary/ingress-canary-cphb5"
Jul 02 19:03:47.405520 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.405478    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cphb5"
Jul 02 19:03:47.598073 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.597749    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cphb5"]
Jul 02 19:03:47.602737 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:03:47.602709    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fda4583_47ac_4729_8968_08d0f1c9473c.slice/crio-fe8d613fc0970059f7c5304a1b9f94a00fd2f5ff0f39daef529683ea2e979939 WatchSource:0}: Error finding container fe8d613fc0970059f7c5304a1b9f94a00fd2f5ff0f39daef529683ea2e979939: Status 404 returned error can't find the container with id fe8d613fc0970059f7c5304a1b9f94a00fd2f5ff0f39daef529683ea2e979939
Jul 02 19:03:47.839488 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.839447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:47.839651 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:47.839522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:47.839651 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.839612    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:03:47.839651 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.839631    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46f86cf8-65ndd: secret "image-registry-tls" not found
Jul 02 19:03:47.839651 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.839650    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:47.839776 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.839698    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls podName:4993a986-db9e-489c-b790-16a1bc2b6c8c nodeName:}" failed. No retries permitted until 2026-07-02 19:03:48.839679334 +0000 UTC m=+42.144699860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls") pod "image-registry-6c46f86cf8-65ndd" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c") : secret "image-registry-tls" not found
Jul 02 19:03:47.839776 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:47.839712    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls podName:b9018a08-409d-419f-aec9-99e32e873a2a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:48.839706083 +0000 UTC m=+42.144726600 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls") pod "dns-default-zmjh9" (UID: "b9018a08-409d-419f-aec9-99e32e873a2a") : secret "dns-default-metrics-tls" not found
Jul 02 19:03:48.231807 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.231768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:03:48.232059 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.231776    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:03:48.232059 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.231776    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:03:48.234965 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.234941    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:03:48.235126 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.234983    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9s6wg\""
Jul 02 19:03:48.235126 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.234982    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:03:48.235241 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.235220    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t6qb6\""
Jul 02 19:03:48.235348 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.235271    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:03:48.235388 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.235354    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:03:48.428980 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.428946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cphb5" event={"ID":"1fda4583-47ac-4729-8968-08d0f1c9473c","Type":"ContainerStarted","Data":"fe8d613fc0970059f7c5304a1b9f94a00fd2f5ff0f39daef529683ea2e979939"}
Jul 02 19:03:48.848909 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.848879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:48.849302 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:48.848944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:48.849302 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:48.849061    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:48.849302 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:48.849091    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:03:48.849302 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:48.849106    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46f86cf8-65ndd: secret "image-registry-tls" not found
Jul 02 19:03:48.849302 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:48.849143    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls podName:b9018a08-409d-419f-aec9-99e32e873a2a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:50.849118882 +0000 UTC m=+44.154139410 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls") pod "dns-default-zmjh9" (UID: "b9018a08-409d-419f-aec9-99e32e873a2a") : secret "dns-default-metrics-tls" not found
Jul 02 19:03:48.849302 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:48.849162    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls podName:4993a986-db9e-489c-b790-16a1bc2b6c8c nodeName:}" failed. No retries permitted until 2026-07-02 19:03:50.849152877 +0000 UTC m=+44.154173395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls") pod "image-registry-6c46f86cf8-65ndd" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c") : secret "image-registry-tls" not found
Jul 02 19:03:50.373132 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:50.373080    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p2rbw_daad7711-32e7-4070-ba51-dfba7bcac052/konnectivity-agent/0.log" limit=1024
Jul 02 19:03:50.863203 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:50.863150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:50.863395 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:50.863233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:50.863395 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:50.863304    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:03:50.863395 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:50.863323    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46f86cf8-65ndd: secret "image-registry-tls" not found
Jul 02 19:03:50.863395 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:50.863335    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:50.863395 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:50.863383    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls podName:4993a986-db9e-489c-b790-16a1bc2b6c8c nodeName:}" failed. No retries permitted until 2026-07-02 19:03:54.863363042 +0000 UTC m=+48.168383570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls") pod "image-registry-6c46f86cf8-65ndd" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c") : secret "image-registry-tls" not found
Jul 02 19:03:50.863395 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:50.863397    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls podName:b9018a08-409d-419f-aec9-99e32e873a2a nodeName:}" failed. No retries permitted until 2026-07-02 19:03:54.86339075 +0000 UTC m=+48.168411264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls") pod "dns-default-zmjh9" (UID: "b9018a08-409d-419f-aec9-99e32e873a2a") : secret "dns-default-metrics-tls" not found
Jul 02 19:03:51.436616 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:51.436580    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cphb5" event={"ID":"1fda4583-47ac-4729-8968-08d0f1c9473c","Type":"ContainerStarted","Data":"6df6c54bfafd1a84076a1433488a7c0d6f30e3c137bc5ec76dfc187a54bdd22f"}
Jul 02 19:03:54.891040 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:54.890999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:03:54.891433 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:03:54.891062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:03:54.891433 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:54.891180    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:03:54.891433 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:54.891192    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46f86cf8-65ndd: secret "image-registry-tls" not found
Jul 02 19:03:54.891433 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:54.891202    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:03:54.891433 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:54.891242    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls podName:4993a986-db9e-489c-b790-16a1bc2b6c8c nodeName:}" failed. No retries permitted until 2026-07-02 19:04:02.89122808 +0000 UTC m=+56.196248594 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls") pod "image-registry-6c46f86cf8-65ndd" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c") : secret "image-registry-tls" not found
Jul 02 19:03:54.891433 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:03:54.891266    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls podName:b9018a08-409d-419f-aec9-99e32e873a2a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:02.891251097 +0000 UTC m=+56.196271611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls") pod "dns-default-zmjh9" (UID: "b9018a08-409d-419f-aec9-99e32e873a2a") : secret "dns-default-metrics-tls" not found
Jul 02 19:04:02.946374 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:02.946330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:04:02.946946 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:02.946396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:04:02.946946 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:02.946473    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:04:02.946946 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:02.946531    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:04:02.946946 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:02.946550    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46f86cf8-65ndd: secret "image-registry-tls" not found
Jul 02 19:04:02.946946 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:02.946535    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls podName:b9018a08-409d-419f-aec9-99e32e873a2a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:18.946520307 +0000 UTC m=+72.251540821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls") pod "dns-default-zmjh9" (UID: "b9018a08-409d-419f-aec9-99e32e873a2a") : secret "dns-default-metrics-tls" not found
Jul 02 19:04:02.946946 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:02.946609    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls podName:4993a986-db9e-489c-b790-16a1bc2b6c8c nodeName:}" failed. No retries permitted until 2026-07-02 19:04:18.946593644 +0000 UTC m=+72.251614164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls") pod "image-registry-6c46f86cf8-65ndd" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c") : secret "image-registry-tls" not found
Jul 02 19:04:12.414752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.414722    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6kxck"
Jul 02 19:04:12.447120 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.447073    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cphb5" podStartSLOduration=22.378737731 podStartE2EDuration="25.447054966s" totalImagesPullingTime="3.068317235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:03:51.45901364 +0000 UTC m=+44.764034177" watchObservedRunningTime="2026-07-02 19:04:12.447054966 +0000 UTC m=+65.752075501"
Jul 02 19:04:12.917201 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.917161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:04:12.917390 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.917223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:04:12.920053 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.920029    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:04:12.920178 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.920038    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:04:12.930261 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.930230    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:04:12.931792 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.931767    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9660efa6-60d1-4a9f-92e5-8a51085714cf-original-pull-secret\") pod \"global-pull-secret-syncer-hzv6h\" (UID: \"9660efa6-60d1-4a9f-92e5-8a51085714cf\") " pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:04:12.940541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:12.940505    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4g4x\" (UniqueName: \"kubernetes.io/projected/e1abd119-a937-4946-bb1e-be233927c694-kube-api-access-b4g4x\") pod \"network-check-target-z4sw2\" (UID: \"e1abd119-a937-4946-bb1e-be233927c694\") " pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:04:13.018209 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.018164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:04:13.021104 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.021081    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:04:13.028916 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:13.028884    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 19:04:13.029062 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:13.028959    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs podName:6a134df9-1516-4edc-a2a5-fa06815a4339 nodeName:}" failed. No retries permitted until 2026-07-02 19:05:17.028940797 +0000 UTC m=+130.333961311 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs") pod "network-metrics-daemon-bfvmt" (UID: "6a134df9-1516-4edc-a2a5-fa06815a4339") : secret "metrics-daemon-secret" not found
Jul 02 19:04:13.146582 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.146541    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hzv6h"
Jul 02 19:04:13.162434 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.162410    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t6qb6\""
Jul 02 19:04:13.170064 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.169980    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:04:13.307616 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.307582    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hzv6h"]
Jul 02 19:04:13.310402 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:13.310376    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9660efa6_60d1_4a9f_92e5_8a51085714cf.slice/crio-a20184eaf59678be60ff9ae56a8e7d64b0e65a0fddacb2ce2fbbc209defc266f WatchSource:0}: Error finding container a20184eaf59678be60ff9ae56a8e7d64b0e65a0fddacb2ce2fbbc209defc266f: Status 404 returned error can't find the container with id a20184eaf59678be60ff9ae56a8e7d64b0e65a0fddacb2ce2fbbc209defc266f
Jul 02 19:04:13.323491 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.323468    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z4sw2"]
Jul 02 19:04:13.326970 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:13.326947    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1abd119_a937_4946_bb1e_be233927c694.slice/crio-fe4f565ba14c581a06c20a498cc2409c382aae89d12e415d6b2ddb71d48d299a WatchSource:0}: Error finding container fe4f565ba14c581a06c20a498cc2409c382aae89d12e415d6b2ddb71d48d299a: Status 404 returned error can't find the container with id fe4f565ba14c581a06c20a498cc2409c382aae89d12e415d6b2ddb71d48d299a
Jul 02 19:04:13.496305 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.496229    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z4sw2" event={"ID":"e1abd119-a937-4946-bb1e-be233927c694","Type":"ContainerStarted","Data":"fe4f565ba14c581a06c20a498cc2409c382aae89d12e415d6b2ddb71d48d299a"}
Jul 02 19:04:13.497279 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.497251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hzv6h" event={"ID":"9660efa6-60d1-4a9f-92e5-8a51085714cf","Type":"ContainerStarted","Data":"a20184eaf59678be60ff9ae56a8e7d64b0e65a0fddacb2ce2fbbc209defc266f"}
Jul 02 19:04:13.696029 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.695994    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"]
Jul 02 19:04:13.725880 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.725821    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"]
Jul 02 19:04:13.726029 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.725968    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:13.728786 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.728764    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 02 19:04:13.728786 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.728776    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:04:13.728786 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.728797    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 02 19:04:13.729017 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.728921    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cmx42\""
Jul 02 19:04:13.800852 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.800821    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"]
Jul 02 19:04:13.821353 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.821322    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qg7s9"]
Jul 02 19:04:13.821494 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.821451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:13.823497 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.823474    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tssp2\" (UniqueName: \"kubernetes.io/projected/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-kube-api-access-tssp2\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:13.823642 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.823502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:13.825145 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.825125    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 19:04:13.825461 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.825397    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 19:04:13.825461 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.825443    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 19:04:13.825798 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.825779    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:04:13.826272 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.826252    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tfjbs\""
Jul 02 19:04:13.839807 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.839769    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"]
Jul 02 19:04:13.839807 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.839810    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qg7s9"]
Jul 02 19:04:13.840007 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.839921    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:13.843954 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.843933    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 19:04:13.843954 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.843950    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 19:04:13.844258 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.844242    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:04:13.844369 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.844302    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vsw8t\""
Jul 02 19:04:13.844369 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.844309    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:04:13.849721 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.849702    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 19:04:13.900894 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.900857    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb"]
Jul 02 19:04:13.915897 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.914500    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf"]
Jul 02 19:04:13.915897 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.914609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb"
Jul 02 19:04:13.918619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.917895    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 02 19:04:13.918619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.917991    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kfldm\""
Jul 02 19:04:13.918619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.917896    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:04:13.924551 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tssp2\" (UniqueName: \"kubernetes.io/projected/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-kube-api-access-tssp2\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:13.924551 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:13.924551 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cafad4ac-c0f8-4111-b661-b62155388fcb-config\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:13.924551 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll692\" (UniqueName: \"kubernetes.io/projected/25d5e7bb-b846-431c-8dbe-28dc4951a632-kube-api-access-ll692\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:13.924551 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924504    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25d5e7bb-b846-431c-8dbe-28dc4951a632-serving-cert\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:13.924551 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25d5e7bb-b846-431c-8dbe-28dc4951a632-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:13.924551 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cafad4ac-c0f8-4111-b661-b62155388fcb-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:13.925078 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25d5e7bb-b846-431c-8dbe-28dc4951a632-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:13.925078 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26w6m\" (UniqueName: \"kubernetes.io/projected/cafad4ac-c0f8-4111-b661-b62155388fcb-kube-api-access-26w6m\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:13.925078 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25d5e7bb-b846-431c-8dbe-28dc4951a632-tmp\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:13.925078 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.924651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/25d5e7bb-b846-431c-8dbe-28dc4951a632-snapshots\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:13.925078 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:13.924949    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:04:13.925078 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:13.925011    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls podName:5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:14.424992022 +0000 UTC m=+67.730012536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gshgn" (UID: "5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9") : secret "samples-operator-tls" not found
Jul 02 19:04:13.928624 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.928605    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb"]
Jul 02 19:04:13.928749 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.928641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf"]
Jul 02 19:04:13.928749 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.928740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf"
Jul 02 19:04:13.931295 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.931273    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4jzpb\""
Jul 02 19:04:13.936668 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:13.936649    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tssp2\" (UniqueName: \"kubernetes.io/projected/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-kube-api-access-tssp2\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:14.025605 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cafad4ac-c0f8-4111-b661-b62155388fcb-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:14.025802 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25d5e7bb-b846-431c-8dbe-28dc4951a632-serving-cert\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.025802 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25d5e7bb-b846-431c-8dbe-28dc4951a632-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.025802 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025684    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25d5e7bb-b846-431c-8dbe-28dc4951a632-tmp\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.025802 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25d5e7bb-b846-431c-8dbe-28dc4951a632-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.026099 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zqxd\" (UniqueName: \"kubernetes.io/projected/a1cf4665-a7d6-49eb-9ea9-ec858f56393c-kube-api-access-8zqxd\") pod \"volume-data-source-validator-5d456fdbcd-pxgkb\" (UID: \"a1cf4665-a7d6-49eb-9ea9-ec858f56393c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb"
Jul 02 19:04:14.026099 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26w6m\" (UniqueName: \"kubernetes.io/projected/cafad4ac-c0f8-4111-b661-b62155388fcb-kube-api-access-26w6m\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:14.026099 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zllf9\" (UniqueName: \"kubernetes.io/projected/1b9af636-14a7-4b44-a008-f040b97f8ff1-kube-api-access-zllf9\") pod \"network-check-source-989f8b8dc-sjwnf\" (UID: \"1b9af636-14a7-4b44-a008-f040b97f8ff1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf"
Jul 02 19:04:14.026099 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/25d5e7bb-b846-431c-8dbe-28dc4951a632-snapshots\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.026099 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cafad4ac-c0f8-4111-b661-b62155388fcb-config\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:14.026099 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.025998    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll692\" (UniqueName: \"kubernetes.io/projected/25d5e7bb-b846-431c-8dbe-28dc4951a632-kube-api-access-ll692\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.027895 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.027752    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25d5e7bb-b846-431c-8dbe-28dc4951a632-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.028759 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.028058    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/25d5e7bb-b846-431c-8dbe-28dc4951a632-snapshots\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.028759 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.028261    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cafad4ac-c0f8-4111-b661-b62155388fcb-config\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:14.028759 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.028703    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25d5e7bb-b846-431c-8dbe-28dc4951a632-tmp\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.029263 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.029243    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25d5e7bb-b846-431c-8dbe-28dc4951a632-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.031211 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.031187    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/25d5e7bb-b846-431c-8dbe-28dc4951a632-serving-cert\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.035296 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.035249    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll692\" (UniqueName: \"kubernetes.io/projected/25d5e7bb-b846-431c-8dbe-28dc4951a632-kube-api-access-ll692\") pod \"insights-operator-5c847dcfc4-qg7s9\" (UID: \"25d5e7bb-b846-431c-8dbe-28dc4951a632\") " pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.035954 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.035920    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26w6m\" (UniqueName: \"kubernetes.io/projected/cafad4ac-c0f8-4111-b661-b62155388fcb-kube-api-access-26w6m\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:14.036182 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.036161    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cafad4ac-c0f8-4111-b661-b62155388fcb-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-9frwl\" (UID: \"cafad4ac-c0f8-4111-b661-b62155388fcb\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:14.127105 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.127021    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zqxd\" (UniqueName: \"kubernetes.io/projected/a1cf4665-a7d6-49eb-9ea9-ec858f56393c-kube-api-access-8zqxd\") pod \"volume-data-source-validator-5d456fdbcd-pxgkb\" (UID: \"a1cf4665-a7d6-49eb-9ea9-ec858f56393c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb"
Jul 02 19:04:14.127105 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.127070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zllf9\" (UniqueName: \"kubernetes.io/projected/1b9af636-14a7-4b44-a008-f040b97f8ff1-kube-api-access-zllf9\") pod \"network-check-source-989f8b8dc-sjwnf\" (UID: \"1b9af636-14a7-4b44-a008-f040b97f8ff1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf"
Jul 02 19:04:14.131964 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.131927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"
Jul 02 19:04:14.135725 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.135676    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zqxd\" (UniqueName: \"kubernetes.io/projected/a1cf4665-a7d6-49eb-9ea9-ec858f56393c-kube-api-access-8zqxd\") pod \"volume-data-source-validator-5d456fdbcd-pxgkb\" (UID: \"a1cf4665-a7d6-49eb-9ea9-ec858f56393c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb"
Jul 02 19:04:14.135725 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.135690    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zllf9\" (UniqueName: \"kubernetes.io/projected/1b9af636-14a7-4b44-a008-f040b97f8ff1-kube-api-access-zllf9\") pod \"network-check-source-989f8b8dc-sjwnf\" (UID: \"1b9af636-14a7-4b44-a008-f040b97f8ff1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf"
Jul 02 19:04:14.149383 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.149356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9"
Jul 02 19:04:14.227024 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.226762    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb"
Jul 02 19:04:14.250274 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.250041    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf"
Jul 02 19:04:14.340826 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.340742    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl"]
Jul 02 19:04:14.345870 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:14.345627    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcafad4ac_c0f8_4111_b661_b62155388fcb.slice/crio-a07ecf03e8465b389f75dc56d6d8f4fc2d6956a9cce62b9b23bf2c169eb8732a WatchSource:0}: Error finding container a07ecf03e8465b389f75dc56d6d8f4fc2d6956a9cce62b9b23bf2c169eb8732a: Status 404 returned error can't find the container with id a07ecf03e8465b389f75dc56d6d8f4fc2d6956a9cce62b9b23bf2c169eb8732a
Jul 02 19:04:14.373045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.372963    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qg7s9"]
Jul 02 19:04:14.381723 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:14.381633    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d5e7bb_b846_431c_8dbe_28dc4951a632.slice/crio-ab70127b1c996e7a541dc2cadd4ad5fd2a5a2f45ee39500a667959c1fdac5243 WatchSource:0}: Error finding container ab70127b1c996e7a541dc2cadd4ad5fd2a5a2f45ee39500a667959c1fdac5243: Status 404 returned error can't find the container with id ab70127b1c996e7a541dc2cadd4ad5fd2a5a2f45ee39500a667959c1fdac5243
Jul 02 19:04:14.431018 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.430773    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb"]
Jul 02 19:04:14.431436 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.431288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:14.431508 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:14.431441    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:04:14.431608 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:14.431520    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls podName:5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:15.431503814 +0000 UTC m=+68.736524328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gshgn" (UID: "5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9") : secret "samples-operator-tls" not found
Jul 02 19:04:14.434287 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:14.434241    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1cf4665_a7d6_49eb_9ea9_ec858f56393c.slice/crio-65d0ef8fcf571ea3ed0a5769a3a2a01b1fdcd791161f57a053c264299ae85f4a WatchSource:0}: Error finding container 65d0ef8fcf571ea3ed0a5769a3a2a01b1fdcd791161f57a053c264299ae85f4a: Status 404 returned error can't find the container with id 65d0ef8fcf571ea3ed0a5769a3a2a01b1fdcd791161f57a053c264299ae85f4a
Jul 02 19:04:14.456897 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.456865    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf"]
Jul 02 19:04:14.459876 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:14.459831    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9af636_14a7_4b44_a008_f040b97f8ff1.slice/crio-19c7f3e172e7a94bd7b77f9d5e4366110c4e904e4049f473cb634362434af257 WatchSource:0}: Error finding container 19c7f3e172e7a94bd7b77f9d5e4366110c4e904e4049f473cb634362434af257: Status 404 returned error can't find the container with id 19c7f3e172e7a94bd7b77f9d5e4366110c4e904e4049f473cb634362434af257
Jul 02 19:04:14.502102 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.502063    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb" event={"ID":"a1cf4665-a7d6-49eb-9ea9-ec858f56393c","Type":"ContainerStarted","Data":"65d0ef8fcf571ea3ed0a5769a3a2a01b1fdcd791161f57a053c264299ae85f4a"}
Jul 02 19:04:14.503563 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.503528    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf" event={"ID":"1b9af636-14a7-4b44-a008-f040b97f8ff1","Type":"ContainerStarted","Data":"19c7f3e172e7a94bd7b77f9d5e4366110c4e904e4049f473cb634362434af257"}
Jul 02 19:04:14.505128 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.505102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9" event={"ID":"25d5e7bb-b846-431c-8dbe-28dc4951a632","Type":"ContainerStarted","Data":"ab70127b1c996e7a541dc2cadd4ad5fd2a5a2f45ee39500a667959c1fdac5243"}
Jul 02 19:04:14.506462 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:14.506426    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl" event={"ID":"cafad4ac-c0f8-4111-b661-b62155388fcb","Type":"ContainerStarted","Data":"a07ecf03e8465b389f75dc56d6d8f4fc2d6956a9cce62b9b23bf2c169eb8732a"}
Jul 02 19:04:15.441999 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:15.441355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:15.441999 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:15.441551    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:04:15.441999 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:15.441619    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls podName:5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:17.441596193 +0000 UTC m=+70.746616725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gshgn" (UID: "5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9") : secret "samples-operator-tls" not found
Jul 02 19:04:16.517963 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:16.517912    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb" event={"ID":"a1cf4665-a7d6-49eb-9ea9-ec858f56393c","Type":"ContainerStarted","Data":"2a3479d2d361ce4d8e4a0f19d2d27d3531704496b7d38d2beb97c103b630628b"}
Jul 02 19:04:16.537247 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:16.537167    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-pxgkb" podStartSLOduration=1.741192822 podStartE2EDuration="3.537144374s" totalImagesPullingTime="1.795951552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:16.536250083 +0000 UTC m=+69.841270620" watchObservedRunningTime="2026-07-02 19:04:16.537144374 +0000 UTC m=+69.842164888"
Jul 02 19:04:17.460999 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:17.460963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:17.461213 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:17.461099    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:04:17.461213 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:17.461160    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls podName:5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:21.461141818 +0000 UTC m=+74.766162332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gshgn" (UID: "5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9") : secret "samples-operator-tls" not found
Jul 02 19:04:18.975526 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:18.975486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:04:18.976029 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:18.975591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:04:18.976029 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:18.975669    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:04:18.976029 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:18.975691    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c46f86cf8-65ndd: secret "image-registry-tls" not found
Jul 02 19:04:18.976029 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:18.975711    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:04:18.976029 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:18.975754    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls podName:4993a986-db9e-489c-b790-16a1bc2b6c8c nodeName:}" failed. No retries permitted until 2026-07-02 19:04:50.975732207 +0000 UTC m=+104.280752744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls") pod "image-registry-6c46f86cf8-65ndd" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c") : secret "image-registry-tls" not found
Jul 02 19:04:18.976029 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:18.975771    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls podName:b9018a08-409d-419f-aec9-99e32e873a2a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:50.975763171 +0000 UTC m=+104.280783690 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls") pod "dns-default-zmjh9" (UID: "b9018a08-409d-419f-aec9-99e32e873a2a") : secret "dns-default-metrics-tls" not found
Jul 02 19:04:20.532509 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.532470    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z4sw2" event={"ID":"e1abd119-a937-4946-bb1e-be233927c694","Type":"ContainerStarted","Data":"7e79abca4e8c8750c7025ca86c8281986405b70b9a8a0e9d73f8301fdcb354d2"}
Jul 02 19:04:20.533003 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.532592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:04:20.534563 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.534521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hzv6h" event={"ID":"9660efa6-60d1-4a9f-92e5-8a51085714cf","Type":"ContainerStarted","Data":"954111fd14d1a353c14d827e9094b2f169d7d34dea0c98593919408cf5ba1188"}
Jul 02 19:04:20.536228 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.536197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf" event={"ID":"1b9af636-14a7-4b44-a008-f040b97f8ff1","Type":"ContainerStarted","Data":"bb663b52b5892f3e6e3ee435eda404d4e55c7f86557fe763ed1f5f698cd7b823"}
Jul 02 19:04:20.537908 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.537883    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9" event={"ID":"25d5e7bb-b846-431c-8dbe-28dc4951a632","Type":"ContainerStarted","Data":"f62c4cbbfb23cb021d3bc0369faf52df06a85f6e8fa294cee4556ac127022e88"}
Jul 02 19:04:20.539397 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.539374    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl" event={"ID":"cafad4ac-c0f8-4111-b661-b62155388fcb","Type":"ContainerStarted","Data":"b39d102d07d7abe0f21de3fac2e1272f1173cb13c3dd1f3bbb2377cdf3dd0b48"}
Jul 02 19:04:20.553342 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.553286    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z4sw2" podStartSLOduration=66.762180591 podStartE2EDuration="1m13.553264393s" totalImagesPullingTime="6.791083802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:20.552793213 +0000 UTC m=+73.857813744" watchObservedRunningTime="2026-07-02 19:04:20.553264393 +0000 UTC m=+73.858284930"
Jul 02 19:04:20.569777 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.569716    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9" podStartSLOduration=1.848586567 podStartE2EDuration="7.569696622s" totalImagesPullingTime="5.721110055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:20.569470303 +0000 UTC m=+73.874490841" watchObservedRunningTime="2026-07-02 19:04:20.569696622 +0000 UTC m=+73.874717160"
Jul 02 19:04:20.586236 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.586178    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hzv6h" podStartSLOduration=66.772224681 podStartE2EDuration="1m13.586155026s" totalImagesPullingTime="6.813930345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:20.584927667 +0000 UTC m=+73.889948204" watchObservedRunningTime="2026-07-02 19:04:20.586155026 +0000 UTC m=+73.891175567"
Jul 02 19:04:20.603597 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.603446    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-sjwnf" podStartSLOduration=1.935343595 podStartE2EDuration="7.6034227s" totalImagesPullingTime="5.668079105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:20.601333438 +0000 UTC m=+73.906353975" watchObservedRunningTime="2026-07-02 19:04:20.6034227 +0000 UTC m=+73.908443433"
Jul 02 19:04:20.625070 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:20.625018    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl" podStartSLOduration=1.8626030230000001 podStartE2EDuration="7.624995765s" totalImagesPullingTime="5.762392742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:20.624515639 +0000 UTC m=+73.929536178" watchObservedRunningTime="2026-07-02 19:04:20.624995765 +0000 UTC m=+73.930016301"
Jul 02 19:04:21.497835 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.497793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:21.498008 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:21.497943    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:04:21.498008 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:21.498004    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls podName:5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.497989673 +0000 UTC m=+82.803010187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gshgn" (UID: "5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9") : secret "samples-operator-tls" not found
Jul 02 19:04:21.718954 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.718900    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-znp2q"]
Jul 02 19:04:21.723332 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.723298    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.727177 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.726731    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rhh92\""
Jul 02 19:04:21.727177 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.727029    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:04:21.727394 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.727220    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:04:21.735986 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.735899    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-znp2q"]
Jul 02 19:04:21.801066 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.801028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c122118-acd6-4901-ab11-74b2ca8b594a-data-volume\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.801066 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.801066    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.801320 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.801088    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.801320 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.801207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrj9m\" (UniqueName: \"kubernetes.io/projected/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-api-access-mrj9m\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.801320 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.801270    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c122118-acd6-4901-ab11-74b2ca8b594a-crio-socket\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.902546 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.902507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c122118-acd6-4901-ab11-74b2ca8b594a-data-volume\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.902546 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.902545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.902750 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.902567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.902750 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.902612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrj9m\" (UniqueName: \"kubernetes.io/projected/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-api-access-mrj9m\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.902750 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:21.902660    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:04:21.902750 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:21.902737    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:22.402716349 +0000 UTC m=+75.707736882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : configmap "kube-rbac-proxy" not found
Jul 02 19:04:21.902750 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:21.902739    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:21.902950 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.902662    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c122118-acd6-4901-ab11-74b2ca8b594a-crio-socket\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.902950 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:21.902809    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:22.402778244 +0000 UTC m=+75.707798769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:21.902950 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.902818    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c122118-acd6-4901-ab11-74b2ca8b594a-crio-socket\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.902950 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.902909    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c122118-acd6-4901-ab11-74b2ca8b594a-data-volume\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:21.912891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:21.912858    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrj9m\" (UniqueName: \"kubernetes.io/projected/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-api-access-mrj9m\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:22.407491 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:22.407453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:22.407713 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:22.407593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:22.407713 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:22.407621    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:22.407713 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:22.407674    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:04:22.407713 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:22.407696    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:23.407680924 +0000 UTC m=+76.712701439 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:22.407909 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:22.407726    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:23.407708399 +0000 UTC m=+76.712728916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : configmap "kube-rbac-proxy" not found
Jul 02 19:04:23.416223 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:23.416175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:23.416223 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:23.416231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:23.416693 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:23.416316    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:04:23.416693 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:23.416328    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:23.416693 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:23.416384    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:25.41637171 +0000 UTC m=+78.721392228 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:23.416693 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:23.416399    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:25.416391284 +0000 UTC m=+78.721411798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : configmap "kube-rbac-proxy" not found
Jul 02 19:04:24.715636 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:24.715607    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dxxf5_51685037-4e29-498f-b7d1-c5ec0ae703dc/dns-node-resolver/0.log"
Jul 02 19:04:25.433940 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:25.433907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:25.434116 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:25.433948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:25.434116 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:25.434036    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:04:25.434116 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:25.434087    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:25.434116 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:25.434106    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.434087511 +0000 UTC m=+82.739108026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : configmap "kube-rbac-proxy" not found
Jul 02 19:04:25.434261 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:25.434135    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:29.43412452 +0000 UTC m=+82.739145033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:25.514970 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:25.514946    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t4gth_9cf2cc53-d9b7-4938-b30a-53971958348b/node-ca/0.log"
Jul 02 19:04:26.314675 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:26.314645    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cphb5_1fda4583-47ac-4729-8968-08d0f1c9473c/serve-healthcheck-canary/0.log"
Jul 02 19:04:29.467213 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:29.467081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:29.467213 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:29.467127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:29.467213 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:29.467206    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:04:29.467663 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:29.467229    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:29.467663 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:29.467270    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:37.467254381 +0000 UTC m=+90.772274896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : configmap "kube-rbac-proxy" not found
Jul 02 19:04:29.467663 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:29.467285    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:37.467278518 +0000 UTC m=+90.772299031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:29.567492 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:29.567452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:29.567635 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:29.567608    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 02 19:04:29.567691 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:29.567677    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls podName:5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:45.567662379 +0000 UTC m=+98.872682894 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-gshgn" (UID: "5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9") : secret "samples-operator-tls" not found
Jul 02 19:04:37.528147 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:37.528088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:37.528147 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:37.528148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:37.528642 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:37.528301    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:37.528642 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:37.528356    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls podName:5c122118-acd6-4901-ab11-74b2ca8b594a nodeName:}" failed. No retries permitted until 2026-07-02 19:04:53.528342728 +0000 UTC m=+106.833363242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-znp2q" (UID: "5c122118-acd6-4901-ab11-74b2ca8b594a") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:04:37.528642 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:37.528600    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c122118-acd6-4901-ab11-74b2ca8b594a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:45.592929 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:45.592888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:45.595427 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:45.595407    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-gshgn\" (UID: \"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:45.834930 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:45.834894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"
Jul 02 19:04:45.963413 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:45.963348    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn"]
Jul 02 19:04:46.625496 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:46.625451    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn" event={"ID":"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9","Type":"ContainerStarted","Data":"fe16fe261d3f5a5963624280f12e1b75e6458d9e94a8ed2a07869ff5c3367b32"}
Jul 02 19:04:47.491538 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.491503    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"]
Jul 02 19:04:47.494438 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.494419    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.497676 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.497649    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 19:04:47.498207 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.498182    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 19:04:47.498659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.498635    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 19:04:47.498760 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.498640    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 19:04:47.517308 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.517266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"]
Jul 02 19:04:47.608158 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.608112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a5391d90-96ae-4287-b051-d6ab2ee53560-klusterlet-config\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.608373 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.608189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5391d90-96ae-4287-b051-d6ab2ee53560-tmp\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.608373 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.608306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2lf9\" (UniqueName: \"kubernetes.io/projected/a5391d90-96ae-4287-b051-d6ab2ee53560-kube-api-access-b2lf9\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.709547 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.709504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2lf9\" (UniqueName: \"kubernetes.io/projected/a5391d90-96ae-4287-b051-d6ab2ee53560-kube-api-access-b2lf9\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.709995 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.709604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a5391d90-96ae-4287-b051-d6ab2ee53560-klusterlet-config\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.709995 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.709629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5391d90-96ae-4287-b051-d6ab2ee53560-tmp\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.710224 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.710197    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a5391d90-96ae-4287-b051-d6ab2ee53560-tmp\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.712667 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.712645    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a5391d90-96ae-4287-b051-d6ab2ee53560-klusterlet-config\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.722308 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.722280    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2lf9\" (UniqueName: \"kubernetes.io/projected/a5391d90-96ae-4287-b051-d6ab2ee53560-kube-api-access-b2lf9\") pod \"klusterlet-addon-workmgr-76f8cb7dbd-fdwrf\" (UID: \"a5391d90-96ae-4287-b051-d6ab2ee53560\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:47.805670 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:47.805634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:48.124569 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.124545    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"]
Jul 02 19:04:48.134053 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:48.134011    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5391d90_96ae_4287_b051_d6ab2ee53560.slice/crio-77094d51053aded24a0db557216dd26bccc7449af669fc4d031917ae1f9fae8a WatchSource:0}: Error finding container 77094d51053aded24a0db557216dd26bccc7449af669fc4d031917ae1f9fae8a: Status 404 returned error can't find the container with id 77094d51053aded24a0db557216dd26bccc7449af669fc4d031917ae1f9fae8a
Jul 02 19:04:48.633424 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.633386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf" event={"ID":"a5391d90-96ae-4287-b051-d6ab2ee53560","Type":"ContainerStarted","Data":"77094d51053aded24a0db557216dd26bccc7449af669fc4d031917ae1f9fae8a"}
Jul 02 19:04:48.634987 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.634962    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn" event={"ID":"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9","Type":"ContainerStarted","Data":"b2ef6b69e2b6ae3ff0d5b3b86cc5cfac3f83ec0a78ae769005e6f4bcf4d2a771"}
Jul 02 19:04:48.635107 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.635006    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn" event={"ID":"5cf3e31e-0b08-4cf4-9d9a-66b89fe549f9","Type":"ContainerStarted","Data":"4db60e74698fe3da1fd90310802e1fb2412c4e0b20907a4dbaafeffbf396aa6e"}
Jul 02 19:04:48.653702 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.653649    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-gshgn" podStartSLOduration=33.618242538 podStartE2EDuration="35.653632897s" totalImagesPullingTime="2.035390359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:48.652733425 +0000 UTC m=+101.957753963" watchObservedRunningTime="2026-07-02 19:04:48.653632897 +0000 UTC m=+101.958653433"
Jul 02 19:04:48.820676 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.820632    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"]
Jul 02 19:04:48.824438 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.824414    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"
Jul 02 19:04:48.827225 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.827196    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 19:04:48.827409 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.827204    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-84w9n\""
Jul 02 19:04:48.835298 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.835266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"]
Jul 02 19:04:48.921954 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:48.921812    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5af495cf-edcb-4f06-adef-81e390ad59e4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4dvxh\" (UID: \"5af495cf-edcb-4f06-adef-81e390ad59e4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"
Jul 02 19:04:49.023178 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:49.023137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5af495cf-edcb-4f06-adef-81e390ad59e4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4dvxh\" (UID: \"5af495cf-edcb-4f06-adef-81e390ad59e4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"
Jul 02 19:04:49.023387 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:49.023315    2577 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 19:04:49.023459 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:04:49.023396    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5af495cf-edcb-4f06-adef-81e390ad59e4-tls-certificates podName:5af495cf-edcb-4f06-adef-81e390ad59e4 nodeName:}" failed. No retries permitted until 2026-07-02 19:04:49.523374637 +0000 UTC m=+102.828395151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/5af495cf-edcb-4f06-adef-81e390ad59e4-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-4dvxh" (UID: "5af495cf-edcb-4f06-adef-81e390ad59e4") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 19:04:49.527756 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:49.527717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5af495cf-edcb-4f06-adef-81e390ad59e4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4dvxh\" (UID: \"5af495cf-edcb-4f06-adef-81e390ad59e4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"
Jul 02 19:04:49.530783 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:49.530732    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/5af495cf-edcb-4f06-adef-81e390ad59e4-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-4dvxh\" (UID: \"5af495cf-edcb-4f06-adef-81e390ad59e4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"
Jul 02 19:04:49.739956 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:49.739913    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"
Jul 02 19:04:50.457308 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:50.457273    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"]
Jul 02 19:04:50.463008 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:50.462978    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af495cf_edcb_4f06_adef_81e390ad59e4.slice/crio-8754411323e1cdc8a7d3ab88219cac16b783acbc644a4fc4922bbb1e08601da8 WatchSource:0}: Error finding container 8754411323e1cdc8a7d3ab88219cac16b783acbc644a4fc4922bbb1e08601da8: Status 404 returned error can't find the container with id 8754411323e1cdc8a7d3ab88219cac16b783acbc644a4fc4922bbb1e08601da8
Jul 02 19:04:50.643430 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:50.643337    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh" event={"ID":"5af495cf-edcb-4f06-adef-81e390ad59e4","Type":"ContainerStarted","Data":"8754411323e1cdc8a7d3ab88219cac16b783acbc644a4fc4922bbb1e08601da8"}
Jul 02 19:04:51.039665 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.039620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:04:51.039892 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.039691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:04:51.042516 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.042454    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b9018a08-409d-419f-aec9-99e32e873a2a-metrics-tls\") pod \"dns-default-zmjh9\" (UID: \"b9018a08-409d-419f-aec9-99e32e873a2a\") " pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:04:51.042655 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.042567    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"image-registry-6c46f86cf8-65ndd\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") " pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:04:51.277181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.277153    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n6mp5\""
Jul 02 19:04:51.284649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.284612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:04:51.284958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.284940    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s5tjt\""
Jul 02 19:04:51.292774 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.292718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:04:51.546960 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.546882    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z4sw2"
Jul 02 19:04:51.868477 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.868423    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c46f86cf8-65ndd"]
Jul 02 19:04:51.871346 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:51.871315    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4993a986_db9e_489c_b790_16a1bc2b6c8c.slice/crio-78f77c48f741911a2751dc351d30ad53dec84ddc1c3354f69e158a55063ddcfe WatchSource:0}: Error finding container 78f77c48f741911a2751dc351d30ad53dec84ddc1c3354f69e158a55063ddcfe: Status 404 returned error can't find the container with id 78f77c48f741911a2751dc351d30ad53dec84ddc1c3354f69e158a55063ddcfe
Jul 02 19:04:51.896768 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:51.896735    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zmjh9"]
Jul 02 19:04:51.902182 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:51.902148    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9018a08_409d_419f_aec9_99e32e873a2a.slice/crio-cb07a35f37fab076a8640a1d369fe8e199d322111f26caa2e7059923e6b5c663 WatchSource:0}: Error finding container cb07a35f37fab076a8640a1d369fe8e199d322111f26caa2e7059923e6b5c663: Status 404 returned error can't find the container with id cb07a35f37fab076a8640a1d369fe8e199d322111f26caa2e7059923e6b5c663
Jul 02 19:04:52.654043 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.654009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf" event={"ID":"a5391d90-96ae-4287-b051-d6ab2ee53560","Type":"ContainerStarted","Data":"fa43107a41eb4ecb6f627e41ef12731a8de98375ac6bde707d309fdd6f8fc147"}
Jul 02 19:04:52.654534 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.654209    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:52.655513 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.655487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmjh9" event={"ID":"b9018a08-409d-419f-aec9-99e32e873a2a","Type":"ContainerStarted","Data":"cb07a35f37fab076a8640a1d369fe8e199d322111f26caa2e7059923e6b5c663"}
Jul 02 19:04:52.656180 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.656159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf"
Jul 02 19:04:52.657504 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.657477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd" event={"ID":"4993a986-db9e-489c-b790-16a1bc2b6c8c","Type":"ContainerStarted","Data":"f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911"}
Jul 02 19:04:52.657617 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.657522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd" event={"ID":"4993a986-db9e-489c-b790-16a1bc2b6c8c","Type":"ContainerStarted","Data":"78f77c48f741911a2751dc351d30ad53dec84ddc1c3354f69e158a55063ddcfe"}
Jul 02 19:04:52.657617 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.657580    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:04:52.671125 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.671070    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76f8cb7dbd-fdwrf" podStartSLOduration=2.008956109 podStartE2EDuration="5.671051272s" totalImagesPullingTime="3.662095163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:52.669716392 +0000 UTC m=+105.974736929" watchObservedRunningTime="2026-07-02 19:04:52.671051272 +0000 UTC m=+105.976071808"
Jul 02 19:04:52.689017 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:52.688941    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd" podStartSLOduration=105.688919261 podStartE2EDuration="1m45.688919261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:52.688496916 +0000 UTC m=+105.993517453" watchObservedRunningTime="2026-07-02 19:04:52.688919261 +0000 UTC m=+105.993939798"
Jul 02 19:04:53.559920 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:53.559870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:53.562609 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:53.562582    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c122118-acd6-4901-ab11-74b2ca8b594a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-znp2q\" (UID: \"5c122118-acd6-4901-ab11-74b2ca8b594a\") " pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:53.665677 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:53.665638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh" event={"ID":"5af495cf-edcb-4f06-adef-81e390ad59e4","Type":"ContainerStarted","Data":"13658a9c976e5fa4cfec63dea33b5b03e4c81dc911e1ad55fe024553b7a0d85d"}
Jul 02 19:04:53.681442 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:53.681394    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh" podStartSLOduration=3.262972335 podStartE2EDuration="5.681377386s" totalImagesPullingTime="2.418405051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:53.680297106 +0000 UTC m=+106.985317639" watchObservedRunningTime="2026-07-02 19:04:53.681377386 +0000 UTC m=+106.986397923"
Jul 02 19:04:53.837808 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:53.837726    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-znp2q"
Jul 02 19:04:54.169110 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.168967    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-znp2q"]
Jul 02 19:04:54.171558 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:54.171534    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c122118_acd6_4901_ab11_74b2ca8b594a.slice/crio-829646a496829087e432daa3a96e799f47cde0314fc2d99aa2f95c936ec9a461 WatchSource:0}: Error finding container 829646a496829087e432daa3a96e799f47cde0314fc2d99aa2f95c936ec9a461: Status 404 returned error can't find the container with id 829646a496829087e432daa3a96e799f47cde0314fc2d99aa2f95c936ec9a461
Jul 02 19:04:54.671972 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.671930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmjh9" event={"ID":"b9018a08-409d-419f-aec9-99e32e873a2a","Type":"ContainerStarted","Data":"903fcdab58da891194c776036e05f47f2463710f0527b25908b087a32aad20c4"}
Jul 02 19:04:54.672432 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.672002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmjh9" event={"ID":"b9018a08-409d-419f-aec9-99e32e873a2a","Type":"ContainerStarted","Data":"03919f8ff589838992529fd527541517f145c4e0236621ff64ba77095c45cec7"}
Jul 02 19:04:54.672432 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.672063    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:04:54.673470 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.673446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znp2q" event={"ID":"5c122118-acd6-4901-ab11-74b2ca8b594a","Type":"ContainerStarted","Data":"829646a496829087e432daa3a96e799f47cde0314fc2d99aa2f95c936ec9a461"}
Jul 02 19:04:54.673856 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.673822    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"
Jul 02 19:04:54.678425 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.678404    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-4dvxh"
Jul 02 19:04:54.691993 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.691953    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zmjh9" podStartSLOduration=65.558520337 podStartE2EDuration="1m7.691938553s" totalImagesPullingTime="2.133418216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:54.691164826 +0000 UTC m=+107.996185362" watchObservedRunningTime="2026-07-02 19:04:54.691938553 +0000 UTC m=+107.996959085"
Jul 02 19:04:54.893993 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.893953    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"]
Jul 02 19:04:54.912600 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.912563    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"]
Jul 02 19:04:54.912763 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.912701    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:54.916128 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.915684    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:04:54.916128 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.915753    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:04:54.916128 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.915688    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 02 19:04:54.916405 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.916153    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:04:54.916917 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.916899    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 02 19:04:54.917191 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:54.917173    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jx7wt\""
Jul 02 19:04:55.070836 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.070800    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.071045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.070890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.071045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.070921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.071045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.070945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2wxk\" (UniqueName: \"kubernetes.io/projected/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-kube-api-access-c2wxk\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.172294 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.171571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2wxk\" (UniqueName: \"kubernetes.io/projected/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-kube-api-access-c2wxk\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.172294 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.171664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.172294 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.171731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.172294 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.171768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.173012 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.172788    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.176078 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.176029    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.177592 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.177546    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.188375 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.188344    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2wxk\" (UniqueName: \"kubernetes.io/projected/a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab-kube-api-access-c2wxk\") pod \"prometheus-operator-567f7b8b7c-66gtj\" (UID: \"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.224096 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.224057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"
Jul 02 19:04:55.398487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.398448    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj"]
Jul 02 19:04:55.401823 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:04:55.401791    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e41f10_2cc3_4d6c_a3bf_d11d6ac2e6ab.slice/crio-d650737cbb493c9b261e8f8cb333ac18757f884963946d9af9da2738d8acbcfc WatchSource:0}: Error finding container d650737cbb493c9b261e8f8cb333ac18757f884963946d9af9da2738d8acbcfc: Status 404 returned error can't find the container with id d650737cbb493c9b261e8f8cb333ac18757f884963946d9af9da2738d8acbcfc
Jul 02 19:04:55.679364 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:55.679268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj" event={"ID":"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab","Type":"ContainerStarted","Data":"d650737cbb493c9b261e8f8cb333ac18757f884963946d9af9da2738d8acbcfc"}
Jul 02 19:04:59.696456 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:59.696415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj" event={"ID":"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab","Type":"ContainerStarted","Data":"b8f3aae9ba57b1d4462d81af2b1484f365fa025b0e28120e7f458d25c7ba07cc"}
Jul 02 19:04:59.696961 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:59.696474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj" event={"ID":"a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab","Type":"ContainerStarted","Data":"1781ee82f466f2d49fe9ec7bbeb7637a1ec2ba951cf0b7966a014d7f79fd1745"}
Jul 02 19:04:59.698167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:59.698144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znp2q" event={"ID":"5c122118-acd6-4901-ab11-74b2ca8b594a","Type":"ContainerStarted","Data":"26b933ad52ae63f0ddfb389eec808e7fff3222f1e5591d4e81475f1c5ca8844c"}
Jul 02 19:04:59.698232 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:59.698192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znp2q" event={"ID":"5c122118-acd6-4901-ab11-74b2ca8b594a","Type":"ContainerStarted","Data":"cf49a3bac57bb4021a0637d1e56954b41a4e5963d1b7e8d63f0205cea4e4fe90"}
Jul 02 19:04:59.716158 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:04:59.716062    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-66gtj" podStartSLOduration=2.287918338 podStartE2EDuration="5.716046729s" totalImagesPullingTime="3.428128391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:04:59.715342258 +0000 UTC m=+113.020362794" watchObservedRunningTime="2026-07-02 19:04:59.716046729 +0000 UTC m=+113.021067264"
Jul 02 19:05:01.279706 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.279671    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tzc9h"]
Jul 02 19:05:01.284362 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.284327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.286825 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.286796    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:05:01.287055 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.287032    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:05:01.287214 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.287146    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:05:01.287861 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.287822    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gbb56\""
Jul 02 19:05:01.322199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-wtmp\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.322394 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.322394 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-metrics-client-ca\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.322394 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjr8\" (UniqueName: \"kubernetes.io/projected/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-kube-api-access-4gjr8\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.322394 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-textfile\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.322602 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-root\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.322602 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.322602 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-tls\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.322602 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.322545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-sys\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423078 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-root\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423078 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423074    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-tls\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-sys\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423167    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-root\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-wtmp\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423303    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-wtmp\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-metrics-client-ca\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423346 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjr8\" (UniqueName: \"kubernetes.io/projected/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-kube-api-access-4gjr8\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423771 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-textfile\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423771 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423530    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-sys\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423771 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423692    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-textfile\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.423947 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.423914    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-accelerators-collector-config\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.424047 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.424027    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-metrics-client-ca\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.426000 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.425975    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.426116 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.426059    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-node-exporter-tls\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.433635 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.433611    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjr8\" (UniqueName: \"kubernetes.io/projected/2f3c21c0-9a67-42a3-9a8b-e3b30b33c197-kube-api-access-4gjr8\") pod \"node-exporter-tzc9h\" (UID: \"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197\") " pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.603775 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:01.603693    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tzc9h"
Jul 02 19:05:01.983635 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:05:01.983605    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3c21c0_9a67_42a3_9a8b_e3b30b33c197.slice/crio-739841d02e90b13dad5b7b5fe398facf316cc78f64e9560631d2382145911dce WatchSource:0}: Error finding container 739841d02e90b13dad5b7b5fe398facf316cc78f64e9560631d2382145911dce: Status 404 returned error can't find the container with id 739841d02e90b13dad5b7b5fe398facf316cc78f64e9560631d2382145911dce
Jul 02 19:05:02.330738 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.330701    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:05:02.333492 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.333472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.336479 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336456    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 19:05:02.336599 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336510    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 19:05:02.336599 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336458    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 19:05:02.336599 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336584    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xxf4s\""
Jul 02 19:05:02.336756 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336603    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 19:05:02.336756 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 19:05:02.336756 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 19:05:02.336926 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336914    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 19:05:02.336981 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.336966    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 19:05:02.337081 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.337066    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 19:05:02.352085 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.352060    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:05:02.431721 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.431689    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.431721 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.431719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.431974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.431795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-out\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.431974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.431836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.431974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.431892    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.431974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.431918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.431974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.431948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.432220 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.432011    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.432220 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.432046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.432220 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.432079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.432220 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.432163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-web-config\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.432220 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.432213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.432389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.432237    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgsq\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-kube-api-access-qdgsq\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533043 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533242 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533242 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533242 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533242 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533242 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533242 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-web-config\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533549 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533549 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.533279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgsq\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-kube-api-access-qdgsq\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.533880 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:05:02.533829    2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 19:05:02.534029 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:05:02.533922    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls podName:c342a8dd-b072-4e95-a7d1-526554d3bf6a nodeName:}" failed. No retries permitted until 2026-07-02 19:05:03.033903917 +0000 UTC m=+116.338924438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a") : secret "alertmanager-main-tls" not found
Jul 02 19:05:02.534365 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.534340    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.534450 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.534434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.534505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.534470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.534560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.534513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-out\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.534560 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.534550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.535045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.534703    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.535156 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.535069    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.536441 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.536413    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-volume\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.536979 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.536918    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-web-config\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.537356 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.537328    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.538117 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.538075    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.538436 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.538388    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.538757 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.538679    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.538977 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.538951    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-out\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.539506 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.539474    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.541741 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.541697    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgsq\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-kube-api-access-qdgsq\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:02.711394 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.711300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzc9h" event={"ID":"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197","Type":"ContainerStarted","Data":"739841d02e90b13dad5b7b5fe398facf316cc78f64e9560631d2382145911dce"}
Jul 02 19:05:02.713786 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.713756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-znp2q" event={"ID":"5c122118-acd6-4901-ab11-74b2ca8b594a","Type":"ContainerStarted","Data":"ce00df73a156b6cdec00756331ab2aa58a5f4257fb092a936ae758e95e5dcdee"}
Jul 02 19:05:02.733714 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:02.733667    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-znp2q" podStartSLOduration=34.010734792 podStartE2EDuration="41.73365176s" totalImagesPullingTime="7.722916968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:04:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:02.731998239 +0000 UTC m=+116.037018776" watchObservedRunningTime="2026-07-02 19:05:02.73365176 +0000 UTC m=+116.038672295"
Jul 02 19:05:03.038399 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:03.038370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:03.040700 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:03.040676    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:03.245324 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:03.245243    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:05:03.386564 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:03.386536    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:05:03.387965 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:05:03.387937    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc342a8dd_b072_4e95_a7d1_526554d3bf6a.slice/crio-bcce8f8a0a9a202c85359c20ccd6c4e6a71e0a3d5922ad165a90d92f1eb1ea06 WatchSource:0}: Error finding container bcce8f8a0a9a202c85359c20ccd6c4e6a71e0a3d5922ad165a90d92f1eb1ea06: Status 404 returned error can't find the container with id bcce8f8a0a9a202c85359c20ccd6c4e6a71e0a3d5922ad165a90d92f1eb1ea06
Jul 02 19:05:03.722233 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:03.722197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerStarted","Data":"bcce8f8a0a9a202c85359c20ccd6c4e6a71e0a3d5922ad165a90d92f1eb1ea06"}
Jul 02 19:05:03.723653 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:03.723624    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f3c21c0-9a67-42a3-9a8b-e3b30b33c197" containerID="2661b196b0463252e01dc5eea883f4137787559574b1efaf80a8feb46e7fa4ab" exitCode=0
Jul 02 19:05:03.723798 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:03.723707    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzc9h" event={"ID":"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197","Type":"ContainerDied","Data":"2661b196b0463252e01dc5eea883f4137787559574b1efaf80a8feb46e7fa4ab"}
Jul 02 19:05:04.137856 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.137799    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-556f6f447c-j4d84"]
Jul 02 19:05:04.140595 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.140572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.143512 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.143295    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 19:05:04.143512 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.143328    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 19:05:04.143512 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.143296    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 19:05:04.143754 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.143623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7hzvs\""
Jul 02 19:05:04.144585 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.144562    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 19:05:04.144585 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.144576    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 19:05:04.145000 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.144914    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 19:05:04.145000 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.144933    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 19:05:04.148657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.148203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-trusted-ca-bundle\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.148657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.148253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-oauth-serving-cert\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.148657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.148296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-console-config\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.148657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.148338    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-oauth-config\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.148657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.148362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-service-ca\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.148657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.148407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz9qf\" (UniqueName: \"kubernetes.io/projected/11ef6c25-c645-47b2-8a14-3eac88b82113-kube-api-access-nz9qf\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.148657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.148439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-serving-cert\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.150708 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.150689    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 19:05:04.150987 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.150968    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556f6f447c-j4d84"]
Jul 02 19:05:04.249653 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.249622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-oauth-config\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.249653 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.249656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-service-ca\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.249903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.249686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz9qf\" (UniqueName: \"kubernetes.io/projected/11ef6c25-c645-47b2-8a14-3eac88b82113-kube-api-access-nz9qf\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.249903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.249707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-serving-cert\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.249903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.249780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-trusted-ca-bundle\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.249903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.249808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-oauth-serving-cert\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.249903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.249858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-console-config\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.250637 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.250605    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-service-ca\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.250969 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.250930    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-console-config\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.251142 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.251117    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-oauth-serving-cert\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.251304 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.251281    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-trusted-ca-bundle\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.252491 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.252470    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-oauth-config\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.252609 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.252595    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-serving-cert\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.257926 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.257900    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz9qf\" (UniqueName: \"kubernetes.io/projected/11ef6c25-c645-47b2-8a14-3eac88b82113-kube-api-access-nz9qf\") pod \"console-556f6f447c-j4d84\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") " pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.455011 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.454926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:04.617769 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.617743    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556f6f447c-j4d84"]
Jul 02 19:05:04.663779 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:05:04.663750    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ef6c25_c645_47b2_8a14_3eac88b82113.slice/crio-d19b40891c72eea7d49f5203ee46333e285d825ed3229069ced5c2a05c7d8e7a WatchSource:0}: Error finding container d19b40891c72eea7d49f5203ee46333e285d825ed3229069ced5c2a05c7d8e7a: Status 404 returned error can't find the container with id d19b40891c72eea7d49f5203ee46333e285d825ed3229069ced5c2a05c7d8e7a
Jul 02 19:05:04.681325 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.681300    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zmjh9"
Jul 02 19:05:04.729369 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.729277    2577 generic.go:356] "Generic (PLEG): container finished" podID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerID="70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590" exitCode=0
Jul 02 19:05:04.729515 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.729374    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerDied","Data":"70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590"}
Jul 02 19:05:04.731896 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.731870    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzc9h" event={"ID":"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197","Type":"ContainerStarted","Data":"94f212097d3078b4c0c7596d9d619bfc49eabcadd238e3a2bda121e67a3bf0bb"}
Jul 02 19:05:04.732034 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.731936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tzc9h" event={"ID":"2f3c21c0-9a67-42a3-9a8b-e3b30b33c197","Type":"ContainerStarted","Data":"f9e77b5b8f37992ccf1fb00439a39bb51eff00d5afac486e5ee7156f7940a77f"}
Jul 02 19:05:04.733215 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.733193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556f6f447c-j4d84" event={"ID":"11ef6c25-c645-47b2-8a14-3eac88b82113","Type":"ContainerStarted","Data":"d19b40891c72eea7d49f5203ee46333e285d825ed3229069ced5c2a05c7d8e7a"}
Jul 02 19:05:04.776823 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:04.776773    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tzc9h" podStartSLOduration=2.719517406 podStartE2EDuration="3.776756504s" totalImagesPullingTime="982.0129ms" totalInitContainerRuntime="75.226198ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:04.775380812 +0000 UTC m=+118.080401372" watchObservedRunningTime="2026-07-02 19:05:04.776756504 +0000 UTC m=+118.081777071"
Jul 02 19:05:05.570934 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.569501    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5979df99dc-cmfqr"]
Jul 02 19:05:05.572229 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.572198    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.574860 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.574699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 19:05:05.574860 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.574819    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 19:05:05.575050 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.574898    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 19:05:05.575879 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.575833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-57dmgqt7t9reu\""
Jul 02 19:05:05.576009 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.575903    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-k6gn9\""
Jul 02 19:05:05.576009 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.575871    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 19:05:05.580524 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.580220    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5979df99dc-cmfqr"]
Jul 02 19:05:05.663112 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.663078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-secret-metrics-server-tls\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.663298 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.663130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40d889b-05f8-4639-a404-fd29fad2cba8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.663298 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.663167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a40d889b-05f8-4639-a404-fd29fad2cba8-metrics-server-audit-profiles\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.663298 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.663185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-client-ca-bundle\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.663298 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.663214    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-secret-metrics-server-client-certs\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.663298 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.663267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a40d889b-05f8-4639-a404-fd29fad2cba8-audit-log\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.663515 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.663303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlkk7\" (UniqueName: \"kubernetes.io/projected/a40d889b-05f8-4639-a404-fd29fad2cba8-kube-api-access-jlkk7\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.764143 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.764044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlkk7\" (UniqueName: \"kubernetes.io/projected/a40d889b-05f8-4639-a404-fd29fad2cba8-kube-api-access-jlkk7\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.764300 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.764157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-secret-metrics-server-tls\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.764300 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.764235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40d889b-05f8-4639-a404-fd29fad2cba8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.764300 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.764277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a40d889b-05f8-4639-a404-fd29fad2cba8-metrics-server-audit-profiles\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.764421 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.764304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-client-ca-bundle\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.764421 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.764357    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-secret-metrics-server-client-certs\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.764421 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.764386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a40d889b-05f8-4639-a404-fd29fad2cba8-audit-log\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.765189 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.765156    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a40d889b-05f8-4639-a404-fd29fad2cba8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.765330 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.765285    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a40d889b-05f8-4639-a404-fd29fad2cba8-audit-log\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.765696 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.765535    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a40d889b-05f8-4639-a404-fd29fad2cba8-metrics-server-audit-profiles\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.767541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.767509    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-client-ca-bundle\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.767696 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.767666    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-secret-metrics-server-client-certs\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.767696 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.767685    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a40d889b-05f8-4639-a404-fd29fad2cba8-secret-metrics-server-tls\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.772595 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.772565    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlkk7\" (UniqueName: \"kubernetes.io/projected/a40d889b-05f8-4639-a404-fd29fad2cba8-kube-api-access-jlkk7\") pod \"metrics-server-5979df99dc-cmfqr\" (UID: \"a40d889b-05f8-4639-a404-fd29fad2cba8\") " pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:05.883286 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:05.883246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:06.043785 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:06.043751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5979df99dc-cmfqr"]
Jul 02 19:05:06.048404 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:05:06.048362    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40d889b_05f8_4639_a404_fd29fad2cba8.slice/crio-bbc63be9b7dd6b7c7d085b01889884187b4ce83de094fb64ad04230b383e93f9 WatchSource:0}: Error finding container bbc63be9b7dd6b7c7d085b01889884187b4ce83de094fb64ad04230b383e93f9: Status 404 returned error can't find the container with id bbc63be9b7dd6b7c7d085b01889884187b4ce83de094fb64ad04230b383e93f9
Jul 02 19:05:06.744120 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:06.744081    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr" event={"ID":"a40d889b-05f8-4639-a404-fd29fad2cba8","Type":"ContainerStarted","Data":"bbc63be9b7dd6b7c7d085b01889884187b4ce83de094fb64ad04230b383e93f9"}
Jul 02 19:05:07.519724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.519684    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:05:07.526918 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.525628    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.528941 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.528915    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 19:05:07.529110 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.528982    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 19:05:07.532771 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.531795    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 19:05:07.532771 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.532044    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 19:05:07.532771 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.532317    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 19:05:07.532771 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.532495    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 19:05:07.532771 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.532642    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 19:05:07.533115 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.533016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 19:05:07.533247 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.533228    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 19:05:07.533987 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.533454    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2qkrojkkurds7\""
Jul 02 19:05:07.533987 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.533527    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 19:05:07.544668 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.544637    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9zv2z\""
Jul 02 19:05:07.544806 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.544761    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 19:05:07.546678 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.546636    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 19:05:07.550247 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.550204    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 19:05:07.554584 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.554075    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 19:05:07.555573 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.555554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.582743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.582788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.582819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.582878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.582940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.582972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-config\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-config-out\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-web-config\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583104    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583289    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ks9s\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-kube-api-access-9ks9s\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.583794 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.583486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.684873 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.684822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685057 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.684882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-config\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685057 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.684933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-config-out\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685057 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.684957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-web-config\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685057 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685057 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685331 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685169    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685331 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685331 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685331 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ks9s\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-kube-api-access-9ks9s\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685331 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685331 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685482    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.685659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.686573 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.685782    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.688317 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.688291    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-config-out\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.688674 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.688654    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.689188 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.689163    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.689273 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.689197    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-web-config\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.689452 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.689431    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.689505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.689485    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.690533 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.690479    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.691390 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.691363    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-config\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.691954 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.691916    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.692134 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.692044    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.692286 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.692241    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.693093 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.693051    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.693556 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.693218    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.693556 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.693336    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.693556 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.693504    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.693757 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.693621    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.693757 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.693734    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.696200 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.696138    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.699185 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.699143    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ks9s\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-kube-api-access-9ks9s\") pod \"prometheus-k8s-0\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:07.857360 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:07.857276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:08.563795 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.563762    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:05:08.754037 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.754001    2577 generic.go:356] "Generic (PLEG): container finished" podID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerID="78fbbe2d78af6465d3c35e894588b88ede30a3574c1c445f94dda91cd576d0ad" exitCode=0
Jul 02 19:05:08.754181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.754084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerDied","Data":"78fbbe2d78af6465d3c35e894588b88ede30a3574c1c445f94dda91cd576d0ad"}
Jul 02 19:05:08.754181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.754163    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerStarted","Data":"675b5a7b7b592b7ce3c3ef52e83065d60d19928d405612c46af10381e40d9c4b"}
Jul 02 19:05:08.756296 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.756271    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556f6f447c-j4d84" event={"ID":"11ef6c25-c645-47b2-8a14-3eac88b82113","Type":"ContainerStarted","Data":"3b63d6210c8088de950d697993c47584bca70d7f5dfcea7acdadf4779bf58c0e"}
Jul 02 19:05:08.758148 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.758103    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr" event={"ID":"a40d889b-05f8-4639-a404-fd29fad2cba8","Type":"ContainerStarted","Data":"2355b99f4b0d2037726b095ab09d5a4e387496ccefbb289a38297544f8543e97"}
Jul 02 19:05:08.761301 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.761278    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerStarted","Data":"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61"}
Jul 02 19:05:08.761426 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.761346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerStarted","Data":"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c"}
Jul 02 19:05:08.761426 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.761388    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerStarted","Data":"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38"}
Jul 02 19:05:08.800654 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.800571    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr" podStartSLOduration=1.40411796 podStartE2EDuration="3.800548729s" totalImagesPullingTime="2.396430769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:08.799519014 +0000 UTC m=+122.104539624" watchObservedRunningTime="2026-07-02 19:05:08.800548729 +0000 UTC m=+122.105569267"
Jul 02 19:05:08.818926 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:08.818237    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-556f6f447c-j4d84" podStartSLOduration=1.073412542 podStartE2EDuration="4.818214826s" totalImagesPullingTime="3.744802284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:08.816682884 +0000 UTC m=+122.121703420" watchObservedRunningTime="2026-07-02 19:05:08.818214826 +0000 UTC m=+122.123235362"
Jul 02 19:05:09.774946 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:09.774901    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerStarted","Data":"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e"}
Jul 02 19:05:09.775426 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:09.775002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerStarted","Data":"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8"}
Jul 02 19:05:10.550037 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:10.549998    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c46f86cf8-65ndd"]
Jul 02 19:05:10.554551 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:10.554525    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:05:10.783752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:10.783711    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerStarted","Data":"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6"}
Jul 02 19:05:10.813015 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:10.812910    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.947129719 podStartE2EDuration="8.812891572s" totalImagesPullingTime="5.850116362s" totalInitContainerRuntime="15.645491ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:10.810896805 +0000 UTC m=+124.115917341" watchObservedRunningTime="2026-07-02 19:05:10.812891572 +0000 UTC m=+124.117912107"
Jul 02 19:05:13.801420 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:13.801382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerStarted","Data":"a0213bf22be4e130acd558aa5266133e8cff80fdb57f83266e20adb091a0da72"}
Jul 02 19:05:13.801884 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:13.801456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerStarted","Data":"0e4347ae24920416c7c855e9ad461544caaf85d864b4d4cba3911b27059a110c"}
Jul 02 19:05:14.455659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:14.455619    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:14.455980 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:14.455695    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:14.461480 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:14.461455    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:14.809321 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:14.809296    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:15.816967 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:15.816927    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerStarted","Data":"0de19bc8d429e2903910ef26d973546f9e5dd878e5aa24e35eb25a7ca0241298"}
Jul 02 19:05:15.817421 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:15.817008    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerStarted","Data":"38114f9a31f0a4a05e5727b82dc30ed613489203f8941fcbdfd89c57a4fffba1"}
Jul 02 19:05:15.817421 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:15.817045    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerStarted","Data":"ab61b9429176b01c519cd731d9dda650c6dcced3c0fd0cafdd4ba568094ab9ff"}
Jul 02 19:05:15.817421 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:15.817080    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerStarted","Data":"32c15d8b68b162f6f3953300db155553c1fbac72d4be34c5ebcf3e610d0e819b"}
Jul 02 19:05:15.851312 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:15.851261    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.945330647 podStartE2EDuration="8.851245403s" totalImagesPullingTime="5.874680468s" totalInitContainerRuntime="31.234288ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:05:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:15.848771688 +0000 UTC m=+129.153792239" watchObservedRunningTime="2026-07-02 19:05:15.851245403 +0000 UTC m=+129.156265939"
Jul 02 19:05:17.084320 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:17.084288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:05:17.086804 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:17.086784    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a134df9-1516-4edc-a2a5-fa06815a4339-metrics-certs\") pod \"network-metrics-daemon-bfvmt\" (UID: \"6a134df9-1516-4edc-a2a5-fa06815a4339\") " pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:05:17.356737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:17.356623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9s6wg\""
Jul 02 19:05:17.364001 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:17.363965    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfvmt"
Jul 02 19:05:17.504546 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:17.504518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bfvmt"]
Jul 02 19:05:17.507371 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:05:17.507343    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a134df9_1516_4edc_a2a5_fa06815a4339.slice/crio-859355aa426c650978e70aac290a57fec9d5545c1d2b42cb7f7ede3586bff47d WatchSource:0}: Error finding container 859355aa426c650978e70aac290a57fec9d5545c1d2b42cb7f7ede3586bff47d: Status 404 returned error can't find the container with id 859355aa426c650978e70aac290a57fec9d5545c1d2b42cb7f7ede3586bff47d
Jul 02 19:05:17.824851 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:17.824811    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfvmt" event={"ID":"6a134df9-1516-4edc-a2a5-fa06815a4339","Type":"ContainerStarted","Data":"859355aa426c650978e70aac290a57fec9d5545c1d2b42cb7f7ede3586bff47d"}
Jul 02 19:05:17.858175 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:17.858127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:05:18.831566 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:18.831533    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfvmt" event={"ID":"6a134df9-1516-4edc-a2a5-fa06815a4339","Type":"ContainerStarted","Data":"a7e3994ce920fd4c14c4661292ea46bf6d40ab51f338741c6dcac2a25f96510c"}
Jul 02 19:05:19.837685 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:19.837647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfvmt" event={"ID":"6a134df9-1516-4edc-a2a5-fa06815a4339","Type":"ContainerStarted","Data":"f00a590566cec81ac8fa847f6509cbb050f414ee27ca940c6741061d3567f949"}
Jul 02 19:05:19.856506 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:19.856440    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bfvmt" podStartSLOduration=131.666292068 podStartE2EDuration="2m12.856409383s" totalImagesPullingTime="1.190117315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:05:19.855772055 +0000 UTC m=+133.160792592" watchObservedRunningTime="2026-07-02 19:05:19.856409383 +0000 UTC m=+133.161429920"
Jul 02 19:05:25.883493 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:25.883449    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:25.883921 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:25.883518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:30.782202 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:30.782164    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556f6f447c-j4d84"]
Jul 02 19:05:35.570729 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.570683    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd" podUID="4993a986-db9e-489c-b790-16a1bc2b6c8c" containerName="registry" containerID="cri-o://f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911" gracePeriod=30
Jul 02 19:05:35.823275 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.823215    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:05:35.900105 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.900072    2577 generic.go:356] "Generic (PLEG): container finished" podID="cafad4ac-c0f8-4111-b661-b62155388fcb" containerID="b39d102d07d7abe0f21de3fac2e1272f1173cb13c3dd1f3bbb2377cdf3dd0b48" exitCode=0
Jul 02 19:05:35.900302 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.900157    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl" event={"ID":"cafad4ac-c0f8-4111-b661-b62155388fcb","Type":"ContainerDied","Data":"b39d102d07d7abe0f21de3fac2e1272f1173cb13c3dd1f3bbb2377cdf3dd0b48"}
Jul 02 19:05:35.900513 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.900497    2577 scope.go:117] "RemoveContainer" containerID="b39d102d07d7abe0f21de3fac2e1272f1173cb13c3dd1f3bbb2377cdf3dd0b48"
Jul 02 19:05:35.901477 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.901457    2577 generic.go:356] "Generic (PLEG): container finished" podID="4993a986-db9e-489c-b790-16a1bc2b6c8c" containerID="f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911" exitCode=0
Jul 02 19:05:35.901578 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.901485    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd" event={"ID":"4993a986-db9e-489c-b790-16a1bc2b6c8c","Type":"ContainerDied","Data":"f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911"}
Jul 02 19:05:35.901578 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.901502    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd"
Jul 02 19:05:35.901578 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.901544    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c46f86cf8-65ndd" event={"ID":"4993a986-db9e-489c-b790-16a1bc2b6c8c","Type":"ContainerDied","Data":"78f77c48f741911a2751dc351d30ad53dec84ddc1c3354f69e158a55063ddcfe"}
Jul 02 19:05:35.902054 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.902034    2577 scope.go:117] "RemoveContainer" containerID="f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911"
Jul 02 19:05:35.910781 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.910764    2577 scope.go:117] "RemoveContainer" containerID="f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911"
Jul 02 19:05:35.911168 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:05:35.911143    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911\": container with ID starting with f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911 not found: ID does not exist" containerID="f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911"
Jul 02 19:05:35.911256 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.911174    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911"} err="failed to get container status \"f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911\": rpc error: code = NotFound desc = could not find container \"f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911\": container with ID starting with f8e605f1d6660fcc6b1c9c2bc2b8e8808b809ed00066d4109b919737f79cc911 not found: ID does not exist"
Jul 02 19:05:35.949590 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.949562    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-installation-pull-secrets\") pod \"4993a986-db9e-489c-b790-16a1bc2b6c8c\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") "
Jul 02 19:05:35.949958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.949620    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-bound-sa-token\") pod \"4993a986-db9e-489c-b790-16a1bc2b6c8c\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") "
Jul 02 19:05:35.949958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.949655    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-image-registry-private-configuration\") pod \"4993a986-db9e-489c-b790-16a1bc2b6c8c\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") "
Jul 02 19:05:35.949958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.949677    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") pod \"4993a986-db9e-489c-b790-16a1bc2b6c8c\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") "
Jul 02 19:05:35.949958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.949702    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-certificates\") pod \"4993a986-db9e-489c-b790-16a1bc2b6c8c\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") "
Jul 02 19:05:35.949958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.949743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4993a986-db9e-489c-b790-16a1bc2b6c8c-ca-trust-extracted\") pod \"4993a986-db9e-489c-b790-16a1bc2b6c8c\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") "
Jul 02 19:05:35.949958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.949810    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-trusted-ca\") pod \"4993a986-db9e-489c-b790-16a1bc2b6c8c\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") "
Jul 02 19:05:35.949958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.949890    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n6xf\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-kube-api-access-8n6xf\") pod \"4993a986-db9e-489c-b790-16a1bc2b6c8c\" (UID: \"4993a986-db9e-489c-b790-16a1bc2b6c8c\") "
Jul 02 19:05:35.951097 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.950521    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4993a986-db9e-489c-b790-16a1bc2b6c8c" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:05:35.951097 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.950995    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4993a986-db9e-489c-b790-16a1bc2b6c8c" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:05:35.953219 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.953182    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-kube-api-access-8n6xf" (OuterVolumeSpecName: "kube-api-access-8n6xf") pod "4993a986-db9e-489c-b790-16a1bc2b6c8c" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c"). InnerVolumeSpecName "kube-api-access-8n6xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:05:35.953219 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.953191    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4993a986-db9e-489c-b790-16a1bc2b6c8c" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:05:35.953413 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.953380    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4993a986-db9e-489c-b790-16a1bc2b6c8c" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:05:35.953638 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.953613    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4993a986-db9e-489c-b790-16a1bc2b6c8c" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:05:35.953712 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.953682    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4993a986-db9e-489c-b790-16a1bc2b6c8c" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:05:35.960866 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:35.960804    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4993a986-db9e-489c-b790-16a1bc2b6c8c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4993a986-db9e-489c-b790-16a1bc2b6c8c" (UID: "4993a986-db9e-489c-b790-16a1bc2b6c8c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:05:36.051135 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.051089    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n6xf\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-kube-api-access-8n6xf\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:36.051135 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.051129    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-installation-pull-secrets\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:36.051135 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.051145    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-bound-sa-token\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:36.051389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.051161    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4993a986-db9e-489c-b790-16a1bc2b6c8c-image-registry-private-configuration\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:36.051389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.051184    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-tls\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:36.051389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.051197    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-registry-certificates\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:36.051389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.051209    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4993a986-db9e-489c-b790-16a1bc2b6c8c-ca-trust-extracted\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:36.051389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.051222    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4993a986-db9e-489c-b790-16a1bc2b6c8c-trusted-ca\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:36.224739 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.224707    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c46f86cf8-65ndd"]
Jul 02 19:05:36.230508 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.230480    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c46f86cf8-65ndd"]
Jul 02 19:05:36.907813 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:36.907723    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-9frwl" event={"ID":"cafad4ac-c0f8-4111-b661-b62155388fcb","Type":"ContainerStarted","Data":"24f815cbae5305ba28ec6751aed539347c0fe97d9aa5da2ddd874b1c1dc67212"}
Jul 02 19:05:37.238227 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:37.238146    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4993a986-db9e-489c-b790-16a1bc2b6c8c" path="/var/lib/kubelet/pods/4993a986-db9e-489c-b790-16a1bc2b6c8c/volumes"
Jul 02 19:05:41.931405 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:41.931370    2577 generic.go:356] "Generic (PLEG): container finished" podID="25d5e7bb-b846-431c-8dbe-28dc4951a632" containerID="f62c4cbbfb23cb021d3bc0369faf52df06a85f6e8fa294cee4556ac127022e88" exitCode=0
Jul 02 19:05:41.931932 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:41.931449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9" event={"ID":"25d5e7bb-b846-431c-8dbe-28dc4951a632","Type":"ContainerDied","Data":"f62c4cbbfb23cb021d3bc0369faf52df06a85f6e8fa294cee4556ac127022e88"}
Jul 02 19:05:41.931932 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:41.931864    2577 scope.go:117] "RemoveContainer" containerID="f62c4cbbfb23cb021d3bc0369faf52df06a85f6e8fa294cee4556ac127022e88"
Jul 02 19:05:42.847049 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:42.847015    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cphb5_1fda4583-47ac-4729-8968-08d0f1c9473c/serve-healthcheck-canary/0.log"
Jul 02 19:05:42.937964 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:42.937923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qg7s9" event={"ID":"25d5e7bb-b846-431c-8dbe-28dc4951a632","Type":"ContainerStarted","Data":"bdac84e938f4d49100fc4cf187e16d12599a6f859b97266b2892816e98a6de13"}
Jul 02 19:05:45.888749 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:45.888718    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:45.892662 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:45.892638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5979df99dc-cmfqr"
Jul 02 19:05:55.803320 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:55.803257    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-556f6f447c-j4d84" podUID="11ef6c25-c645-47b2-8a14-3eac88b82113" containerName="console" containerID="cri-o://3b63d6210c8088de950d697993c47584bca70d7f5dfcea7acdadf4779bf58c0e" gracePeriod=15
Jul 02 19:05:55.994666 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:55.994611    2577 generic.go:356] "Generic (PLEG): container finished" podID="11ef6c25-c645-47b2-8a14-3eac88b82113" containerID="3b63d6210c8088de950d697993c47584bca70d7f5dfcea7acdadf4779bf58c0e" exitCode=0
Jul 02 19:05:55.994812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:55.994677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556f6f447c-j4d84" event={"ID":"11ef6c25-c645-47b2-8a14-3eac88b82113","Type":"ContainerDied","Data":"3b63d6210c8088de950d697993c47584bca70d7f5dfcea7acdadf4779bf58c0e"}
Jul 02 19:05:56.090661 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.090289    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:56.127876 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.127821    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz9qf\" (UniqueName: \"kubernetes.io/projected/11ef6c25-c645-47b2-8a14-3eac88b82113-kube-api-access-nz9qf\") pod \"11ef6c25-c645-47b2-8a14-3eac88b82113\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") "
Jul 02 19:05:56.128049 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.127891    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-oauth-serving-cert\") pod \"11ef6c25-c645-47b2-8a14-3eac88b82113\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") "
Jul 02 19:05:56.128049 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.127960    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-serving-cert\") pod \"11ef6c25-c645-47b2-8a14-3eac88b82113\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") "
Jul 02 19:05:56.128049 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.127992    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-trusted-ca-bundle\") pod \"11ef6c25-c645-47b2-8a14-3eac88b82113\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") "
Jul 02 19:05:56.128213 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.128067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-service-ca\") pod \"11ef6c25-c645-47b2-8a14-3eac88b82113\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") "
Jul 02 19:05:56.128213 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.128101    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-oauth-config\") pod \"11ef6c25-c645-47b2-8a14-3eac88b82113\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") "
Jul 02 19:05:56.128213 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.128147    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-console-config\") pod \"11ef6c25-c645-47b2-8a14-3eac88b82113\" (UID: \"11ef6c25-c645-47b2-8a14-3eac88b82113\") "
Jul 02 19:05:56.128362 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.128318    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11ef6c25-c645-47b2-8a14-3eac88b82113" (UID: "11ef6c25-c645-47b2-8a14-3eac88b82113"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:05:56.128661 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.128419    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-oauth-serving-cert\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:56.128661 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.128570    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-service-ca" (OuterVolumeSpecName: "service-ca") pod "11ef6c25-c645-47b2-8a14-3eac88b82113" (UID: "11ef6c25-c645-47b2-8a14-3eac88b82113"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:05:56.128905 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.128880    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11ef6c25-c645-47b2-8a14-3eac88b82113" (UID: "11ef6c25-c645-47b2-8a14-3eac88b82113"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:05:56.129160 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.129137    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-console-config" (OuterVolumeSpecName: "console-config") pod "11ef6c25-c645-47b2-8a14-3eac88b82113" (UID: "11ef6c25-c645-47b2-8a14-3eac88b82113"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:05:56.131039 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.130890    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11ef6c25-c645-47b2-8a14-3eac88b82113-kube-api-access-nz9qf" (OuterVolumeSpecName: "kube-api-access-nz9qf") pod "11ef6c25-c645-47b2-8a14-3eac88b82113" (UID: "11ef6c25-c645-47b2-8a14-3eac88b82113"). InnerVolumeSpecName "kube-api-access-nz9qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:05:56.131039 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.131033    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11ef6c25-c645-47b2-8a14-3eac88b82113" (UID: "11ef6c25-c645-47b2-8a14-3eac88b82113"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:05:56.131184 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.131101    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11ef6c25-c645-47b2-8a14-3eac88b82113" (UID: "11ef6c25-c645-47b2-8a14-3eac88b82113"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:05:56.229709 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.229666    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-service-ca\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:56.229709 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.229700    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-oauth-config\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:56.229709 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.229709    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-console-config\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:56.230082 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.229718    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz9qf\" (UniqueName: \"kubernetes.io/projected/11ef6c25-c645-47b2-8a14-3eac88b82113-kube-api-access-nz9qf\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:56.230082 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.229737    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11ef6c25-c645-47b2-8a14-3eac88b82113-console-serving-cert\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:56.230082 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:56.229746    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11ef6c25-c645-47b2-8a14-3eac88b82113-trusted-ca-bundle\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:05:57.001304 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:57.001270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556f6f447c-j4d84" event={"ID":"11ef6c25-c645-47b2-8a14-3eac88b82113","Type":"ContainerDied","Data":"d19b40891c72eea7d49f5203ee46333e285d825ed3229069ced5c2a05c7d8e7a"}
Jul 02 19:05:57.001752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:57.001334    2577 scope.go:117] "RemoveContainer" containerID="3b63d6210c8088de950d697993c47584bca70d7f5dfcea7acdadf4779bf58c0e"
Jul 02 19:05:57.001752 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:57.001333    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556f6f447c-j4d84"
Jul 02 19:05:57.025661 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:57.025617    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556f6f447c-j4d84"]
Jul 02 19:05:57.029987 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:57.029956    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-556f6f447c-j4d84"]
Jul 02 19:05:57.237184 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:05:57.237148    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11ef6c25-c645-47b2-8a14-3eac88b82113" path="/var/lib/kubelet/pods/11ef6c25-c645-47b2-8a14-3eac88b82113/volumes"
Jul 02 19:06:07.858041 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:07.858002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:07.879060 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:07.879032    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:08.062614 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:08.062586    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:21.666020 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:21.665981    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:06:21.667036 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:21.666975    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="alertmanager" containerID="cri-o://582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38" gracePeriod=120
Jul 02 19:06:21.667269 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:21.667229    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy-metric" containerID="cri-o://32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e" gracePeriod=120
Jul 02 19:06:21.667383 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:21.667330    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy" containerID="cri-o://d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8" gracePeriod=120
Jul 02 19:06:21.667506 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:21.667268    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy-web" containerID="cri-o://3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61" gracePeriod=120
Jul 02 19:06:21.667506 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:21.667329    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="prom-label-proxy" containerID="cri-o://51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6" gracePeriod=120
Jul 02 19:06:21.667680 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:21.667599    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="config-reloader" containerID="cri-o://3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c" gracePeriod=120
Jul 02 19:06:22.103565 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.103529    2577 generic.go:356] "Generic (PLEG): container finished" podID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerID="51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6" exitCode=0
Jul 02 19:06:22.103565 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.103554    2577 generic.go:356] "Generic (PLEG): container finished" podID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerID="d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8" exitCode=0
Jul 02 19:06:22.103565 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.103561    2577 generic.go:356] "Generic (PLEG): container finished" podID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerID="3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c" exitCode=0
Jul 02 19:06:22.103565 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.103567    2577 generic.go:356] "Generic (PLEG): container finished" podID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerID="582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38" exitCode=0
Jul 02 19:06:22.103826 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.103586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerDied","Data":"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6"}
Jul 02 19:06:22.103826 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.103639    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerDied","Data":"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8"}
Jul 02 19:06:22.103826 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.103663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerDied","Data":"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c"}
Jul 02 19:06:22.103826 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.103686    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerDied","Data":"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38"}
Jul 02 19:06:22.923492 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:22.923458    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:23.070398 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070354    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-main-db\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070398 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070404    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070663 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070431    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-web\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070663 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070466    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070663 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070497    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070663 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070522    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-volume\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070663 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070552    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-cluster-tls-config\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070663 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070594    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-trusted-ca-bundle\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070663 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070622    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-metrics-client-ca\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.070663 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070647    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-web-config\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.071101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070670    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdgsq\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-kube-api-access-qdgsq\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.071101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070694    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-tls-assets\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.071101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070720    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-out\") pod \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\" (UID: \"c342a8dd-b072-4e95-a7d1-526554d3bf6a\") "
Jul 02 19:06:23.071101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070754    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:06:23.071101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.070988    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-main-db\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.071101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.071026    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:23.071777 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.071737    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:23.073564 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.073518    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:23.074163 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.074126    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:23.074258 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.074206    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-volume" (OuterVolumeSpecName: "config-volume") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:23.074950 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.074920    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-kube-api-access-qdgsq" (OuterVolumeSpecName: "kube-api-access-qdgsq") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "kube-api-access-qdgsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:06:23.074950 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.074932    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:23.075106 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.075086    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-out" (OuterVolumeSpecName: "config-out") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:06:23.075337 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.075318    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:23.076035 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.076017    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:06:23.078747 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.078721    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:23.084891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.084866    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-web-config" (OuterVolumeSpecName: "web-config") pod "c342a8dd-b072-4e95-a7d1-526554d3bf6a" (UID: "c342a8dd-b072-4e95-a7d1-526554d3bf6a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:23.110612 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.110576    2577 generic.go:356] "Generic (PLEG): container finished" podID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerID="32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e" exitCode=0
Jul 02 19:06:23.110612 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.110604    2577 generic.go:356] "Generic (PLEG): container finished" podID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerID="3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61" exitCode=0
Jul 02 19:06:23.110797 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.110654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerDied","Data":"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e"}
Jul 02 19:06:23.110797 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.110667    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:06:23.110797 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.110751    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerDied","Data":"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61"}
Jul 02 19:06:23.110797 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.110780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c342a8dd-b072-4e95-a7d1-526554d3bf6a","Type":"ContainerDied","Data":"bcce8f8a0a9a202c85359c20ccd6c4e6a71e0a3d5922ad165a90d92f1eb1ea06"}
Jul 02 19:06:23.110977 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.110810    2577 scope.go:117] "RemoveContainer" containerID="51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6"
Jul 02 19:06:23.119479 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.119456    2577 scope.go:117] "RemoveContainer" containerID="32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e"
Jul 02 19:06:23.127086 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.127068    2577 scope.go:117] "RemoveContainer" containerID="d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8"
Jul 02 19:06:23.135552 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.135527    2577 scope.go:117] "RemoveContainer" containerID="3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61"
Jul 02 19:06:23.137061 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.137032    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:06:23.144031 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.144005    2577 scope.go:117] "RemoveContainer" containerID="3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c"
Jul 02 19:06:23.145596 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.145576    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:06:23.152372 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.152351    2577 scope.go:117] "RemoveContainer" containerID="582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38"
Jul 02 19:06:23.160407 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.160387    2577 scope.go:117] "RemoveContainer" containerID="70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590"
Jul 02 19:06:23.168348 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.168321    2577 scope.go:117] "RemoveContainer" containerID="51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6"
Jul 02 19:06:23.168708 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:06:23.168681    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6\": container with ID starting with 51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6 not found: ID does not exist" containerID="51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6"
Jul 02 19:06:23.168761 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.168720    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6"} err="failed to get container status \"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6\": rpc error: code = NotFound desc = could not find container \"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6\": container with ID starting with 51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6 not found: ID does not exist"
Jul 02 19:06:23.168761 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.168742    2577 scope.go:117] "RemoveContainer" containerID="32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e"
Jul 02 19:06:23.169023 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:06:23.169002    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e\": container with ID starting with 32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e not found: ID does not exist" containerID="32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e"
Jul 02 19:06:23.169092 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.169032    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e"} err="failed to get container status \"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e\": rpc error: code = NotFound desc = could not find container \"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e\": container with ID starting with 32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e not found: ID does not exist"
Jul 02 19:06:23.169092 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.169059    2577 scope.go:117] "RemoveContainer" containerID="d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8"
Jul 02 19:06:23.169333 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:06:23.169316    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8\": container with ID starting with d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8 not found: ID does not exist" containerID="d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8"
Jul 02 19:06:23.169373 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.169339    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8"} err="failed to get container status \"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8\": rpc error: code = NotFound desc = could not find container \"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8\": container with ID starting with d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8 not found: ID does not exist"
Jul 02 19:06:23.169373 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.169354    2577 scope.go:117] "RemoveContainer" containerID="3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61"
Jul 02 19:06:23.169607 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:06:23.169590    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61\": container with ID starting with 3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61 not found: ID does not exist" containerID="3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61"
Jul 02 19:06:23.169690 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.169613    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61"} err="failed to get container status \"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61\": rpc error: code = NotFound desc = could not find container \"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61\": container with ID starting with 3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61 not found: ID does not exist"
Jul 02 19:06:23.169690 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.169633    2577 scope.go:117] "RemoveContainer" containerID="3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c"
Jul 02 19:06:23.169899 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:06:23.169832    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c\": container with ID starting with 3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c not found: ID does not exist" containerID="3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c"
Jul 02 19:06:23.169969 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.169911    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c"} err="failed to get container status \"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c\": rpc error: code = NotFound desc = could not find container \"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c\": container with ID starting with 3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c not found: ID does not exist"
Jul 02 19:06:23.169969 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.169931    2577 scope.go:117] "RemoveContainer" containerID="582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38"
Jul 02 19:06:23.170161 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:06:23.170143    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38\": container with ID starting with 582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38 not found: ID does not exist" containerID="582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38"
Jul 02 19:06:23.170205 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170167    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38"} err="failed to get container status \"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38\": rpc error: code = NotFound desc = could not find container \"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38\": container with ID starting with 582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38 not found: ID does not exist"
Jul 02 19:06:23.170205 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170181    2577 scope.go:117] "RemoveContainer" containerID="70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590"
Jul 02 19:06:23.170383 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:06:23.170368    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590\": container with ID starting with 70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590 not found: ID does not exist" containerID="70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590"
Jul 02 19:06:23.170430 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170385    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590"} err="failed to get container status \"70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590\": rpc error: code = NotFound desc = could not find container \"70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590\": container with ID starting with 70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590 not found: ID does not exist"
Jul 02 19:06:23.170430 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170397    2577 scope.go:117] "RemoveContainer" containerID="51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6"
Jul 02 19:06:23.170632 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170616    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6"} err="failed to get container status \"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6\": rpc error: code = NotFound desc = could not find container \"51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6\": container with ID starting with 51e8ddeadf9ed7a5d4791e17599007a6836c9dd682b2c941c1291b5ba08809c6 not found: ID does not exist"
Jul 02 19:06:23.170686 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170633    2577 scope.go:117] "RemoveContainer" containerID="32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e"
Jul 02 19:06:23.170789 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170774    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e"} err="failed to get container status \"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e\": rpc error: code = NotFound desc = could not find container \"32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e\": container with ID starting with 32828983c3e38991cc6e0a63bcefab286f87c82e165948cf61ec68b31a1eaa9e not found: ID does not exist"
Jul 02 19:06:23.170829 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170789    2577 scope.go:117] "RemoveContainer" containerID="d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8"
Jul 02 19:06:23.171006 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.170986    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8"} err="failed to get container status \"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8\": rpc error: code = NotFound desc = could not find container \"d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8\": container with ID starting with d1bca317f8267d76effa1bfe1cd61c8771e2c5f200aa9c8953204230b9ade7c8 not found: ID does not exist"
Jul 02 19:06:23.171058 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171008    2577 scope.go:117] "RemoveContainer" containerID="3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61"
Jul 02 19:06:23.171234 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171212    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61"} err="failed to get container status \"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61\": rpc error: code = NotFound desc = could not find container \"3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61\": container with ID starting with 3fca864213a80841d298d9ef9ff11d09a7d82d2ea7043cc912c0b0671da7da61 not found: ID does not exist"
Jul 02 19:06:23.171278 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171236    2577 scope.go:117] "RemoveContainer" containerID="3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c"
Jul 02 19:06:23.171448 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171431    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171453    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171452    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c"} err="failed to get container status \"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c\": rpc error: code = NotFound desc = could not find container \"3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c\": container with ID starting with 3ee315c0fd692ab6d7bac7352cd2d8208b9060bcae70dc72cbfe16f978251e9c not found: ID does not exist"
Jul 02 19:06:23.171487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171464    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-main-tls\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171470    2577 scope.go:117] "RemoveContainer" containerID="582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38"
Jul 02 19:06:23.171487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171474    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-volume\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171486    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-cluster-tls-config\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171497    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171510    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c342a8dd-b072-4e95-a7d1-526554d3bf6a-metrics-client-ca\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171519    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-web-config\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171526    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdgsq\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-kube-api-access-qdgsq\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171554    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c342a8dd-b072-4e95-a7d1-526554d3bf6a-tls-assets\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171567    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c342a8dd-b072-4e95-a7d1-526554d3bf6a-config-out\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171578    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c342a8dd-b072-4e95-a7d1-526554d3bf6a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171642    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38"} err="failed to get container status \"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38\": rpc error: code = NotFound desc = could not find container \"582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38\": container with ID starting with 582fc50c9a4ef718baf86d16873c788f9110f8d4da27140c94fd3f3e54123e38 not found: ID does not exist"
Jul 02 19:06:23.171679 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171661    2577 scope.go:117] "RemoveContainer" containerID="70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590"
Jul 02 19:06:23.171988 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.171881    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590"} err="failed to get container status \"70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590\": rpc error: code = NotFound desc = could not find container \"70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590\": container with ID starting with 70e45171b5a7f7d2b6bb520a35b564e489783fb1d00593fe535d6bcec3b98590 not found: ID does not exist"
Jul 02 19:06:23.236765 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:23.236734    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" path="/var/lib/kubelet/pods/c342a8dd-b072-4e95-a7d1-526554d3bf6a/volumes"
Jul 02 19:06:25.907404 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:25.907355    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:06:25.907825 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:25.907654    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="prometheus" containerID="cri-o://0e4347ae24920416c7c855e9ad461544caaf85d864b4d4cba3911b27059a110c" gracePeriod=600
Jul 02 19:06:25.907825 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:25.907691    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="thanos-sidecar" containerID="cri-o://32c15d8b68b162f6f3953300db155553c1fbac72d4be34c5ebcf3e610d0e819b" gracePeriod=600
Jul 02 19:06:25.907825 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:25.907715    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy-web" containerID="cri-o://ab61b9429176b01c519cd731d9dda650c6dcced3c0fd0cafdd4ba568094ab9ff" gracePeriod=600
Jul 02 19:06:25.907825 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:25.907751    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="config-reloader" containerID="cri-o://a0213bf22be4e130acd558aa5266133e8cff80fdb57f83266e20adb091a0da72" gracePeriod=600
Jul 02 19:06:25.907825 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:25.907754    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0de19bc8d429e2903910ef26d973546f9e5dd878e5aa24e35eb25a7ca0241298" gracePeriod=600
Jul 02 19:06:25.908089 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:25.907866    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy" containerID="cri-o://38114f9a31f0a4a05e5727b82dc30ed613489203f8941fcbdfd89c57a4fffba1" gracePeriod=600
Jul 02 19:06:26.129904 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.129869    2577 generic.go:356] "Generic (PLEG): container finished" podID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerID="0de19bc8d429e2903910ef26d973546f9e5dd878e5aa24e35eb25a7ca0241298" exitCode=0
Jul 02 19:06:26.129904 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.129895    2577 generic.go:356] "Generic (PLEG): container finished" podID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerID="38114f9a31f0a4a05e5727b82dc30ed613489203f8941fcbdfd89c57a4fffba1" exitCode=0
Jul 02 19:06:26.129904 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.129903    2577 generic.go:356] "Generic (PLEG): container finished" podID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerID="ab61b9429176b01c519cd731d9dda650c6dcced3c0fd0cafdd4ba568094ab9ff" exitCode=0
Jul 02 19:06:26.129904 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.129909    2577 generic.go:356] "Generic (PLEG): container finished" podID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerID="32c15d8b68b162f6f3953300db155553c1fbac72d4be34c5ebcf3e610d0e819b" exitCode=0
Jul 02 19:06:26.129904 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.129914    2577 generic.go:356] "Generic (PLEG): container finished" podID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerID="a0213bf22be4e130acd558aa5266133e8cff80fdb57f83266e20adb091a0da72" exitCode=0
Jul 02 19:06:26.130270 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.129921    2577 generic.go:356] "Generic (PLEG): container finished" podID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerID="0e4347ae24920416c7c855e9ad461544caaf85d864b4d4cba3911b27059a110c" exitCode=0
Jul 02 19:06:26.130270 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.129941    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerDied","Data":"0de19bc8d429e2903910ef26d973546f9e5dd878e5aa24e35eb25a7ca0241298"}
Jul 02 19:06:26.130270 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.130023    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerDied","Data":"38114f9a31f0a4a05e5727b82dc30ed613489203f8941fcbdfd89c57a4fffba1"}
Jul 02 19:06:26.130270 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.130064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerDied","Data":"ab61b9429176b01c519cd731d9dda650c6dcced3c0fd0cafdd4ba568094ab9ff"}
Jul 02 19:06:26.130270 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.130102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerDied","Data":"32c15d8b68b162f6f3953300db155553c1fbac72d4be34c5ebcf3e610d0e819b"}
Jul 02 19:06:26.130270 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.130142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerDied","Data":"a0213bf22be4e130acd558aa5266133e8cff80fdb57f83266e20adb091a0da72"}
Jul 02 19:06:26.130270 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.130183    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerDied","Data":"0e4347ae24920416c7c855e9ad461544caaf85d864b4d4cba3911b27059a110c"}
Jul 02 19:06:26.168632 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.168602    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:26.306100 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306057    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-serving-certs-ca-bundle\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306113    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306133    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-tls-assets\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306149    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-1\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306169    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-config-out\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306185    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-kubelet-serving-ca-bundle\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306216    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-trusted-ca-bundle\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306252    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-thanos-prometheus-http-client-file\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306287    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306310    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-metrics-client-certs\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306339    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-0\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306368    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-db\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306409    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-tls\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306440    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-config\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306464    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-kube-rbac-proxy\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306475    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306520    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-web-config\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306545    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306567    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-metrics-client-ca\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306594    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306598    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-grpc-tls\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306654    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ks9s\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-kube-api-access-9ks9s\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.306737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306690    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-2\") pod \"91ff24c4-1345-4113-9ed0-b4531637bd33\" (UID: \"91ff24c4-1345-4113-9ed0-b4531637bd33\") "
Jul 02 19:06:26.307549 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.306995    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.307549 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.307018    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.307549 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.307032    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.307549 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.307443    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:26.307799 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.307774    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:26.307958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.307933    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:26.308972 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.308943    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:06:26.309114 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.309090    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-config-out" (OuterVolumeSpecName: "config-out") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:06:26.309193 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.309147    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.309293 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.309269    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.309917 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.309887    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.310282 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.310257    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:06:26.310440 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.310411    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.310683 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.310645    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:06:26.311063 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.311029    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-kube-api-access-9ks9s" (OuterVolumeSpecName: "kube-api-access-9ks9s") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "kube-api-access-9ks9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:06:26.311178 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.311090    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.311243 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.311227    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-config" (OuterVolumeSpecName: "config") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.311319 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.311301    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.312253 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.312232    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.321318 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.321296    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-web-config" (OuterVolumeSpecName: "web-config") pod "91ff24c4-1345-4113-9ed0-b4531637bd33" (UID: "91ff24c4-1345-4113-9ed0-b4531637bd33"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:06:26.407928 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407888    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-metrics-client-ca\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.407928 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407920    2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-grpc-tls\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.407928 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407931    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ks9s\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-kube-api-access-9ks9s\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.407928 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407941    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407951    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407961    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/91ff24c4-1345-4113-9ed0-b4531637bd33-tls-assets\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407969    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-config-out\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407977    2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407986    2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.407995    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.408005    2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-metrics-client-certs\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.408013    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.408020    2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/91ff24c4-1345-4113-9ed0-b4531637bd33-prometheus-k8s-db\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.408028    2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.408038    2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-config\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.408045    2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-secret-kube-rbac-proxy\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:26.408181 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:26.408054    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/91ff24c4-1345-4113-9ed0-b4531637bd33-web-config\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:06:27.136534 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.136503    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"91ff24c4-1345-4113-9ed0-b4531637bd33","Type":"ContainerDied","Data":"675b5a7b7b592b7ce3c3ef52e83065d60d19928d405612c46af10381e40d9c4b"}
Jul 02 19:06:27.136534 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.136525    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.137040 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.136584    2577 scope.go:117] "RemoveContainer" containerID="0de19bc8d429e2903910ef26d973546f9e5dd878e5aa24e35eb25a7ca0241298"
Jul 02 19:06:27.145324 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.145299    2577 scope.go:117] "RemoveContainer" containerID="38114f9a31f0a4a05e5727b82dc30ed613489203f8941fcbdfd89c57a4fffba1"
Jul 02 19:06:27.153196 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.153177    2577 scope.go:117] "RemoveContainer" containerID="ab61b9429176b01c519cd731d9dda650c6dcced3c0fd0cafdd4ba568094ab9ff"
Jul 02 19:06:27.160789 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.160768    2577 scope.go:117] "RemoveContainer" containerID="32c15d8b68b162f6f3953300db155553c1fbac72d4be34c5ebcf3e610d0e819b"
Jul 02 19:06:27.161277 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.161252    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:06:27.168180 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.168150    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:06:27.169795 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.169776    2577 scope.go:117] "RemoveContainer" containerID="a0213bf22be4e130acd558aa5266133e8cff80fdb57f83266e20adb091a0da72"
Jul 02 19:06:27.177459 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.177439    2577 scope.go:117] "RemoveContainer" containerID="0e4347ae24920416c7c855e9ad461544caaf85d864b4d4cba3911b27059a110c"
Jul 02 19:06:27.185739 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.185719    2577 scope.go:117] "RemoveContainer" containerID="78fbbe2d78af6465d3c35e894588b88ede30a3574c1c445f94dda91cd576d0ad"
Jul 02 19:06:27.192643 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.192612    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:06:27.193046 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193027    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy"
Jul 02 19:06:27.193100 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193054    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy"
Jul 02 19:06:27.193100 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193068    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy"
Jul 02 19:06:27.193100 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193076    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy"
Jul 02 19:06:27.193100 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193089    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4993a986-db9e-489c-b790-16a1bc2b6c8c" containerName="registry"
Jul 02 19:06:27.193100 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193099    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4993a986-db9e-489c-b790-16a1bc2b6c8c" containerName="registry"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193109    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="prom-label-proxy"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193118    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="prom-label-proxy"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193130    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="init-config-reloader"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193138    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="init-config-reloader"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193149    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy-web"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193157    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy-web"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193175    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11ef6c25-c645-47b2-8a14-3eac88b82113" containerName="console"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193182    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="11ef6c25-c645-47b2-8a14-3eac88b82113" containerName="console"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193190    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="prometheus"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193198    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="prometheus"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193209    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="config-reloader"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193216    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="config-reloader"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193224    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy-thanos"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193232    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy-thanos"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193243    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="config-reloader"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193252    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="config-reloader"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193265    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="thanos-sidecar"
Jul 02 19:06:27.193262 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193273    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="thanos-sidecar"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193282    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="init-config-reloader"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193291    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="init-config-reloader"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193299    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy-web"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193310    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy-web"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193322    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="alertmanager"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193330    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="alertmanager"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193341    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy-metric"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193349    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy-metric"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193461    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193472    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="config-reloader"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193480    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="prom-label-proxy"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193489    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="thanos-sidecar"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193496    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4993a986-db9e-489c-b790-16a1bc2b6c8c" containerName="registry"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193505    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="11ef6c25-c645-47b2-8a14-3eac88b82113" containerName="console"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193512    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy-metric"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193520    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="config-reloader"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193530    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy-web"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193540    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193547    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="kube-rbac-proxy-web"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193555    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c342a8dd-b072-4e95-a7d1-526554d3bf6a" containerName="alertmanager"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193562    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="prometheus"
Jul 02 19:06:27.193832 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.193572    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" containerName="kube-rbac-proxy-thanos"
Jul 02 19:06:27.199092 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.199072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.202274 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.202250    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 19:06:27.202478 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.202260    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 19:06:27.202478 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.202358    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 19:06:27.202478 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.202364    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 19:06:27.202742 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.202679    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 19:06:27.202825 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.202786    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 19:06:27.202825 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.202786    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-9zv2z\""
Jul 02 19:06:27.203020 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.203000    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2qkrojkkurds7\""
Jul 02 19:06:27.203546 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.203507    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 19:06:27.203652 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.203576    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 19:06:27.203823 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.203800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 19:06:27.204361 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.204341    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 19:06:27.204467 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.204342    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 19:06:27.204467 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.204419    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 19:06:27.206216 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.206198    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 19:06:27.208625 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.208602    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 19:06:27.212258 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.212154    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:06:27.237145 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.237112    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91ff24c4-1345-4113-9ed0-b4531637bd33" path="/var/lib/kubelet/pods/91ff24c4-1345-4113-9ed0-b4531637bd33/volumes"
Jul 02 19:06:27.316565 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.316565 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.316891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.316891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.316891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.316891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316746    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmbm\" (UniqueName: \"kubernetes.io/projected/ec8b359a-b29d-4687-816e-63bac52cba94-kube-api-access-njmbm\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.316891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.316891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.316891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec8b359a-b29d-4687-816e-63bac52cba94-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.316996    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.317029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.317071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-config\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.317097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec8b359a-b29d-4687-816e-63bac52cba94-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.317123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.317146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.317165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.317505 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.317185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418542 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418542 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418781 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418781 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418989 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njmbm\" (UniqueName: \"kubernetes.io/projected/ec8b359a-b29d-4687-816e-63bac52cba94-kube-api-access-njmbm\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418989 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418989 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418989 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.418989 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.418966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419168 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419168 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419010    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419168 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec8b359a-b29d-4687-816e-63bac52cba94-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419168 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419168 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419168 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-config\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419168 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419149    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec8b359a-b29d-4687-816e-63bac52cba94-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419168 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419530 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419530 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419530 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419530 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419636    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.419724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.419672    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.420114 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.420085    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.420257 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.420159    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.422101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.422071    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.422217 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.422193    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.422650 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.422619    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-config\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.422915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.422891    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.423712 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.423347    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.423712 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.423356    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.423712 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.423581    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.423712 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.423666    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.424267 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.424184    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec8b359a-b29d-4687-816e-63bac52cba94-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.424459 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.424427    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec8b359a-b29d-4687-816e-63bac52cba94-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.424927 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.424903    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.425348 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.425327    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.425737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.425713    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec8b359a-b29d-4687-816e-63bac52cba94-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.426036 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.426017    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec8b359a-b29d-4687-816e-63bac52cba94-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.429061 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.429017    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmbm\" (UniqueName: \"kubernetes.io/projected/ec8b359a-b29d-4687-816e-63bac52cba94-kube-api-access-njmbm\") pod \"prometheus-k8s-0\" (UID: \"ec8b359a-b29d-4687-816e-63bac52cba94\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.510043 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.509998    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:06:27.663277 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:27.663242    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:06:27.666209 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:06:27.666181    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8b359a_b29d_4687_816e_63bac52cba94.slice/crio-4107b98b6be1beea6608fc524de9420c38afb49204d091e4ad9e43bcca5b9526 WatchSource:0}: Error finding container 4107b98b6be1beea6608fc524de9420c38afb49204d091e4ad9e43bcca5b9526: Status 404 returned error can't find the container with id 4107b98b6be1beea6608fc524de9420c38afb49204d091e4ad9e43bcca5b9526
Jul 02 19:06:28.142366 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:28.142318    2577 generic.go:356] "Generic (PLEG): container finished" podID="ec8b359a-b29d-4687-816e-63bac52cba94" containerID="fa5fb53448a6864d956d62e8659eae80a3f2cb30cdcae9180c0d7259afa10ef2" exitCode=0
Jul 02 19:06:28.142803 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:28.142404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8b359a-b29d-4687-816e-63bac52cba94","Type":"ContainerDied","Data":"fa5fb53448a6864d956d62e8659eae80a3f2cb30cdcae9180c0d7259afa10ef2"}
Jul 02 19:06:28.142803 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:28.142513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8b359a-b29d-4687-816e-63bac52cba94","Type":"ContainerStarted","Data":"4107b98b6be1beea6608fc524de9420c38afb49204d091e4ad9e43bcca5b9526"}
Jul 02 19:06:29.150721 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:29.150684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8b359a-b29d-4687-816e-63bac52cba94","Type":"ContainerStarted","Data":"63215335389cf72ba2620cc7053178ffff3033ef97e5fcba242e96f5dda21110"}
Jul 02 19:06:29.151195 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:29.150749    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8b359a-b29d-4687-816e-63bac52cba94","Type":"ContainerStarted","Data":"74f46fc13fa8fce20e389c82f3abff3079d41d10ea6f38ca8b8a565824677e2e"}
Jul 02 19:06:29.151195 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:29.150777    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8b359a-b29d-4687-816e-63bac52cba94","Type":"ContainerStarted","Data":"ca7dbaa86defd4e7c4d46062b802c558688924dddc1931fb75b4657a891cdbf5"}
Jul 02 19:06:29.151195 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:29.150804    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8b359a-b29d-4687-816e-63bac52cba94","Type":"ContainerStarted","Data":"0d53f4abc60e950755de7c80a43a10cb7edbc0a7e18a610251af23a261ca1330"}
Jul 02 19:06:29.151195 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:29.150827    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8b359a-b29d-4687-816e-63bac52cba94","Type":"ContainerStarted","Data":"914e4fdab23fd5668b8c5daf1a0330fd13c3e3b990639401952fb9fe9de752ab"}
Jul 02 19:06:29.151195 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:29.150870    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec8b359a-b29d-4687-816e-63bac52cba94","Type":"ContainerStarted","Data":"066056c8cec8d45b0255a9a725a884ab9dbab106ddec8fddb27c96643a64742b"}
Jul 02 19:06:29.181483 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:29.181419    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.161774551 podStartE2EDuration="2.181397541s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.62299ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:06:29.180023159 +0000 UTC m=+202.485043696" watchObservedRunningTime="2026-07-02 19:06:29.181397541 +0000 UTC m=+202.486418080"
Jul 02 19:06:32.510165 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:06:32.510115    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:07:27.511066 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:07:27.511024    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:07:27.527242 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:07:27.527211    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:07:28.389140 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:07:28.389035    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:08:07.143719 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:07.143684    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:08:43.006466 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.006432    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"]
Jul 02 19:08:43.009506 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.009491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"
Jul 02 19:08:43.012143 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.012119    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:08:43.013285 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.013267    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mg8nz\""
Jul 02 19:08:43.013386 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.013305    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 19:08:43.019385 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.019360    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"]
Jul 02 19:08:43.074408 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.074372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc4949ca-7247-4d3b-97b6-32e04de98c18-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bnztb\" (UID: \"bc4949ca-7247-4d3b-97b6-32e04de98c18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"
Jul 02 19:08:43.074590 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.074461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpxmj\" (UniqueName: \"kubernetes.io/projected/bc4949ca-7247-4d3b-97b6-32e04de98c18-kube-api-access-rpxmj\") pod \"openshift-lws-operator-fd8ccff4c-bnztb\" (UID: \"bc4949ca-7247-4d3b-97b6-32e04de98c18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"
Jul 02 19:08:43.175443 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.175390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpxmj\" (UniqueName: \"kubernetes.io/projected/bc4949ca-7247-4d3b-97b6-32e04de98c18-kube-api-access-rpxmj\") pod \"openshift-lws-operator-fd8ccff4c-bnztb\" (UID: \"bc4949ca-7247-4d3b-97b6-32e04de98c18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"
Jul 02 19:08:43.175443 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.175451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc4949ca-7247-4d3b-97b6-32e04de98c18-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bnztb\" (UID: \"bc4949ca-7247-4d3b-97b6-32e04de98c18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"
Jul 02 19:08:43.175776 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.175760    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc4949ca-7247-4d3b-97b6-32e04de98c18-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bnztb\" (UID: \"bc4949ca-7247-4d3b-97b6-32e04de98c18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"
Jul 02 19:08:43.184515 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.184485    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpxmj\" (UniqueName: \"kubernetes.io/projected/bc4949ca-7247-4d3b-97b6-32e04de98c18-kube-api-access-rpxmj\") pod \"openshift-lws-operator-fd8ccff4c-bnztb\" (UID: \"bc4949ca-7247-4d3b-97b6-32e04de98c18\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"
Jul 02 19:08:43.332237 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.332189    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"
Jul 02 19:08:43.469607 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.469572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb"]
Jul 02 19:08:43.473979 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:08:43.473944    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc4949ca_7247_4d3b_97b6_32e04de98c18.slice/crio-f0748e1ee3d12e1923692a1071c217473f954ede962bf5b57cd0dc69bfb8b389 WatchSource:0}: Error finding container f0748e1ee3d12e1923692a1071c217473f954ede962bf5b57cd0dc69bfb8b389: Status 404 returned error can't find the container with id f0748e1ee3d12e1923692a1071c217473f954ede962bf5b57cd0dc69bfb8b389
Jul 02 19:08:43.475557 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.475533    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:08:43.644699 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:43.644613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb" event={"ID":"bc4949ca-7247-4d3b-97b6-32e04de98c18","Type":"ContainerStarted","Data":"f0748e1ee3d12e1923692a1071c217473f954ede962bf5b57cd0dc69bfb8b389"}
Jul 02 19:08:46.660637 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:46.660595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb" event={"ID":"bc4949ca-7247-4d3b-97b6-32e04de98c18","Type":"ContainerStarted","Data":"8d0f3e9b7ebe579d3bbfa60fcc6fe4cd47d43d9b6ba5029daf54265dbb532a78"}
Jul 02 19:08:46.678279 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:46.678220    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bnztb" podStartSLOduration=1.889969889 podStartE2EDuration="4.678200449s" totalImagesPullingTime="2.78823056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:08:46.677735664 +0000 UTC m=+339.982756201" watchObservedRunningTime="2026-07-02 19:08:46.678200449 +0000 UTC m=+339.983220984"
Jul 02 19:08:57.574333 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.574294    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"]
Jul 02 19:08:57.577901 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.577881    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.582472 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.582443    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xnfzt\""
Jul 02 19:08:57.582472 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.582469    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 19:08:57.582691 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.582524    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 19:08:57.582691 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.582565    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 19:08:57.590890 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.590867    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"]
Jul 02 19:08:57.693457 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.693420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-manager-config\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.693637 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.693488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml99p\" (UniqueName: \"kubernetes.io/projected/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-kube-api-access-ml99p\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.693637 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.693511    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-cert\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.693637 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.693533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-metrics-cert\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.794250 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.794214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-metrics-cert\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.794445 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.794267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-manager-config\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.794445 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.794309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml99p\" (UniqueName: \"kubernetes.io/projected/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-kube-api-access-ml99p\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.794445 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.794329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-cert\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.795036 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.795011    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-manager-config\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.797007 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.796979    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-cert\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.797007 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.796990    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-metrics-cert\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.803569 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.803547    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml99p\" (UniqueName: \"kubernetes.io/projected/ef3bd11b-9cbb-48ec-ac92-ee1844081e12-kube-api-access-ml99p\") pod \"lws-controller-manager-744887b959-ttxw8\" (UID: \"ef3bd11b-9cbb-48ec-ac92-ee1844081e12\") " pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:57.887696 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:57.887608    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:08:58.025602 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:58.025574    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"]
Jul 02 19:08:58.028223 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:08:58.028198    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef3bd11b_9cbb_48ec_ac92_ee1844081e12.slice/crio-0a509c9f56d8997865ad326408ed8838c0ed8d76e4ce2edf5956b2bf6917392e WatchSource:0}: Error finding container 0a509c9f56d8997865ad326408ed8838c0ed8d76e4ce2edf5956b2bf6917392e: Status 404 returned error can't find the container with id 0a509c9f56d8997865ad326408ed8838c0ed8d76e4ce2edf5956b2bf6917392e
Jul 02 19:08:58.706060 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:08:58.706021    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8" event={"ID":"ef3bd11b-9cbb-48ec-ac92-ee1844081e12","Type":"ContainerStarted","Data":"0a509c9f56d8997865ad326408ed8838c0ed8d76e4ce2edf5956b2bf6917392e"}
Jul 02 19:09:01.719681 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:01.719586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8" event={"ID":"ef3bd11b-9cbb-48ec-ac92-ee1844081e12","Type":"ContainerStarted","Data":"f079eed4e9c2abbfbe057605e7b12c5e1cab4277b1a5331d6f0a436552058ab7"}
Jul 02 19:09:01.719681 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:01.719670    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:09:01.739000 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:01.738952    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8" podStartSLOduration=1.3640069160000001 podStartE2EDuration="4.738936942s" totalImagesPullingTime="3.374930026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:01.737891641 +0000 UTC m=+355.042912168" watchObservedRunningTime="2026-07-02 19:09:01.738936942 +0000 UTC m=+355.043957478"
Jul 02 19:09:05.788356 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.788319    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"]
Jul 02 19:09:05.792948 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.792926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.795687 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.795664    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:09:05.795921 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.795904    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:09:05.795983 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.795904    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tnjqd\""
Jul 02 19:09:05.796518 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.796495    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:09:05.797535 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.797516    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:09:05.809914 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.809887    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"]
Jul 02 19:09:05.864130 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.864100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/663e855f-1137-40e0-8ea5-e89c2e5a593f-manifests\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.864130 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.864137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663e855f-1137-40e0-8ea5-e89c2e5a593f-tmp\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.864341 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.864194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/663e855f-1137-40e0-8ea5-e89c2e5a593f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.864341 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.864223    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j2gd\" (UniqueName: \"kubernetes.io/projected/663e855f-1137-40e0-8ea5-e89c2e5a593f-kube-api-access-2j2gd\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.864341 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.864267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/663e855f-1137-40e0-8ea5-e89c2e5a593f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.965639 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.965607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/663e855f-1137-40e0-8ea5-e89c2e5a593f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.965796 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.965644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j2gd\" (UniqueName: \"kubernetes.io/projected/663e855f-1137-40e0-8ea5-e89c2e5a593f-kube-api-access-2j2gd\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.965796 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.965672    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/663e855f-1137-40e0-8ea5-e89c2e5a593f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.965796 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.965738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/663e855f-1137-40e0-8ea5-e89c2e5a593f-manifests\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.965796 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.965773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663e855f-1137-40e0-8ea5-e89c2e5a593f-tmp\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.966200 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.966178    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/663e855f-1137-40e0-8ea5-e89c2e5a593f-manifests\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.968101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.968070    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/663e855f-1137-40e0-8ea5-e89c2e5a593f-tmp\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.968320 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.968303    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/663e855f-1137-40e0-8ea5-e89c2e5a593f-webhook-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.968364 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.968338    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/663e855f-1137-40e0-8ea5-e89c2e5a593f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:05.976621 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:05.976591    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j2gd\" (UniqueName: \"kubernetes.io/projected/663e855f-1137-40e0-8ea5-e89c2e5a593f-kube-api-access-2j2gd\") pod \"opendatahub-operator-controller-manager-cb89c69-n9sf5\" (UID: \"663e855f-1137-40e0-8ea5-e89c2e5a593f\") " pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:06.102651 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:06.102547    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:06.239657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:06.239631    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"]
Jul 02 19:09:06.242095 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:09:06.242070    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663e855f_1137_40e0_8ea5_e89c2e5a593f.slice/crio-615268a00d5fbba51aa7b8e0d07b7e6f0e003e1fa55074a39692bd907b7310e9 WatchSource:0}: Error finding container 615268a00d5fbba51aa7b8e0d07b7e6f0e003e1fa55074a39692bd907b7310e9: Status 404 returned error can't find the container with id 615268a00d5fbba51aa7b8e0d07b7e6f0e003e1fa55074a39692bd907b7310e9
Jul 02 19:09:06.741287 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:06.741250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5" event={"ID":"663e855f-1137-40e0-8ea5-e89c2e5a593f","Type":"ContainerStarted","Data":"615268a00d5fbba51aa7b8e0d07b7e6f0e003e1fa55074a39692bd907b7310e9"}
Jul 02 19:09:09.758779 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:09.758746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5" event={"ID":"663e855f-1137-40e0-8ea5-e89c2e5a593f","Type":"ContainerStarted","Data":"5709fdcbec347172398e5b50a9882433681e2a526380ce2b991bc76aa80f0424"}
Jul 02 19:09:10.765377 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:10.765340    2577 generic.go:356] "Generic (PLEG): container finished" podID="663e855f-1137-40e0-8ea5-e89c2e5a593f" containerID="5709fdcbec347172398e5b50a9882433681e2a526380ce2b991bc76aa80f0424" exitCode=0
Jul 02 19:09:10.765766 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:10.765433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5" event={"ID":"663e855f-1137-40e0-8ea5-e89c2e5a593f","Type":"ContainerDied","Data":"5709fdcbec347172398e5b50a9882433681e2a526380ce2b991bc76aa80f0424"}
Jul 02 19:09:11.771216 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:11.771181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5" event={"ID":"663e855f-1137-40e0-8ea5-e89c2e5a593f","Type":"ContainerStarted","Data":"f4a6ed3e5caef8880622d15f8621bcf05809d7b55537ea066d20577ccc526a10"}
Jul 02 19:09:11.771617 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:11.771329    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:11.806127 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:11.806067    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5" podStartSLOduration=2.485546418 podStartE2EDuration="6.80604517s" totalImagesPullingTime="3.25095655s" totalInitContainerRuntime="1.069542202s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:11.80404545 +0000 UTC m=+365.109065985" watchObservedRunningTime="2026-07-02 19:09:11.80604517 +0000 UTC m=+365.111065707"
Jul 02 19:09:12.725522 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:12.725486    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-744887b959-ttxw8"
Jul 02 19:09:22.778997 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:22.778962    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cb89c69-n9sf5"
Jul 02 19:09:30.781416 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.781382    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-578747f885-k8c66"]
Jul 02 19:09:30.784810 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.784787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:30.788101 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.788075    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:09:30.788452 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.788077    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 19:09:30.788767 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.788084    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-s2fdj\""
Jul 02 19:09:30.789653 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.789129    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:09:30.789653 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.788129    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 19:09:30.799004 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.798977    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-578747f885-k8c66"]
Jul 02 19:09:30.878231 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.878191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4130351d-3433-484c-aa43-e942b64f1fec-tls-certs\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:30.878426 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.878242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sngl\" (UniqueName: \"kubernetes.io/projected/4130351d-3433-484c-aa43-e942b64f1fec-kube-api-access-6sngl\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:30.878426 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.878272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4130351d-3433-484c-aa43-e942b64f1fec-tmp\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:30.979193 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.979155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sngl\" (UniqueName: \"kubernetes.io/projected/4130351d-3433-484c-aa43-e942b64f1fec-kube-api-access-6sngl\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:30.979388 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.979204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4130351d-3433-484c-aa43-e942b64f1fec-tmp\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:30.979388 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.979260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4130351d-3433-484c-aa43-e942b64f1fec-tls-certs\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:30.979388 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:09:30.979358    2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 02 19:09:30.979552 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:09:30.979437    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4130351d-3433-484c-aa43-e942b64f1fec-tls-certs podName:4130351d-3433-484c-aa43-e942b64f1fec nodeName:}" failed. No retries permitted until 2026-07-02 19:09:31.479418481 +0000 UTC m=+384.784438997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/4130351d-3433-484c-aa43-e942b64f1fec-tls-certs") pod "kube-auth-proxy-578747f885-k8c66" (UID: "4130351d-3433-484c-aa43-e942b64f1fec") : secret "kube-auth-proxy-tls" not found
Jul 02 19:09:30.981764 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.981739    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4130351d-3433-484c-aa43-e942b64f1fec-tmp\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:30.990499 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:30.990468    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sngl\" (UniqueName: \"kubernetes.io/projected/4130351d-3433-484c-aa43-e942b64f1fec-kube-api-access-6sngl\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:31.483801 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:31.483761    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4130351d-3433-484c-aa43-e942b64f1fec-tls-certs\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:31.486415 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:31.486391    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4130351d-3433-484c-aa43-e942b64f1fec-tls-certs\") pod \"kube-auth-proxy-578747f885-k8c66\" (UID: \"4130351d-3433-484c-aa43-e942b64f1fec\") " pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:31.701597 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:31.701559    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66"
Jul 02 19:09:31.846188 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:31.846164    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-578747f885-k8c66"]
Jul 02 19:09:31.850688 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:09:31.848628    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4130351d_3433_484c_aa43_e942b64f1fec.slice/crio-f9e2cf5ff39ddb3e902b0f994395db8208b4708c1867fd122caa470ef0ef85bb WatchSource:0}: Error finding container f9e2cf5ff39ddb3e902b0f994395db8208b4708c1867fd122caa470ef0ef85bb: Status 404 returned error can't find the container with id f9e2cf5ff39ddb3e902b0f994395db8208b4708c1867fd122caa470ef0ef85bb
Jul 02 19:09:31.858389 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:31.858356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66" event={"ID":"4130351d-3433-484c-aa43-e942b64f1fec","Type":"ContainerStarted","Data":"f9e2cf5ff39ddb3e902b0f994395db8208b4708c1867fd122caa470ef0ef85bb"}
Jul 02 19:09:36.893747 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:36.893709    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66" event={"ID":"4130351d-3433-484c-aa43-e942b64f1fec","Type":"ContainerStarted","Data":"a24695df09f93f7f66ffe78f63eaf846567c11bf5e7e400199f32b484c9ed8c4"}
Jul 02 19:09:36.928142 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:09:36.928089    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-578747f885-k8c66" podStartSLOduration=2.585515335 podStartE2EDuration="6.928069373s" totalImagesPullingTime="4.342554038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:09:36.92349542 +0000 UTC m=+390.228515956" watchObservedRunningTime="2026-07-02 19:09:36.928069373 +0000 UTC m=+390.233089908"
Jul 02 19:11:05.047492 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.047454    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"]
Jul 02 19:11:05.050650 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.050631    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:05.058436 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.058411    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:11:05.058541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.058519    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:11:05.061299 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.061278    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4j6r8\""
Jul 02 19:11:05.074151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.074118    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"]
Jul 02 19:11:05.096782 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.096746    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57wq9\" (UniqueName: \"kubernetes.io/projected/17db9a6a-6be3-4e0b-9323-21b43510f3f8-kube-api-access-57wq9\") pod \"limitador-operator-controller-manager-859d7b78bd-xv28w\" (UID: \"17db9a6a-6be3-4e0b-9323-21b43510f3f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:05.197765 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.197729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57wq9\" (UniqueName: \"kubernetes.io/projected/17db9a6a-6be3-4e0b-9323-21b43510f3f8-kube-api-access-57wq9\") pod \"limitador-operator-controller-manager-859d7b78bd-xv28w\" (UID: \"17db9a6a-6be3-4e0b-9323-21b43510f3f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:05.229271 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.229237    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57wq9\" (UniqueName: \"kubernetes.io/projected/17db9a6a-6be3-4e0b-9323-21b43510f3f8-kube-api-access-57wq9\") pod \"limitador-operator-controller-manager-859d7b78bd-xv28w\" (UID: \"17db9a6a-6be3-4e0b-9323-21b43510f3f8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:05.360997 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.360906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:05.502707 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:05.502685    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"]
Jul 02 19:11:05.505685 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:11:05.505652    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17db9a6a_6be3_4e0b_9323_21b43510f3f8.slice/crio-b28790d6efceea128224db1c0d0c65315e195d8f9ad76aa6e49acddc5bf73bf8 WatchSource:0}: Error finding container b28790d6efceea128224db1c0d0c65315e195d8f9ad76aa6e49acddc5bf73bf8: Status 404 returned error can't find the container with id b28790d6efceea128224db1c0d0c65315e195d8f9ad76aa6e49acddc5bf73bf8
Jul 02 19:11:06.279274 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:06.279235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w" event={"ID":"17db9a6a-6be3-4e0b-9323-21b43510f3f8","Type":"ContainerStarted","Data":"b28790d6efceea128224db1c0d0c65315e195d8f9ad76aa6e49acddc5bf73bf8"}
Jul 02 19:11:08.289038 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:08.289006    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w" event={"ID":"17db9a6a-6be3-4e0b-9323-21b43510f3f8","Type":"ContainerStarted","Data":"dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb"}
Jul 02 19:11:08.289421 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:08.289130    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:08.310475 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:08.310419    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w" podStartSLOduration=0.97818179 podStartE2EDuration="3.310403527s" totalImagesPullingTime="2.332221737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:08.307937062 +0000 UTC m=+481.612957599" watchObservedRunningTime="2026-07-02 19:11:08.310403527 +0000 UTC m=+481.615424063"
Jul 02 19:11:19.298010 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:19.297975    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:30.523862 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.523793    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"]
Jul 02 19:11:30.524359 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.524053    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w" podUID="17db9a6a-6be3-4e0b-9323-21b43510f3f8" containerName="manager" containerID="cri-o://dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb" gracePeriod=2
Jul 02 19:11:30.543047 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:11:30.543010    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"17db9a6a-6be3-4e0b-9323-21b43510f3f8\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-xv28w\": pods \"limitador-operator-controller-manager-859d7b78bd-xv28w\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:30.546145 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.546119    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"]
Jul 02 19:11:30.579314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.579281    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"]
Jul 02 19:11:30.579598 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.579585    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17db9a6a-6be3-4e0b-9323-21b43510f3f8" containerName="manager"
Jul 02 19:11:30.579640 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.579600    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="17db9a6a-6be3-4e0b-9323-21b43510f3f8" containerName="manager"
Jul 02 19:11:30.579913 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.579665    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="17db9a6a-6be3-4e0b-9323-21b43510f3f8" containerName="manager"
Jul 02 19:11:30.582557 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.582538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"
Jul 02 19:11:30.599710 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.599668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"]
Jul 02 19:11:30.625982 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:11:30.625945    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xv28w\" is forbidden: User \"system:node:ip-10-0-131-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-135.ec2.internal' and this object" podUID="17db9a6a-6be3-4e0b-9323-21b43510f3f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:30.632392 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.632362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqkrr\" (UniqueName: \"kubernetes.io/projected/a4be75f8-77fc-49d9-8c57-80fd3c9d5083-kube-api-access-vqkrr\") pod \"limitador-operator-controller-manager-859d7b78bd-spxl9\" (UID: \"a4be75f8-77fc-49d9-8c57-80fd3c9d5083\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"
Jul 02 19:11:30.733085 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.733050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqkrr\" (UniqueName: \"kubernetes.io/projected/a4be75f8-77fc-49d9-8c57-80fd3c9d5083-kube-api-access-vqkrr\") pod \"limitador-operator-controller-manager-859d7b78bd-spxl9\" (UID: \"a4be75f8-77fc-49d9-8c57-80fd3c9d5083\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"
Jul 02 19:11:30.746923 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.746895    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqkrr\" (UniqueName: \"kubernetes.io/projected/a4be75f8-77fc-49d9-8c57-80fd3c9d5083-kube-api-access-vqkrr\") pod \"limitador-operator-controller-manager-859d7b78bd-spxl9\" (UID: \"a4be75f8-77fc-49d9-8c57-80fd3c9d5083\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"
Jul 02 19:11:30.765390 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.765365    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:30.768329 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:11:30.768298    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xv28w\" is forbidden: User \"system:node:ip-10-0-131-135.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-135.ec2.internal' and this object" podUID="17db9a6a-6be3-4e0b-9323-21b43510f3f8" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:30.833802 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.833710    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57wq9\" (UniqueName: \"kubernetes.io/projected/17db9a6a-6be3-4e0b-9323-21b43510f3f8-kube-api-access-57wq9\") pod \"17db9a6a-6be3-4e0b-9323-21b43510f3f8\" (UID: \"17db9a6a-6be3-4e0b-9323-21b43510f3f8\") "
Jul 02 19:11:30.836093 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.836066    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17db9a6a-6be3-4e0b-9323-21b43510f3f8-kube-api-access-57wq9" (OuterVolumeSpecName: "kube-api-access-57wq9") pod "17db9a6a-6be3-4e0b-9323-21b43510f3f8" (UID: "17db9a6a-6be3-4e0b-9323-21b43510f3f8"). InnerVolumeSpecName "kube-api-access-57wq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:11:30.923447 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.923392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"
Jul 02 19:11:30.934815 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:30.934792    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57wq9\" (UniqueName: \"kubernetes.io/projected/17db9a6a-6be3-4e0b-9323-21b43510f3f8-kube-api-access-57wq9\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:11:31.069705 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.069679    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"]
Jul 02 19:11:31.071560 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:11:31.071537    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4be75f8_77fc_49d9_8c57_80fd3c9d5083.slice/crio-caf7a03c36be20c8e11282d777a41db175ffcd4bbcb37a4f21a2f48442f29a42 WatchSource:0}: Error finding container caf7a03c36be20c8e11282d777a41db175ffcd4bbcb37a4f21a2f48442f29a42: Status 404 returned error can't find the container with id caf7a03c36be20c8e11282d777a41db175ffcd4bbcb37a4f21a2f48442f29a42
Jul 02 19:11:31.236593 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.236561    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17db9a6a-6be3-4e0b-9323-21b43510f3f8" path="/var/lib/kubelet/pods/17db9a6a-6be3-4e0b-9323-21b43510f3f8/volumes"
Jul 02 19:11:31.393274 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.393174    2577 generic.go:356] "Generic (PLEG): container finished" podID="17db9a6a-6be3-4e0b-9323-21b43510f3f8" containerID="dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb" exitCode=0
Jul 02 19:11:31.393274 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.393220    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xv28w"
Jul 02 19:11:31.393274 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.393270    2577 scope.go:117] "RemoveContainer" containerID="dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb"
Jul 02 19:11:31.395024 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.394999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9" event={"ID":"a4be75f8-77fc-49d9-8c57-80fd3c9d5083","Type":"ContainerStarted","Data":"6fb9c5d50162a48f4fa6475c852f5f900825732aee54fc0fa533c0ce9af2338a"}
Jul 02 19:11:31.395162 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.395049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9" event={"ID":"a4be75f8-77fc-49d9-8c57-80fd3c9d5083","Type":"ContainerStarted","Data":"caf7a03c36be20c8e11282d777a41db175ffcd4bbcb37a4f21a2f48442f29a42"}
Jul 02 19:11:31.395162 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.395146    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"
Jul 02 19:11:31.401680 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.401662    2577 scope.go:117] "RemoveContainer" containerID="dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb"
Jul 02 19:11:31.401993 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:11:31.401975    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb\": container with ID starting with dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb not found: ID does not exist" containerID="dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb"
Jul 02 19:11:31.402070 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.402004    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb"} err="failed to get container status \"dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb\": rpc error: code = NotFound desc = could not find container \"dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb\": container with ID starting with dc2625f1a1b45aaf845a1678aedff8b03b6067a765757176892c03c645aff3bb not found: ID does not exist"
Jul 02 19:11:31.451903 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:31.451834    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9" podStartSLOduration=1.451812417 podStartE2EDuration="1.451812417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:11:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:11:31.450532012 +0000 UTC m=+504.755552549" watchObservedRunningTime="2026-07-02 19:11:31.451812417 +0000 UTC m=+504.756832951"
Jul 02 19:11:42.402727 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:11:42.402695    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-spxl9"
Jul 02 19:12:18.393284 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.393250    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:12:18.396128 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.396110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:18.404014 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.403994    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bfbmt\""
Jul 02 19:12:18.404123 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.404090    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 19:12:18.413879 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.413851    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:12:18.455766 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.455727    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:12:18.541893 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.541827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-485xm\" (UniqueName: \"kubernetes.io/projected/cfeb62ae-7ebf-4946-a261-5211cec45c42-kube-api-access-485xm\") pod \"limitador-limitador-54d6d988d5-rf6ht\" (UID: \"cfeb62ae-7ebf-4946-a261-5211cec45c42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:18.542070 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.541902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cfeb62ae-7ebf-4946-a261-5211cec45c42-config-file\") pod \"limitador-limitador-54d6d988d5-rf6ht\" (UID: \"cfeb62ae-7ebf-4946-a261-5211cec45c42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:18.642997 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.642952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cfeb62ae-7ebf-4946-a261-5211cec45c42-config-file\") pod \"limitador-limitador-54d6d988d5-rf6ht\" (UID: \"cfeb62ae-7ebf-4946-a261-5211cec45c42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:18.643187 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.643053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-485xm\" (UniqueName: \"kubernetes.io/projected/cfeb62ae-7ebf-4946-a261-5211cec45c42-kube-api-access-485xm\") pod \"limitador-limitador-54d6d988d5-rf6ht\" (UID: \"cfeb62ae-7ebf-4946-a261-5211cec45c42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:18.643607 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.643551    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cfeb62ae-7ebf-4946-a261-5211cec45c42-config-file\") pod \"limitador-limitador-54d6d988d5-rf6ht\" (UID: \"cfeb62ae-7ebf-4946-a261-5211cec45c42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:18.651394 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.651367    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-485xm\" (UniqueName: \"kubernetes.io/projected/cfeb62ae-7ebf-4946-a261-5211cec45c42-kube-api-access-485xm\") pod \"limitador-limitador-54d6d988d5-rf6ht\" (UID: \"cfeb62ae-7ebf-4946-a261-5211cec45c42\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:18.706121 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.706083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:18.848183 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.848150    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:12:18.852542 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:12:18.852512    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfeb62ae_7ebf_4946_a261_5211cec45c42.slice/crio-ac09994ce55075765c5b173d5cfdc745eff0ac440746f492b0365694912dd9c3 WatchSource:0}: Error finding container ac09994ce55075765c5b173d5cfdc745eff0ac440746f492b0365694912dd9c3: Status 404 returned error can't find the container with id ac09994ce55075765c5b173d5cfdc745eff0ac440746f492b0365694912dd9c3
Jul 02 19:12:18.963313 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.963235    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7nc4h"]
Jul 02 19:12:18.966442 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.966420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7nc4h"
Jul 02 19:12:18.969291 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.969263    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m5cfg\""
Jul 02 19:12:18.984521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:18.984492    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7nc4h"]
Jul 02 19:12:19.147459 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:19.147419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb9j5\" (UniqueName: \"kubernetes.io/projected/ea61223f-5ad9-4990-b854-52b52e645ae3-kube-api-access-cb9j5\") pod \"authorino-75d556bd77-7nc4h\" (UID: \"ea61223f-5ad9-4990-b854-52b52e645ae3\") " pod="kuadrant-system/authorino-75d556bd77-7nc4h"
Jul 02 19:12:19.248885 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:19.248680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb9j5\" (UniqueName: \"kubernetes.io/projected/ea61223f-5ad9-4990-b854-52b52e645ae3-kube-api-access-cb9j5\") pod \"authorino-75d556bd77-7nc4h\" (UID: \"ea61223f-5ad9-4990-b854-52b52e645ae3\") " pod="kuadrant-system/authorino-75d556bd77-7nc4h"
Jul 02 19:12:19.264659 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:19.264618    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb9j5\" (UniqueName: \"kubernetes.io/projected/ea61223f-5ad9-4990-b854-52b52e645ae3-kube-api-access-cb9j5\") pod \"authorino-75d556bd77-7nc4h\" (UID: \"ea61223f-5ad9-4990-b854-52b52e645ae3\") " pod="kuadrant-system/authorino-75d556bd77-7nc4h"
Jul 02 19:12:19.275541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:19.275445    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7nc4h"
Jul 02 19:12:19.482706 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:19.482667    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7nc4h"]
Jul 02 19:12:19.488918 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:12:19.488835    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea61223f_5ad9_4990_b854_52b52e645ae3.slice/crio-b18ecf057653425e48d40def2f70004711b1cfe6ef8d4cf6096205c1d6edd569 WatchSource:0}: Error finding container b18ecf057653425e48d40def2f70004711b1cfe6ef8d4cf6096205c1d6edd569: Status 404 returned error can't find the container with id b18ecf057653425e48d40def2f70004711b1cfe6ef8d4cf6096205c1d6edd569
Jul 02 19:12:19.619210 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:19.619159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht" event={"ID":"cfeb62ae-7ebf-4946-a261-5211cec45c42","Type":"ContainerStarted","Data":"ac09994ce55075765c5b173d5cfdc745eff0ac440746f492b0365694912dd9c3"}
Jul 02 19:12:19.620630 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:19.620566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7nc4h" event={"ID":"ea61223f-5ad9-4990-b854-52b52e645ae3","Type":"ContainerStarted","Data":"b18ecf057653425e48d40def2f70004711b1cfe6ef8d4cf6096205c1d6edd569"}
Jul 02 19:12:23.643732 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:23.643690    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7nc4h" event={"ID":"ea61223f-5ad9-4990-b854-52b52e645ae3","Type":"ContainerStarted","Data":"4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a"}
Jul 02 19:12:23.645451 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:23.645423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht" event={"ID":"cfeb62ae-7ebf-4946-a261-5211cec45c42","Type":"ContainerStarted","Data":"b61fcba2112653beaed27080052d31f6cd541cc124e2d8b2195edafa5f1d3485"}
Jul 02 19:12:23.645577 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:23.645561    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:23.660119 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:23.660063    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7nc4h" podStartSLOduration=2.007473079 podStartE2EDuration="5.660043669s" totalImagesPullingTime="3.65257059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:23.659955596 +0000 UTC m=+556.964976132" watchObservedRunningTime="2026-07-02 19:12:23.660043669 +0000 UTC m=+556.965064209"
Jul 02 19:12:23.682186 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:23.682132    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht" podStartSLOduration=1.432676858 podStartE2EDuration="5.682113371s" totalImagesPullingTime="4.249436513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:12:23.681044309 +0000 UTC m=+556.986064845" watchObservedRunningTime="2026-07-02 19:12:23.682113371 +0000 UTC m=+556.987133906"
Jul 02 19:12:34.651282 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:34.651252    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"
Jul 02 19:12:52.676810 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.676768    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-ftgzt"]
Jul 02 19:12:52.682791 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.682766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:52.685497 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.685474    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 19:12:52.688621 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.688596    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-ftgzt"]
Jul 02 19:12:52.708411 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.708381    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-ftgzt"]
Jul 02 19:12:52.708646 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:12:52.708627    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-stwx2 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-stwx2 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-ftgzt" podUID="94a65054-7742-413d-8361-2de47cfffd3d"
Jul 02 19:12:52.780760 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.780728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:52.787726 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.787705    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:52.837316 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.837282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94a65054-7742-413d-8361-2de47cfffd3d-tls-cert\") pod \"authorino-76877994-ftgzt\" (UID: \"94a65054-7742-413d-8361-2de47cfffd3d\") " pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:52.837497 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.837343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stwx2\" (UniqueName: \"kubernetes.io/projected/94a65054-7742-413d-8361-2de47cfffd3d-kube-api-access-stwx2\") pod \"authorino-76877994-ftgzt\" (UID: \"94a65054-7742-413d-8361-2de47cfffd3d\") " pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:52.937905 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.937790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94a65054-7742-413d-8361-2de47cfffd3d-tls-cert\") pod \"authorino-76877994-ftgzt\" (UID: \"94a65054-7742-413d-8361-2de47cfffd3d\") " pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:52.937905 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.937883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stwx2\" (UniqueName: \"kubernetes.io/projected/94a65054-7742-413d-8361-2de47cfffd3d-kube-api-access-stwx2\") pod \"authorino-76877994-ftgzt\" (UID: \"94a65054-7742-413d-8361-2de47cfffd3d\") " pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:52.940436 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.940413    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94a65054-7742-413d-8361-2de47cfffd3d-tls-cert\") pod \"authorino-76877994-ftgzt\" (UID: \"94a65054-7742-413d-8361-2de47cfffd3d\") " pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:52.946097 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:52.946074    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stwx2\" (UniqueName: \"kubernetes.io/projected/94a65054-7742-413d-8361-2de47cfffd3d-kube-api-access-stwx2\") pod \"authorino-76877994-ftgzt\" (UID: \"94a65054-7742-413d-8361-2de47cfffd3d\") " pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:53.038629 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.038596    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stwx2\" (UniqueName: \"kubernetes.io/projected/94a65054-7742-413d-8361-2de47cfffd3d-kube-api-access-stwx2\") pod \"94a65054-7742-413d-8361-2de47cfffd3d\" (UID: \"94a65054-7742-413d-8361-2de47cfffd3d\") "
Jul 02 19:12:53.038823 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.038669    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94a65054-7742-413d-8361-2de47cfffd3d-tls-cert\") pod \"94a65054-7742-413d-8361-2de47cfffd3d\" (UID: \"94a65054-7742-413d-8361-2de47cfffd3d\") "
Jul 02 19:12:53.040920 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.040889    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94a65054-7742-413d-8361-2de47cfffd3d-kube-api-access-stwx2" (OuterVolumeSpecName: "kube-api-access-stwx2") pod "94a65054-7742-413d-8361-2de47cfffd3d" (UID: "94a65054-7742-413d-8361-2de47cfffd3d"). InnerVolumeSpecName "kube-api-access-stwx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:12:53.041035 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.040946    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94a65054-7742-413d-8361-2de47cfffd3d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "94a65054-7742-413d-8361-2de47cfffd3d" (UID: "94a65054-7742-413d-8361-2de47cfffd3d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:12:53.139687 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.139653    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stwx2\" (UniqueName: \"kubernetes.io/projected/94a65054-7742-413d-8361-2de47cfffd3d-kube-api-access-stwx2\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:12:53.139687 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.139682    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94a65054-7742-413d-8361-2de47cfffd3d-tls-cert\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:12:53.785092 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.785054    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-ftgzt"
Jul 02 19:12:53.811784 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.811752    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-ftgzt"]
Jul 02 19:12:53.816522 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.816491    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-ftgzt"]
Jul 02 19:12:53.964038 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.964004    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7nc4h"]
Jul 02 19:12:53.964251 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:53.964211    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7nc4h" podUID="ea61223f-5ad9-4990-b854-52b52e645ae3" containerName="authorino" containerID="cri-o://4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a" gracePeriod=30
Jul 02 19:12:54.273782 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.273745    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7nc4h"
Jul 02 19:12:54.350754 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.350719    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb9j5\" (UniqueName: \"kubernetes.io/projected/ea61223f-5ad9-4990-b854-52b52e645ae3-kube-api-access-cb9j5\") pod \"ea61223f-5ad9-4990-b854-52b52e645ae3\" (UID: \"ea61223f-5ad9-4990-b854-52b52e645ae3\") "
Jul 02 19:12:54.352990 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.352952    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea61223f-5ad9-4990-b854-52b52e645ae3-kube-api-access-cb9j5" (OuterVolumeSpecName: "kube-api-access-cb9j5") pod "ea61223f-5ad9-4990-b854-52b52e645ae3" (UID: "ea61223f-5ad9-4990-b854-52b52e645ae3"). InnerVolumeSpecName "kube-api-access-cb9j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:12:54.452362 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.452273    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb9j5\" (UniqueName: \"kubernetes.io/projected/ea61223f-5ad9-4990-b854-52b52e645ae3-kube-api-access-cb9j5\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:12:54.791267 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.791230    2577 generic.go:356] "Generic (PLEG): container finished" podID="ea61223f-5ad9-4990-b854-52b52e645ae3" containerID="4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a" exitCode=0
Jul 02 19:12:54.791724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.791273    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7nc4h"
Jul 02 19:12:54.791724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.791295    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7nc4h" event={"ID":"ea61223f-5ad9-4990-b854-52b52e645ae3","Type":"ContainerDied","Data":"4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a"}
Jul 02 19:12:54.791724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.791333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7nc4h" event={"ID":"ea61223f-5ad9-4990-b854-52b52e645ae3","Type":"ContainerDied","Data":"b18ecf057653425e48d40def2f70004711b1cfe6ef8d4cf6096205c1d6edd569"}
Jul 02 19:12:54.791724 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.791355    2577 scope.go:117] "RemoveContainer" containerID="4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a"
Jul 02 19:12:54.800692 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.800667    2577 scope.go:117] "RemoveContainer" containerID="4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a"
Jul 02 19:12:54.801031 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:12:54.801010    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a\": container with ID starting with 4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a not found: ID does not exist" containerID="4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a"
Jul 02 19:12:54.801079 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.801043    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a"} err="failed to get container status \"4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a\": rpc error: code = NotFound desc = could not find container \"4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a\": container with ID starting with 4baf38d85762dd095af9f56c0f38bebacbd1265bcf859ae1db461dd1f6880f4a not found: ID does not exist"
Jul 02 19:12:54.811216 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.811188    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7nc4h"]
Jul 02 19:12:54.817494 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:54.817468    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7nc4h"]
Jul 02 19:12:55.236906 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:55.236810    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94a65054-7742-413d-8361-2de47cfffd3d" path="/var/lib/kubelet/pods/94a65054-7742-413d-8361-2de47cfffd3d/volumes"
Jul 02 19:12:55.237085 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:12:55.237071    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea61223f-5ad9-4990-b854-52b52e645ae3" path="/var/lib/kubelet/pods/ea61223f-5ad9-4990-b854-52b52e645ae3/volumes"
Jul 02 19:13:34.414118 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:13:34.414025    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:13:51.866403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:13:51.866364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:14:00.249412 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:00.249376    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:14:14.846044 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:14.846007    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:14:35.102759 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.102723    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"]
Jul 02 19:14:35.103155 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.103081    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea61223f-5ad9-4990-b854-52b52e645ae3" containerName="authorino"
Jul 02 19:14:35.103155 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.103092    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea61223f-5ad9-4990-b854-52b52e645ae3" containerName="authorino"
Jul 02 19:14:35.103155 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.103148    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea61223f-5ad9-4990-b854-52b52e645ae3" containerName="authorino"
Jul 02 19:14:35.105130 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.105115    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.111030 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.111008    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 19:14:35.111720 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.111704    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 02 19:14:35.112310 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.112293    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t76xx\""
Jul 02 19:14:35.112427 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.112336    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 19:14:35.157619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.157579    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"]
Jul 02 19:14:35.220687 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.220650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/953f209e-d0ae-4d6f-aa34-1fba05ff3012-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.220933 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.220717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.220933 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.220795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.220933 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.220879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48pxr\" (UniqueName: \"kubernetes.io/projected/953f209e-d0ae-4d6f-aa34-1fba05ff3012-kube-api-access-48pxr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.221086 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.220936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.221086 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.220963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322119 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322119 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322126    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322371 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/953f209e-d0ae-4d6f-aa34-1fba05ff3012-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322371 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322371 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322538 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48pxr\" (UniqueName: \"kubernetes.io/projected/953f209e-d0ae-4d6f-aa34-1fba05ff3012-kube-api-access-48pxr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322593 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322544    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322593 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322580    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.322677 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.322622    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.324640 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.324615    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/953f209e-d0ae-4d6f-aa34-1fba05ff3012-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.325047 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.325024    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/953f209e-d0ae-4d6f-aa34-1fba05ff3012-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.331657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.331631    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48pxr\" (UniqueName: \"kubernetes.io/projected/953f209e-d0ae-4d6f-aa34-1fba05ff3012-kube-api-access-48pxr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526\" (UID: \"953f209e-d0ae-4d6f-aa34-1fba05ff3012\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.415592 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.415497    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:35.551369 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.551345    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"]
Jul 02 19:14:35.553368 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:14:35.553338    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953f209e_d0ae_4d6f_aa34_1fba05ff3012.slice/crio-7fd1e781d5c250af4935ddf3819479c2feb16930f5e00afc7011095b15c7e090 WatchSource:0}: Error finding container 7fd1e781d5c250af4935ddf3819479c2feb16930f5e00afc7011095b15c7e090: Status 404 returned error can't find the container with id 7fd1e781d5c250af4935ddf3819479c2feb16930f5e00afc7011095b15c7e090
Jul 02 19:14:35.554644 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:35.554629    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:14:36.238994 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:36.238955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526" event={"ID":"953f209e-d0ae-4d6f-aa34-1fba05ff3012","Type":"ContainerStarted","Data":"7fd1e781d5c250af4935ddf3819479c2feb16930f5e00afc7011095b15c7e090"}
Jul 02 19:14:36.538908 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:36.538874    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:14:37.245214 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:37.245173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526" event={"ID":"953f209e-d0ae-4d6f-aa34-1fba05ff3012","Type":"ContainerStarted","Data":"c07a9510fb0d400def155ba45b193aa740f4413230e7a25c4f9a0ecb7f386e79"}
Jul 02 19:14:37.276022 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:37.275960    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526" podStartSLOduration=1.136339232 podStartE2EDuration="2.275941884s" totalImagesPullingTime="1.139602652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:37.273142743 +0000 UTC m=+690.578163280" watchObservedRunningTime="2026-07-02 19:14:37.275941884 +0000 UTC m=+690.580962419"
Jul 02 19:14:43.546445 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.546405    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"]
Jul 02 19:14:43.549350 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.549334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.556978 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.556957    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 02 19:14:43.565942 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.565912    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"]
Jul 02 19:14:43.697487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.697453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.697487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.697488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae2989-a185-4467-a550-e962cfa3d66b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.697703 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.697515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.697703 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.697535    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4qll\" (UniqueName: \"kubernetes.io/projected/e8ae2989-a185-4467-a550-e962cfa3d66b-kube-api-access-b4qll\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.697703 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.697615    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.697703 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.697655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.798909 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.798791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.798909 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.798872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.798909 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.798897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae2989-a185-4467-a550-e962cfa3d66b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.799205 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.798928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.799205 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.798963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4qll\" (UniqueName: \"kubernetes.io/projected/e8ae2989-a185-4467-a550-e962cfa3d66b-kube-api-access-b4qll\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.799205 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.799050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.799371 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.799266    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.799371 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.799324    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.799446 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.799398    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.801343 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.801316    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ae2989-a185-4467-a550-e962cfa3d66b-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.801529 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.801513    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ae2989-a185-4467-a550-e962cfa3d66b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.807062 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.807029    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4qll\" (UniqueName: \"kubernetes.io/projected/e8ae2989-a185-4467-a550-e962cfa3d66b-kube-api-access-b4qll\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gctqh\" (UID: \"e8ae2989-a185-4467-a550-e962cfa3d66b\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.859487 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.859451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:43.994959 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:43.994918    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"]
Jul 02 19:14:43.997592 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:14:43.997558    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ae2989_a185_4467_a550_e962cfa3d66b.slice/crio-c74d72c8426ada284299581c16e0f7d637ae994202cea6ea5cb772dab9d86cd9 WatchSource:0}: Error finding container c74d72c8426ada284299581c16e0f7d637ae994202cea6ea5cb772dab9d86cd9: Status 404 returned error can't find the container with id c74d72c8426ada284299581c16e0f7d637ae994202cea6ea5cb772dab9d86cd9
Jul 02 19:14:44.278820 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:44.278793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh" event={"ID":"e8ae2989-a185-4467-a550-e962cfa3d66b","Type":"ContainerStarted","Data":"c74d72c8426ada284299581c16e0f7d637ae994202cea6ea5cb772dab9d86cd9"}
Jul 02 19:14:45.285249 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:45.285213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh" event={"ID":"e8ae2989-a185-4467-a550-e962cfa3d66b","Type":"ContainerStarted","Data":"3a62a52cbf8de53e71d79159ee5721ff49568403555c48fb0ea70af7afa443d3"}
Jul 02 19:14:45.304915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:45.304856    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh" podStartSLOduration=2.063302918 podStartE2EDuration="2.304822871s" totalImagesPullingTime="241.519953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:45.303174349 +0000 UTC m=+698.608194886" watchObservedRunningTime="2026-07-02 19:14:45.304822871 +0000 UTC m=+698.609843422"
Jul 02 19:14:45.416542 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:45.416506    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:45.416706 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:45.416565    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:45.429246 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:45.429218    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:45.445021 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:45.444988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:14:46.302209 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:46.302172    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526"
Jul 02 19:14:53.860022 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:53.859984    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:53.860438 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:53.860063    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:53.873305 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:53.873271    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:54.335211 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:54.335183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gctqh"
Jul 02 19:14:55.348228 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.348195    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"]
Jul 02 19:14:55.354383 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.354363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.357294 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.357271    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 19:14:55.369545 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.369517    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"]
Jul 02 19:14:55.399730 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.399696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11bba824-b0c1-4777-8ac8-8385c64c3660-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.399974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.399777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.399974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.399828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqj24\" (UniqueName: \"kubernetes.io/projected/11bba824-b0c1-4777-8ac8-8385c64c3660-kube-api-access-bqj24\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.399974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.399881    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.399974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.399902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.399974 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.399945    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500417 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500417 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqj24\" (UniqueName: \"kubernetes.io/projected/11bba824-b0c1-4777-8ac8-8385c64c3660-kube-api-access-bqj24\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500677 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500677 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500677 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500677 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11bba824-b0c1-4777-8ac8-8385c64c3660-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500934 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500912    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500996 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500917    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.500996 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.500988    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.502925 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.502902    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11bba824-b0c1-4777-8ac8-8385c64c3660-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.503031 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.502973    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11bba824-b0c1-4777-8ac8-8385c64c3660-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.509453 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.509425    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqj24\" (UniqueName: \"kubernetes.io/projected/11bba824-b0c1-4777-8ac8-8385c64c3660-kube-api-access-bqj24\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp\" (UID: \"11bba824-b0c1-4777-8ac8-8385c64c3660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.664258 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.664158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:14:55.802913 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:55.802879    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"]
Jul 02 19:14:55.806329 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:14:55.806303    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11bba824_b0c1_4777_8ac8_8385c64c3660.slice/crio-2f6daf86c611ea08b89fd5526196785b484653b1ecfdf96e961d49e2658917a4 WatchSource:0}: Error finding container 2f6daf86c611ea08b89fd5526196785b484653b1ecfdf96e961d49e2658917a4: Status 404 returned error can't find the container with id 2f6daf86c611ea08b89fd5526196785b484653b1ecfdf96e961d49e2658917a4
Jul 02 19:14:56.340189 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:56.340098    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp" event={"ID":"11bba824-b0c1-4777-8ac8-8385c64c3660","Type":"ContainerStarted","Data":"0910be00429b5052d7a56030a85663c536cda38f43ddfff1d087ee72c9d6a6b4"}
Jul 02 19:14:56.340189 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:56.340143    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp" event={"ID":"11bba824-b0c1-4777-8ac8-8385c64c3660","Type":"ContainerStarted","Data":"2f6daf86c611ea08b89fd5526196785b484653b1ecfdf96e961d49e2658917a4"}
Jul 02 19:14:56.359203 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:56.359145    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp" podStartSLOduration=1.120779419 podStartE2EDuration="1.359128627s" totalImagesPullingTime="238.349208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:14:56.357616109 +0000 UTC m=+709.662636646" watchObservedRunningTime="2026-07-02 19:14:56.359128627 +0000 UTC m=+709.664149163"
Jul 02 19:14:57.649526 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:14:57.649488    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:15:05.664414 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:15:05.664371    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:15:05.664414 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:15:05.664424    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:15:05.676795 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:15:05.676759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:15:06.401071 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:15:06.401043    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp"
Jul 02 19:16:10.704670 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.704634    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b97fcd9c9-vm7fq"]
Jul 02 19:16:10.707657 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.707632    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq"
Jul 02 19:16:10.711360 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.711338    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m5cfg\""
Jul 02 19:16:10.711468 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.711345    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 02 19:16:10.716022 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.715997    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b97fcd9c9-vm7fq"]
Jul 02 19:16:10.784313 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.784271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/752867ab-6548-4e5d-8071-a7425be4d9ff-tls-cert\") pod \"authorino-6b97fcd9c9-vm7fq\" (UID: \"752867ab-6548-4e5d-8071-a7425be4d9ff\") " pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq"
Jul 02 19:16:10.784523 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.784330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn2nz\" (UniqueName: \"kubernetes.io/projected/752867ab-6548-4e5d-8071-a7425be4d9ff-kube-api-access-cn2nz\") pod \"authorino-6b97fcd9c9-vm7fq\" (UID: \"752867ab-6548-4e5d-8071-a7425be4d9ff\") " pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq"
Jul 02 19:16:10.885597 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.885552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn2nz\" (UniqueName: \"kubernetes.io/projected/752867ab-6548-4e5d-8071-a7425be4d9ff-kube-api-access-cn2nz\") pod \"authorino-6b97fcd9c9-vm7fq\" (UID: \"752867ab-6548-4e5d-8071-a7425be4d9ff\") " pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq"
Jul 02 19:16:10.885787 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.885673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/752867ab-6548-4e5d-8071-a7425be4d9ff-tls-cert\") pod \"authorino-6b97fcd9c9-vm7fq\" (UID: \"752867ab-6548-4e5d-8071-a7425be4d9ff\") " pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq"
Jul 02 19:16:10.888314 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.888283    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/752867ab-6548-4e5d-8071-a7425be4d9ff-tls-cert\") pod \"authorino-6b97fcd9c9-vm7fq\" (UID: \"752867ab-6548-4e5d-8071-a7425be4d9ff\") " pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq"
Jul 02 19:16:10.893807 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:10.893784    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn2nz\" (UniqueName: \"kubernetes.io/projected/752867ab-6548-4e5d-8071-a7425be4d9ff-kube-api-access-cn2nz\") pod \"authorino-6b97fcd9c9-vm7fq\" (UID: \"752867ab-6548-4e5d-8071-a7425be4d9ff\") " pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq"
Jul 02 19:16:11.017530 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:11.017498    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq"
Jul 02 19:16:11.162734 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:11.162691    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b97fcd9c9-vm7fq"]
Jul 02 19:16:11.164052 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:16:11.164029    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod752867ab_6548_4e5d_8071_a7425be4d9ff.slice/crio-783a094c3ebd2259e905f5a103a0089bd72772b44aeba7a9c89432ef0970fe27 WatchSource:0}: Error finding container 783a094c3ebd2259e905f5a103a0089bd72772b44aeba7a9c89432ef0970fe27: Status 404 returned error can't find the container with id 783a094c3ebd2259e905f5a103a0089bd72772b44aeba7a9c89432ef0970fe27
Jul 02 19:16:11.682451 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:11.682423    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq" event={"ID":"752867ab-6548-4e5d-8071-a7425be4d9ff","Type":"ContainerStarted","Data":"783a094c3ebd2259e905f5a103a0089bd72772b44aeba7a9c89432ef0970fe27"}
Jul 02 19:16:12.689221 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:12.689181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq" event={"ID":"752867ab-6548-4e5d-8071-a7425be4d9ff","Type":"ContainerStarted","Data":"f67b7fa518cbeafd82cd4acd884a592e17bb29487948c7da19d0327a827128ea"}
Jul 02 19:16:12.711432 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:12.711362    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b97fcd9c9-vm7fq" podStartSLOduration=2.203337034 podStartE2EDuration="2.711340251s" totalImagesPullingTime="508.003217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:16:12.711174349 +0000 UTC m=+786.016194886" watchObservedRunningTime="2026-07-02 19:16:12.711340251 +0000 UTC m=+786.016360790"
Jul 02 19:16:42.047005 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:42.046919    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:16:51.542579 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:16:51.542548    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:17:01.540869 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:17:01.540814    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:17:08.739089 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:17:08.739050    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:17:17.444557 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:17:17.444515    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:17:27.042396 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:17:27.042360    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:17:50.734006 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:17:50.733969    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:18:01.648202 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:18:01.648163    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:18:14.334857 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:18:14.334807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:18:31.942606 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:18:31.942561    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:18:38.945643 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:18:38.945607    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:18:49.134187 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:18:49.134147    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:18:54.838776 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:18:54.838742    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:19:05.239411 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:19:05.239374    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:19:15.743818 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:19:15.743783    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:19:27.037464 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:19:27.037424    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:19:36.451387 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:19:36.451290    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:19:59.738029 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:19:59.737993    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:20:10.541407 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:20:10.541368    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:20:35.139296 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:20:35.139258    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:20:47.052598 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:20:47.052562    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:21:02.351175 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:21:02.351141    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:21:12.939152 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:21:12.939103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:21:21.564827 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:21:21.564789    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:21:30.843014 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:21:30.842974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:21:40.751514 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:21:40.751471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:23:30.346975 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:23:30.346928    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:23:39.051113 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:23:39.051061    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:23:54.235569 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:23:54.235527    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:24:00.846875 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:24:00.844206    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:24:09.837813 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:24:09.837774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:24:18.442994 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:24:18.442948    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:24:29.363944 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:24:29.363903    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:24:41.133066 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:24:41.133028    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:24:49.540042 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:24:49.540002    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:24:59.843643 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:24:59.843602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:25:11.847336 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:25:11.847298    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:25:19.135850 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:25:19.135798    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:25:45.532573 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:25:45.532487    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:25:52.885617 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:25:52.885579    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:26:02.237063 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:26:02.237028    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:26:12.543244 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:26:12.543201    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:26:19.838723 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:26:19.838679    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:26:30.037068 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:26:30.037027    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:26:40.635537 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:26:40.635497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:26:49.342949 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:26:49.342905    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:26:58.937221 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:26:58.937122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:27:07.543144 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:27:07.543106    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:27:16.474447 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:27:16.474412    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:27:30.645880 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:27:30.645816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:27:39.147476 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:27:39.147430    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:27:49.841649 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:27:49.841606    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:28:01.239697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:28:01.239663    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:28:11.240210 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:28:11.240178    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:28:19.537776 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:28:19.537732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:28:30.243700 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:28:30.243604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:28:39.336159 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:28:39.336117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:28:47.940718 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:28:47.940679    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:28:55.948537 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:28:55.948501    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:29:08.059106 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:29:08.059062    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:29:16.736908 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:29:16.736875    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:29:25.337183 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:29:25.337141    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:29:42.842810 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:29:42.842773    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:29:54.358682 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:29:54.358641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:30:03.042012 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:30:03.041962    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:30:10.740030 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:30:10.739991    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:31:32.941298 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:31:32.941212    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:31:40.633104 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:31:40.633066    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:31:46.953251 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:31:46.953213    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:31:55.641147 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:31:55.641114    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:32:06.050559 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:06.050526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:32:36.679749 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:36.679703    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:32:47.762521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.762479    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"]
Jul 02 19:32:47.765743 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.765720    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.770110 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.770088    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-197dee99\"/\"e2e-lifecycle-model-197dee99-kserve-self-signed-certs\""
Jul 02 19:32:47.770249 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.770117    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-197dee99\"/\"openshift-service-ca.crt\""
Jul 02 19:32:47.770249 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.770199    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-197dee99\"/\"kube-root-ca.crt\""
Jul 02 19:32:47.770249 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.770206    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-197dee99\"/\"default-dockercfg-xqh5t\""
Jul 02 19:32:47.777275 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.777251    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"]
Jul 02 19:32:47.865055 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.865009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-home\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.865241 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.865070    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tmp-dir\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.865241 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.865107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tls-certs\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.865241 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.865205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f52q\" (UniqueName: \"kubernetes.io/projected/ed18f8d6-ebda-456e-9764-f20d4d1ba860-kube-api-access-6f52q\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.865388 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.865241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-dshm\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.865388 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.865281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-model-cache\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.966501 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.966455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tmp-dir\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.966501 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.966500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tls-certs\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.966748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.966548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f52q\" (UniqueName: \"kubernetes.io/projected/ed18f8d6-ebda-456e-9764-f20d4d1ba860-kube-api-access-6f52q\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.966748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.966586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-dshm\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.966748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.966634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-model-cache\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.966748 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.966688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-home\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.967063 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.967037    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tmp-dir\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.967132 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.967081    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-model-cache\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.967132 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.967107    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-home\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.969076 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.969053    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-dshm\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.969287 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.969266    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tls-certs\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:47.976666 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:47.976638    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f52q\" (UniqueName: \"kubernetes.io/projected/ed18f8d6-ebda-456e-9764-f20d4d1ba860-kube-api-access-6f52q\") pod \"e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") " pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:48.074982 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:48.074942    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:48.215758 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:48.215690    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"]
Jul 02 19:32:48.218042 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:32:48.218014    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded18f8d6_ebda_456e_9764_f20d4d1ba860.slice/crio-5deabcba7a7febcd0844c6452dfb5c4701a57457e674c81e8fda36c9f6e6508c WatchSource:0}: Error finding container 5deabcba7a7febcd0844c6452dfb5c4701a57457e674c81e8fda36c9f6e6508c: Status 404 returned error can't find the container with id 5deabcba7a7febcd0844c6452dfb5c4701a57457e674c81e8fda36c9f6e6508c
Jul 02 19:32:48.348218 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:48.348124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p" event={"ID":"ed18f8d6-ebda-456e-9764-f20d4d1ba860","Type":"ContainerStarted","Data":"244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46"}
Jul 02 19:32:48.348218 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:48.348178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p" event={"ID":"ed18f8d6-ebda-456e-9764-f20d4d1ba860","Type":"ContainerStarted","Data":"5deabcba7a7febcd0844c6452dfb5c4701a57457e674c81e8fda36c9f6e6508c"}
Jul 02 19:32:48.367799 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:48.367743    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p" podStartSLOduration=1.367721983 podStartE2EDuration="1.367721983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:32:48.366044881 +0000 UTC m=+1781.671065411" watchObservedRunningTime="2026-07-02 19:32:48.367721983 +0000 UTC m=+1781.672742523"
Jul 02 19:32:51.045610 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:51.045575    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:32:58.075128 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:58.075036    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:58.075128 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:58.075091    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:58.087800 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:58.087769    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:32:58.407080 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:32:58.406984    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:33:12.633880 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:12.633821    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:33:24.145909 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:24.145866    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:33:24.214356 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:24.214308    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"]
Jul 02 19:33:39.235805 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.235738    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p" podUID="ed18f8d6-ebda-456e-9764-f20d4d1ba860" containerName="main" containerID="cri-o://244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46" gracePeriod=45
Jul 02 19:33:39.496100 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.496028    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:33:39.542405 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542363    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-model-cache\") pod \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") "
Jul 02 19:33:39.542591 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542440    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-home\") pod \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") "
Jul 02 19:33:39.542591 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542461    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f52q\" (UniqueName: \"kubernetes.io/projected/ed18f8d6-ebda-456e-9764-f20d4d1ba860-kube-api-access-6f52q\") pod \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") "
Jul 02 19:33:39.542591 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542493    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tmp-dir\") pod \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") "
Jul 02 19:33:39.542591 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542564    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tls-certs\") pod \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") "
Jul 02 19:33:39.542798 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542593    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-dshm\") pod \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\" (UID: \"ed18f8d6-ebda-456e-9764-f20d4d1ba860\") "
Jul 02 19:33:39.542798 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542675    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed18f8d6-ebda-456e-9764-f20d4d1ba860" (UID: "ed18f8d6-ebda-456e-9764-f20d4d1ba860"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:39.542798 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542747    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-home" (OuterVolumeSpecName: "home") pod "ed18f8d6-ebda-456e-9764-f20d4d1ba860" (UID: "ed18f8d6-ebda-456e-9764-f20d4d1ba860"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:39.543380 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542869    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed18f8d6-ebda-456e-9764-f20d4d1ba860" (UID: "ed18f8d6-ebda-456e-9764-f20d4d1ba860"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:39.543380 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542966    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-model-cache\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:33:39.543380 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542983    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-home\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:33:39.543380 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.542996    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tmp-dir\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:33:39.545040 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.545011    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed18f8d6-ebda-456e-9764-f20d4d1ba860-kube-api-access-6f52q" (OuterVolumeSpecName: "kube-api-access-6f52q") pod "ed18f8d6-ebda-456e-9764-f20d4d1ba860" (UID: "ed18f8d6-ebda-456e-9764-f20d4d1ba860"). InnerVolumeSpecName "kube-api-access-6f52q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:33:39.545160 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.545038    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed18f8d6-ebda-456e-9764-f20d4d1ba860" (UID: "ed18f8d6-ebda-456e-9764-f20d4d1ba860"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:33:39.545160 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.545106    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-dshm" (OuterVolumeSpecName: "dshm") pod "ed18f8d6-ebda-456e-9764-f20d4d1ba860" (UID: "ed18f8d6-ebda-456e-9764-f20d4d1ba860"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:33:39.583578 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.583544    2577 generic.go:356] "Generic (PLEG): container finished" podID="ed18f8d6-ebda-456e-9764-f20d4d1ba860" containerID="244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46" exitCode=0
Jul 02 19:33:39.583782 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.583593    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"
Jul 02 19:33:39.583782 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.583643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p" event={"ID":"ed18f8d6-ebda-456e-9764-f20d4d1ba860","Type":"ContainerDied","Data":"244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46"}
Jul 02 19:33:39.583782 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.583694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p" event={"ID":"ed18f8d6-ebda-456e-9764-f20d4d1ba860","Type":"ContainerDied","Data":"5deabcba7a7febcd0844c6452dfb5c4701a57457e674c81e8fda36c9f6e6508c"}
Jul 02 19:33:39.583782 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.583718    2577 scope.go:117] "RemoveContainer" containerID="244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46"
Jul 02 19:33:39.593732 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.593714    2577 scope.go:117] "RemoveContainer" containerID="244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46"
Jul 02 19:33:39.594094 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:33:39.594073    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46\": container with ID starting with 244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46 not found: ID does not exist" containerID="244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46"
Jul 02 19:33:39.594172 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.594104    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46"} err="failed to get container status \"244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46\": rpc error: code = NotFound desc = could not find container \"244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46\": container with ID starting with 244d9ab99f4a3cfeb6179af7484364f4da7e65c6edfd03a01786666f9d91da46 not found: ID does not exist"
Jul 02 19:33:39.604742 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.604714    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"]
Jul 02 19:33:39.607979 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.607955    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-197dee99/e2e-lifecycle-model-197dee99-kserve-69f5c4dc87-89n7p"]
Jul 02 19:33:39.643697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.643653    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f52q\" (UniqueName: \"kubernetes.io/projected/ed18f8d6-ebda-456e-9764-f20d4d1ba860-kube-api-access-6f52q\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:33:39.643697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.643688    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed18f8d6-ebda-456e-9764-f20d4d1ba860-tls-certs\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:33:39.643697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:39.643708    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed18f8d6-ebda-456e-9764-f20d4d1ba860-dshm\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:33:41.237933 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:33:41.237898    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed18f8d6-ebda-456e-9764-f20d4d1ba860" path="/var/lib/kubelet/pods/ed18f8d6-ebda-456e-9764-f20d4d1ba860/volumes"
Jul 02 19:34:03.838176 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:34:03.838139    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:35:12.734199 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:12.734163    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:35:23.238753 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:23.238714    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:35:36.447595 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.447561    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"]
Jul 02 19:35:36.448198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.447909    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed18f8d6-ebda-456e-9764-f20d4d1ba860" containerName="main"
Jul 02 19:35:36.448198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.447921    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed18f8d6-ebda-456e-9764-f20d4d1ba860" containerName="main"
Jul 02 19:35:36.448198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.447988    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed18f8d6-ebda-456e-9764-f20d4d1ba860" containerName="main"
Jul 02 19:35:36.451233 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.451216    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.455285 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.455260    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fd9e49\"/\"kube-root-ca.crt\""
Jul 02 19:35:36.455417 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.455287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fd9e49\"/\"default-dockercfg-q5vjw\""
Jul 02 19:35:36.455417 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.455315    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-fd9e49\"/\"openshift-service-ca.crt\""
Jul 02 19:35:36.455417 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.455260    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-fd9e49\"/\"test-model-fd9e49-kserve-self-signed-certs\""
Jul 02 19:35:36.459908 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.459886    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"]
Jul 02 19:35:36.600594 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.600545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-dshm\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.600779 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.600605    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpgnc\" (UniqueName: \"kubernetes.io/projected/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-kube-api-access-gpgnc\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.600779 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.600716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tls-certs\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.600779 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.600759    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tmp-dir\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.600958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.600791    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-home\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.600958 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.600816    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-model-cache\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.701544 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.701449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-model-cache\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.701544 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.701507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-dshm\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.701544 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.701530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpgnc\" (UniqueName: \"kubernetes.io/projected/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-kube-api-access-gpgnc\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.701875 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.701563    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tls-certs\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.701875 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.701586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tmp-dir\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.701875 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.701607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-home\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.702053 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.701937    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-model-cache\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.702053 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.701980    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-home\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.702128 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.702063    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tmp-dir\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.704055 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.704033    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-dshm\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.704230 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.704213    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tls-certs\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.714734 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.714706    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpgnc\" (UniqueName: \"kubernetes.io/projected/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-kube-api-access-gpgnc\") pod \"test-model-fd9e49-kserve-7fb7f67dc5-gmqtl\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") " pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.760944 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.760903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:36.902993 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:36.902960    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"]
Jul 02 19:35:36.905210 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:35:36.905182    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f8bfe5b_5783_4096_8d75_0f3fb0bad69b.slice/crio-07bf325d0b2b51ffcb8443392386ebeb15f473327785f1f61cb78ce72ff03c95 WatchSource:0}: Error finding container 07bf325d0b2b51ffcb8443392386ebeb15f473327785f1f61cb78ce72ff03c95: Status 404 returned error can't find the container with id 07bf325d0b2b51ffcb8443392386ebeb15f473327785f1f61cb78ce72ff03c95
Jul 02 19:35:37.136020 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:37.135981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl" event={"ID":"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b","Type":"ContainerStarted","Data":"f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750"}
Jul 02 19:35:37.136221 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:37.136028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl" event={"ID":"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b","Type":"ContainerStarted","Data":"07bf325d0b2b51ffcb8443392386ebeb15f473327785f1f61cb78ce72ff03c95"}
Jul 02 19:35:37.160277 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:37.160224    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl" podStartSLOduration=1.160208988 podStartE2EDuration="1.160208988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:35:37.157529997 +0000 UTC m=+1950.462550545" watchObservedRunningTime="2026-07-02 19:35:37.160208988 +0000 UTC m=+1950.465229582"
Jul 02 19:35:41.041458 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:41.041417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:35:46.761737 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:46.761690    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:46.762356 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:46.761794    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:46.774617 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:46.774592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:35:47.195012 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:35:47.194980    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:36:11.555824 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:11.555790    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:36:24.052235 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:24.052191    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:36:31.525591 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:31.525561    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"]
Jul 02 19:36:36.783589 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:36.783551    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:36:46.546816 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.546776    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl" podUID="8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" containerName="main" containerID="cri-o://f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750" gracePeriod=45
Jul 02 19:36:46.795830 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.795799    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:36:46.808072 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808000    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tls-certs\") pod \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") "
Jul 02 19:36:46.808072 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808039    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpgnc\" (UniqueName: \"kubernetes.io/projected/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-kube-api-access-gpgnc\") pod \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") "
Jul 02 19:36:46.808072 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808067    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-home\") pod \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") "
Jul 02 19:36:46.808349 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808147    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tmp-dir\") pod \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") "
Jul 02 19:36:46.808349 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808165    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-dshm\") pod \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") "
Jul 02 19:36:46.808349 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808181    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-model-cache\") pod \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\" (UID: \"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b\") "
Jul 02 19:36:46.808507 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808395    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" (UID: "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:46.808507 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808414    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-home" (OuterVolumeSpecName: "home") pod "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" (UID: "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:46.808588 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.808531    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" (UID: "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:46.810356 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.810332    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-dshm" (OuterVolumeSpecName: "dshm") pod "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" (UID: "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:36:46.810452 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.810385    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-kube-api-access-gpgnc" (OuterVolumeSpecName: "kube-api-access-gpgnc") pod "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" (UID: "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b"). InnerVolumeSpecName "kube-api-access-gpgnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:36:46.810452 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.810430    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" (UID: "8f8bfe5b-5783-4096-8d75-0f3fb0bad69b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:36:46.909045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.909004    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-dshm\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:36:46.909045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.909036    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-model-cache\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:36:46.909045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.909046    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tls-certs\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:36:46.909045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.909054    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpgnc\" (UniqueName: \"kubernetes.io/projected/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-kube-api-access-gpgnc\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:36:46.909316 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.909063    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-home\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:36:46.909316 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:46.909071    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b-tmp-dir\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:36:47.463446 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.463407    2577 generic.go:356] "Generic (PLEG): container finished" podID="8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" containerID="f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750" exitCode=0
Jul 02 19:36:47.463629 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.463455    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"
Jul 02 19:36:47.463629 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.463460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl" event={"ID":"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b","Type":"ContainerDied","Data":"f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750"}
Jul 02 19:36:47.463629 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.463499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl" event={"ID":"8f8bfe5b-5783-4096-8d75-0f3fb0bad69b","Type":"ContainerDied","Data":"07bf325d0b2b51ffcb8443392386ebeb15f473327785f1f61cb78ce72ff03c95"}
Jul 02 19:36:47.463629 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.463521    2577 scope.go:117] "RemoveContainer" containerID="f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750"
Jul 02 19:36:47.472271 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.472251    2577 scope.go:117] "RemoveContainer" containerID="f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750"
Jul 02 19:36:47.472570 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:36:47.472544    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750\": container with ID starting with f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750 not found: ID does not exist" containerID="f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750"
Jul 02 19:36:47.472636 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.472582    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750"} err="failed to get container status \"f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750\": rpc error: code = NotFound desc = could not find container \"f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750\": container with ID starting with f5cef70928c2ef5a7ddea5b6fd1ce8b73bf8fe8c34e796d24ab1b5df4802e750 not found: ID does not exist"
Jul 02 19:36:47.482664 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.482636    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"]
Jul 02 19:36:47.486489 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:47.486466    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-fd9e49/test-model-fd9e49-kserve-7fb7f67dc5-gmqtl"]
Jul 02 19:36:49.238343 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:36:49.238310    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" path="/var/lib/kubelet/pods/8f8bfe5b-5783-4096-8d75-0f3fb0bad69b/volumes"
Jul 02 19:37:19.938287 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:37:19.938248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:37:33.888386 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:37:33.888284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:37:44.748114 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:37:44.748076    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:37:55.033987 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:37:55.033949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:38:04.235410 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:04.235374    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:38:15.981501 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:15.981463    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:38:32.363764 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.363722    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"]
Jul 02 19:38:32.364288 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.364272    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" containerName="main"
Jul 02 19:38:32.364351 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.364293    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" containerName="main"
Jul 02 19:38:32.364397 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.364385    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f8bfe5b-5783-4096-8d75-0f3fb0bad69b" containerName="main"
Jul 02 19:38:32.368111 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.368091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.371030 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.371002    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"kube-root-ca.crt\""
Jul 02 19:38:32.372231 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.372211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"openshift-service-ca.crt\""
Jul 02 19:38:32.372337 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.372253    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"auth-test-model-74b95c-kserve-self-signed-certs\""
Jul 02 19:38:32.372337 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.372318    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"default-dockercfg-9f427\""
Jul 02 19:38:32.378619 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.378589    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"]
Jul 02 19:38:32.451964 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.451919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tmp-dir\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.451964 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.451971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-home\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.452203 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.451993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-model-cache\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.452203 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.452040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tls-certs\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.452203 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.452099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-dshm\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.452203 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.452130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95lqk\" (UniqueName: \"kubernetes.io/projected/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-kube-api-access-95lqk\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.552612 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.552569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tmp-dir\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.552612 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.552622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-home\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.552884 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.552642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-model-cache\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.552884 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.552693    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tls-certs\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.552884 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.552733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-dshm\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.552884 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.552758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95lqk\" (UniqueName: \"kubernetes.io/projected/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-kube-api-access-95lqk\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.553152 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.553126    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tmp-dir\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.553222 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.553145    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-home\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.553273 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.553214    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-model-cache\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.555226 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.555205    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-dshm\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.555481 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.555465    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tls-certs\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.561341 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.561318    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95lqk\" (UniqueName: \"kubernetes.io/projected/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-kube-api-access-95lqk\") pod \"auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") " pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.678185 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.678079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:32.822675 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.822647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"]
Jul 02 19:38:32.825012 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:38:32.824982    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded65d9e9_63bf_43f8_ae0c_8faf0b16a31b.slice/crio-686b3708fb148f5dee1f61cb5a1fbd09bd4dfd0da248d67e3d09bf9a75dc8e53 WatchSource:0}: Error finding container 686b3708fb148f5dee1f61cb5a1fbd09bd4dfd0da248d67e3d09bf9a75dc8e53: Status 404 returned error can't find the container with id 686b3708fb148f5dee1f61cb5a1fbd09bd4dfd0da248d67e3d09bf9a75dc8e53
Jul 02 19:38:32.950443 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.950333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx" event={"ID":"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b","Type":"ContainerStarted","Data":"a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3"}
Jul 02 19:38:32.950443 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.950386    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx" event={"ID":"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b","Type":"ContainerStarted","Data":"686b3708fb148f5dee1f61cb5a1fbd09bd4dfd0da248d67e3d09bf9a75dc8e53"}
Jul 02 19:38:32.968087 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:32.968033    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx" podStartSLOduration=0.968013864 podStartE2EDuration="968.013864ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:38:32.967254942 +0000 UTC m=+2126.272275480" watchObservedRunningTime="2026-07-02 19:38:32.968013864 +0000 UTC m=+2126.273034402"
Jul 02 19:38:35.537682 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:35.537645    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:38:42.678566 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:42.678522    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:42.678566 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:42.678577    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:42.690980 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:42.690953    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:43.006535 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:43.006451    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:38:55.637705 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:38:55.637662    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:39:11.334686 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:39:11.334646    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:39:27.939147 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:39:27.939112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:39:41.036440 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:39:41.036399    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:39:58.638769 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:39:58.638731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:40:15.544096 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:40:15.544057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:40:33.438149 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:40:33.438035    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:40:46.925454 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:40:46.925412    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"]
Jul 02 19:40:50.430855 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:40:50.430820    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:41:01.947561 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:01.947481    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx" podUID="ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" containerName="main" containerID="cri-o://a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3" gracePeriod=45
Jul 02 19:41:02.227606 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.227573    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:41:02.333215 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333177    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-model-cache\") pod \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") "
Jul 02 19:41:02.333416 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333240    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95lqk\" (UniqueName: \"kubernetes.io/projected/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-kube-api-access-95lqk\") pod \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") "
Jul 02 19:41:02.333416 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333322    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tls-certs\") pod \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") "
Jul 02 19:41:02.333416 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333345    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-home\") pod \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") "
Jul 02 19:41:02.333416 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333364    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-dshm\") pod \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") "
Jul 02 19:41:02.333416 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333409    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tmp-dir\") pod \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\" (UID: \"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b\") "
Jul 02 19:41:02.333697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333466    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" (UID: "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:02.333697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333572    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-home" (OuterVolumeSpecName: "home") pod "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" (UID: "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:02.333697 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333645    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" (UID: "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:02.333883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333784    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-home\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:41:02.333883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333800    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tmp-dir\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:41:02.333883 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.333815    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-model-cache\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:41:02.336154 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.336112    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-kube-api-access-95lqk" (OuterVolumeSpecName: "kube-api-access-95lqk") pod "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" (UID: "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b"). InnerVolumeSpecName "kube-api-access-95lqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:41:02.337790 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.337763    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" (UID: "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:41:02.337790 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.337774    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-dshm" (OuterVolumeSpecName: "dshm") pod "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" (UID: "ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:41:02.434944 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.434904    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95lqk\" (UniqueName: \"kubernetes.io/projected/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-kube-api-access-95lqk\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:41:02.434944 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.434942    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-tls-certs\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:41:02.434944 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.434953    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b-dshm\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:41:02.635328 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.635288    2577 generic.go:356] "Generic (PLEG): container finished" podID="ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" containerID="a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3" exitCode=0
Jul 02 19:41:02.635541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.635349    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx" event={"ID":"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b","Type":"ContainerDied","Data":"a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3"}
Jul 02 19:41:02.635541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.635356    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"
Jul 02 19:41:02.635541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.635392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx" event={"ID":"ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b","Type":"ContainerDied","Data":"686b3708fb148f5dee1f61cb5a1fbd09bd4dfd0da248d67e3d09bf9a75dc8e53"}
Jul 02 19:41:02.635541 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.635415    2577 scope.go:117] "RemoveContainer" containerID="a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3"
Jul 02 19:41:02.645521 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.645498    2577 scope.go:117] "RemoveContainer" containerID="a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3"
Jul 02 19:41:02.645825 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:41:02.645807    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3\": container with ID starting with a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3 not found: ID does not exist" containerID="a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3"
Jul 02 19:41:02.645946 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.645833    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3"} err="failed to get container status \"a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3\": rpc error: code = NotFound desc = could not find container \"a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3\": container with ID starting with a56babc4efc18c473a0443783a1f78324c0ef148c9d27a08c37f9f188ccec0f3 not found: ID does not exist"
Jul 02 19:41:02.657488 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.657454    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"]
Jul 02 19:41:02.659783 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:02.659753    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/auth-test-model-74b95c-kserve-6f9fbb8f55-4czrx"]
Jul 02 19:41:03.237895 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:03.237831    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" path="/var/lib/kubelet/pods/ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b/volumes"
Jul 02 19:41:10.631605 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:10.631563    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:41:15.229300 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.229265    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"]
Jul 02 19:41:15.229680 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.229602    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" containerName="main"
Jul 02 19:41:15.229680 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.229612    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" containerName="main"
Jul 02 19:41:15.229680 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.229677    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed65d9e9-63bf-43f8-ae0c-8faf0b16a31b" containerName="main"
Jul 02 19:41:15.232675 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.232655    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.237743 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.237676    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8e566a\"/\"default-dockercfg-fzmtc\""
Jul 02 19:41:15.237743 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.237690    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-8e566a\"/\"sub-test-model-8e566a-kserve-self-signed-certs\""
Jul 02 19:41:15.237743 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.237676    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8e566a\"/\"openshift-service-ca.crt\""
Jul 02 19:41:15.237743 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.237745    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-8e566a\"/\"kube-root-ca.crt\""
Jul 02 19:41:15.246084 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.246057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"]
Jul 02 19:41:15.352003 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.351956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b236c6d2-bf38-4997-8e63-0a77d6713604-tls-certs\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.352189 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.352038    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-model-cache\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.352189 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.352083    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-tmp-dir\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.352189 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.352133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-home\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.352189 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.352187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-dshm\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.352337 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.352205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdlzv\" (UniqueName: \"kubernetes.io/projected/b236c6d2-bf38-4997-8e63-0a77d6713604-kube-api-access-jdlzv\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.452907 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.452864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-dshm\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.453085 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.452912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdlzv\" (UniqueName: \"kubernetes.io/projected/b236c6d2-bf38-4997-8e63-0a77d6713604-kube-api-access-jdlzv\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.453085 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.453010    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b236c6d2-bf38-4997-8e63-0a77d6713604-tls-certs\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.453085 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.453064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-model-cache\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.453229 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.453104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-tmp-dir\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.453229 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.453130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-home\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.453482 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.453456    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-model-cache\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.453482 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.453471    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-home\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.453580 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.453529    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-tmp-dir\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.455401 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.455372    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-dshm\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.455589 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.455574    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b236c6d2-bf38-4997-8e63-0a77d6713604-tls-certs\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.461205 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.461183    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdlzv\" (UniqueName: \"kubernetes.io/projected/b236c6d2-bf38-4997-8e63-0a77d6713604-kube-api-access-jdlzv\") pod \"sub-test-model-8e566a-kserve-757859b8bf-mt27n\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") " pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.542198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.542159    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:15.678624 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.678598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"]
Jul 02 19:41:15.680803 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:41:15.680772    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb236c6d2_bf38_4997_8e63_0a77d6713604.slice/crio-4419f40b4895db515e597d5bd3bd5f078dac8e8b1c3300ec57989b3f7c9e996c WatchSource:0}: Error finding container 4419f40b4895db515e597d5bd3bd5f078dac8e8b1c3300ec57989b3f7c9e996c: Status 404 returned error can't find the container with id 4419f40b4895db515e597d5bd3bd5f078dac8e8b1c3300ec57989b3f7c9e996c
Jul 02 19:41:15.701978 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:15.701945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n" event={"ID":"b236c6d2-bf38-4997-8e63-0a77d6713604","Type":"ContainerStarted","Data":"4419f40b4895db515e597d5bd3bd5f078dac8e8b1c3300ec57989b3f7c9e996c"}
Jul 02 19:41:16.708579 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:16.708527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n" event={"ID":"b236c6d2-bf38-4997-8e63-0a77d6713604","Type":"ContainerStarted","Data":"f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084"}
Jul 02 19:41:16.725819 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:16.725766    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n" podStartSLOduration=1.72573052 podStartE2EDuration="1.72573052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:41:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:41:16.724279314 +0000 UTC m=+2290.029299853" watchObservedRunningTime="2026-07-02 19:41:16.72573052 +0000 UTC m=+2290.030751113"
Jul 02 19:41:22.231078 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:22.231040    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:41:25.542397 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:25.542353    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:25.542880 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:25.542434    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:25.555421 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:25.555399    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:25.764164 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:25.764130    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:41:35.843578 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:35.843525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:41:54.115302 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:54.115269    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"]
Jul 02 19:41:58.139616 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:41:58.139526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:42:09.136349 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.136300    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n" podUID="b236c6d2-bf38-4997-8e63-0a77d6713604" containerName="main" containerID="cri-o://f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084" gracePeriod=45
Jul 02 19:42:09.397833 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.397761    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:42:09.453323 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453289    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-model-cache\") pod \"b236c6d2-bf38-4997-8e63-0a77d6713604\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") "
Jul 02 19:42:09.453514 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453362    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-tmp-dir\") pod \"b236c6d2-bf38-4997-8e63-0a77d6713604\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") "
Jul 02 19:42:09.453514 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453400    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-dshm\") pod \"b236c6d2-bf38-4997-8e63-0a77d6713604\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") "
Jul 02 19:42:09.453514 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453433    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-home\") pod \"b236c6d2-bf38-4997-8e63-0a77d6713604\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") "
Jul 02 19:42:09.453514 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453462    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b236c6d2-bf38-4997-8e63-0a77d6713604-tls-certs\") pod \"b236c6d2-bf38-4997-8e63-0a77d6713604\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") "
Jul 02 19:42:09.453514 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453514    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdlzv\" (UniqueName: \"kubernetes.io/projected/b236c6d2-bf38-4997-8e63-0a77d6713604-kube-api-access-jdlzv\") pod \"b236c6d2-bf38-4997-8e63-0a77d6713604\" (UID: \"b236c6d2-bf38-4997-8e63-0a77d6713604\") "
Jul 02 19:42:09.453792 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453553    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-model-cache" (OuterVolumeSpecName: "model-cache") pod "b236c6d2-bf38-4997-8e63-0a77d6713604" (UID: "b236c6d2-bf38-4997-8e63-0a77d6713604"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:09.453792 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453662    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b236c6d2-bf38-4997-8e63-0a77d6713604" (UID: "b236c6d2-bf38-4997-8e63-0a77d6713604"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:09.453792 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453688    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-home" (OuterVolumeSpecName: "home") pod "b236c6d2-bf38-4997-8e63-0a77d6713604" (UID: "b236c6d2-bf38-4997-8e63-0a77d6713604"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:09.453960 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453815    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-home\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:42:09.453960 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453835    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-model-cache\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:42:09.453960 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.453882    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-tmp-dir\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:42:09.455879 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.455824    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-dshm" (OuterVolumeSpecName: "dshm") pod "b236c6d2-bf38-4997-8e63-0a77d6713604" (UID: "b236c6d2-bf38-4997-8e63-0a77d6713604"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:42:09.455998 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.455889    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b236c6d2-bf38-4997-8e63-0a77d6713604-kube-api-access-jdlzv" (OuterVolumeSpecName: "kube-api-access-jdlzv") pod "b236c6d2-bf38-4997-8e63-0a77d6713604" (UID: "b236c6d2-bf38-4997-8e63-0a77d6713604"). InnerVolumeSpecName "kube-api-access-jdlzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:42:09.455998 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.455888    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b236c6d2-bf38-4997-8e63-0a77d6713604-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b236c6d2-bf38-4997-8e63-0a77d6713604" (UID: "b236c6d2-bf38-4997-8e63-0a77d6713604"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:42:09.554970 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.554923    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdlzv\" (UniqueName: \"kubernetes.io/projected/b236c6d2-bf38-4997-8e63-0a77d6713604-kube-api-access-jdlzv\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:42:09.554970 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.554962    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b236c6d2-bf38-4997-8e63-0a77d6713604-dshm\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:42:09.554970 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.554975    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b236c6d2-bf38-4997-8e63-0a77d6713604-tls-certs\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:42:09.959027 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.958990    2577 generic.go:356] "Generic (PLEG): container finished" podID="b236c6d2-bf38-4997-8e63-0a77d6713604" containerID="f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084" exitCode=0
Jul 02 19:42:09.959231 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.959040    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"
Jul 02 19:42:09.959231 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.959076    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n" event={"ID":"b236c6d2-bf38-4997-8e63-0a77d6713604","Type":"ContainerDied","Data":"f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084"}
Jul 02 19:42:09.959231 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.959121    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n" event={"ID":"b236c6d2-bf38-4997-8e63-0a77d6713604","Type":"ContainerDied","Data":"4419f40b4895db515e597d5bd3bd5f078dac8e8b1c3300ec57989b3f7c9e996c"}
Jul 02 19:42:09.959231 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.959141    2577 scope.go:117] "RemoveContainer" containerID="f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084"
Jul 02 19:42:09.968486 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.968466    2577 scope.go:117] "RemoveContainer" containerID="f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084"
Jul 02 19:42:09.968778 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:42:09.968761    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084\": container with ID starting with f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084 not found: ID does not exist" containerID="f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084"
Jul 02 19:42:09.968881 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.968787    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084"} err="failed to get container status \"f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084\": rpc error: code = NotFound desc = could not find container \"f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084\": container with ID starting with f8f845479263f33577b1903d13a8265f98283b3418d7defad6b5497e57ed0084 not found: ID does not exist"
Jul 02 19:42:09.980723 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.980692    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"]
Jul 02 19:42:09.984456 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:09.984432    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-8e566a/sub-test-model-8e566a-kserve-757859b8bf-mt27n"]
Jul 02 19:42:11.146581 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.146543    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"]
Jul 02 19:42:11.147077 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.146918    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b236c6d2-bf38-4997-8e63-0a77d6713604" containerName="main"
Jul 02 19:42:11.147077 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.146929    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b236c6d2-bf38-4997-8e63-0a77d6713604" containerName="main"
Jul 02 19:42:11.147077 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.147000    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b236c6d2-bf38-4997-8e63-0a77d6713604" containerName="main"
Jul 02 19:42:11.151433 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.151409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.154374 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.154351    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"kube-root-ca.crt\""
Jul 02 19:42:11.155450 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.155422    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"openshift-service-ca.crt\""
Jul 02 19:42:11.155564 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.155468    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"default-dockercfg-9f427\""
Jul 02 19:42:11.155564 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.155432    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-74b95c\"/\"rate-test-model-74b95c-kserve-self-signed-certs\""
Jul 02 19:42:11.160780 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.160758    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"]
Jul 02 19:42:11.237730 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.237699    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b236c6d2-bf38-4997-8e63-0a77d6713604" path="/var/lib/kubelet/pods/b236c6d2-bf38-4997-8e63-0a77d6713604/volumes"
Jul 02 19:42:11.271172 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.271141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-home\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.271291 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.271178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-dshm\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.271349 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.271313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-model-cache\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.271406 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.271373    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-tmp-dir\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.271406 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.271389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb65072-14ea-47cb-a810-59cd42baaf89-tls-certs\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.271515 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.271479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nhv6\" (UniqueName: \"kubernetes.io/projected/dbb65072-14ea-47cb-a810-59cd42baaf89-kube-api-access-6nhv6\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.372946 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.372906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-tmp-dir\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.372946 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.372948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb65072-14ea-47cb-a810-59cd42baaf89-tls-certs\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.373204 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.373081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nhv6\" (UniqueName: \"kubernetes.io/projected/dbb65072-14ea-47cb-a810-59cd42baaf89-kube-api-access-6nhv6\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.373204 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.373120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-home\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.373204 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.373143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-dshm\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.373368 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.373240    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-model-cache\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.373368 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.373334    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-tmp-dir\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.373470 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.373436    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-home\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.373591 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.373571    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-model-cache\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.375542 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.375520    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-dshm\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.375866 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.375817    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb65072-14ea-47cb-a810-59cd42baaf89-tls-certs\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.382046 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.382024    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nhv6\" (UniqueName: \"kubernetes.io/projected/dbb65072-14ea-47cb-a810-59cd42baaf89-kube-api-access-6nhv6\") pod \"rate-test-model-74b95c-kserve-b5fdcddc-dmvwh\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") " pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.461433 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.461337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:11.604154 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.604090    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"]
Jul 02 19:42:11.606985 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:42:11.606956    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbb65072_14ea_47cb_a810_59cd42baaf89.slice/crio-2407c78a2c100d700c17e7f04ea71309236fdb49dc10cb30d78b326b6ae43a70 WatchSource:0}: Error finding container 2407c78a2c100d700c17e7f04ea71309236fdb49dc10cb30d78b326b6ae43a70: Status 404 returned error can't find the container with id 2407c78a2c100d700c17e7f04ea71309236fdb49dc10cb30d78b326b6ae43a70
Jul 02 19:42:11.971011 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.970976    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh" event={"ID":"dbb65072-14ea-47cb-a810-59cd42baaf89","Type":"ContainerStarted","Data":"8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85"}
Jul 02 19:42:11.971194 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.971024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh" event={"ID":"dbb65072-14ea-47cb-a810-59cd42baaf89","Type":"ContainerStarted","Data":"2407c78a2c100d700c17e7f04ea71309236fdb49dc10cb30d78b326b6ae43a70"}
Jul 02 19:42:11.989403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:11.989347    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh" podStartSLOduration=0.989330565 podStartE2EDuration="989.330565ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:42:11.987579493 +0000 UTC m=+2345.292600028" watchObservedRunningTime="2026-07-02 19:42:11.989330565 +0000 UTC m=+2345.294351101"
Jul 02 19:42:14.954066 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:14.954024    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:42:21.461991 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:21.461942    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:21.462508 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:21.462005    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:21.474795 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:21.474765    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:42:22.030987 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:42:22.030955    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:43:06.064415 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:06.064377    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:43:19.144328 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:19.144278    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:43:34.542606 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:34.542513    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:43:41.076158 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:41.076119    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"]
Jul 02 19:43:47.452351 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:47.452301    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:43:56.097086 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.097041    2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh" podUID="dbb65072-14ea-47cb-a810-59cd42baaf89" containerName="main" containerID="cri-o://8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85" gracePeriod=45
Jul 02 19:43:56.339051 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.339026    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:43:56.415014 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.414918    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nhv6\" (UniqueName: \"kubernetes.io/projected/dbb65072-14ea-47cb-a810-59cd42baaf89-kube-api-access-6nhv6\") pod \"dbb65072-14ea-47cb-a810-59cd42baaf89\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") "
Jul 02 19:43:56.415014 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.414969    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-model-cache\") pod \"dbb65072-14ea-47cb-a810-59cd42baaf89\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") "
Jul 02 19:43:56.415256 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.415019    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-dshm\") pod \"dbb65072-14ea-47cb-a810-59cd42baaf89\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") "
Jul 02 19:43:56.415256 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.415070    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb65072-14ea-47cb-a810-59cd42baaf89-tls-certs\") pod \"dbb65072-14ea-47cb-a810-59cd42baaf89\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") "
Jul 02 19:43:56.415256 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.415087    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-home\") pod \"dbb65072-14ea-47cb-a810-59cd42baaf89\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") "
Jul 02 19:43:56.415256 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.415121    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-tmp-dir\") pod \"dbb65072-14ea-47cb-a810-59cd42baaf89\" (UID: \"dbb65072-14ea-47cb-a810-59cd42baaf89\") "
Jul 02 19:43:56.415448 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.415289    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-model-cache" (OuterVolumeSpecName: "model-cache") pod "dbb65072-14ea-47cb-a810-59cd42baaf89" (UID: "dbb65072-14ea-47cb-a810-59cd42baaf89"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:56.415448 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.415390    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-model-cache\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:43:56.415448 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.415393    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-home" (OuterVolumeSpecName: "home") pod "dbb65072-14ea-47cb-a810-59cd42baaf89" (UID: "dbb65072-14ea-47cb-a810-59cd42baaf89"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:56.415596 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.415468    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dbb65072-14ea-47cb-a810-59cd42baaf89" (UID: "dbb65072-14ea-47cb-a810-59cd42baaf89"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:56.417288 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.417261    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-dshm" (OuterVolumeSpecName: "dshm") pod "dbb65072-14ea-47cb-a810-59cd42baaf89" (UID: "dbb65072-14ea-47cb-a810-59cd42baaf89"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:43:56.417411 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.417309    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb65072-14ea-47cb-a810-59cd42baaf89-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dbb65072-14ea-47cb-a810-59cd42baaf89" (UID: "dbb65072-14ea-47cb-a810-59cd42baaf89"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:43:56.417411 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.417316    2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb65072-14ea-47cb-a810-59cd42baaf89-kube-api-access-6nhv6" (OuterVolumeSpecName: "kube-api-access-6nhv6") pod "dbb65072-14ea-47cb-a810-59cd42baaf89" (UID: "dbb65072-14ea-47cb-a810-59cd42baaf89"). InnerVolumeSpecName "kube-api-access-6nhv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:43:56.460403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.460280    2577 generic.go:356] "Generic (PLEG): container finished" podID="dbb65072-14ea-47cb-a810-59cd42baaf89" containerID="8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85" exitCode=0
Jul 02 19:43:56.460403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.460344    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"
Jul 02 19:43:56.460403 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.460379    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh" event={"ID":"dbb65072-14ea-47cb-a810-59cd42baaf89","Type":"ContainerDied","Data":"8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85"}
Jul 02 19:43:56.470351 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.460432    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh" event={"ID":"dbb65072-14ea-47cb-a810-59cd42baaf89","Type":"ContainerDied","Data":"2407c78a2c100d700c17e7f04ea71309236fdb49dc10cb30d78b326b6ae43a70"}
Jul 02 19:43:56.470351 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.460453    2577 scope.go:117] "RemoveContainer" containerID="8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85"
Jul 02 19:43:56.470351 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.469179    2577 scope.go:117] "RemoveContainer" containerID="8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85"
Jul 02 19:43:56.470351 ip-10-0-131-135 kubenswrapper[2577]: E0702 19:43:56.469466    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85\": container with ID starting with 8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85 not found: ID does not exist" containerID="8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85"
Jul 02 19:43:56.470351 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.469492    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85"} err="failed to get container status \"8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85\": rpc error: code = NotFound desc = could not find container \"8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85\": container with ID starting with 8250700fb420560daddfec33157f1efea8a935241c93d3f819b86076816d2a85 not found: ID does not exist"
Jul 02 19:43:56.481913 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.481831    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"]
Jul 02 19:43:56.488098 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.488073    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-74b95c/rate-test-model-74b95c-kserve-b5fdcddc-dmvwh"]
Jul 02 19:43:56.515909 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.515879    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nhv6\" (UniqueName: \"kubernetes.io/projected/dbb65072-14ea-47cb-a810-59cd42baaf89-kube-api-access-6nhv6\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:43:56.515909 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.515906    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-dshm\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:43:56.516062 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.515917    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbb65072-14ea-47cb-a810-59cd42baaf89-tls-certs\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:43:56.516062 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.515926    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-home\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:43:56.516062 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:56.515933    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dbb65072-14ea-47cb-a810-59cd42baaf89-tmp-dir\") on node \"ip-10-0-131-135.ec2.internal\" DevicePath \"\""
Jul 02 19:43:57.237689 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:43:57.237593    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb65072-14ea-47cb-a810-59cd42baaf89" path="/var/lib/kubelet/pods/dbb65072-14ea-47cb-a810-59cd42baaf89/volumes"
Jul 02 19:44:30.149077 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:30.149033    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rf6ht"]
Jul 02 19:44:34.225034 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:34.225002    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b97fcd9c9-vm7fq_752867ab-6548-4e5d-8071-a7425be4d9ff/authorino/0.log"
Jul 02 19:44:39.501132 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:39.501101    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb89c69-n9sf5_663e855f-1137-40e0-8ea5-e89c2e5a593f/copy-manifests/0.log"
Jul 02 19:44:39.508422 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:39.508400    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb89c69-n9sf5_663e855f-1137-40e0-8ea5-e89c2e5a593f/manager/0.log"
Jul 02 19:44:40.965022 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:40.964970    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b97fcd9c9-vm7fq_752867ab-6548-4e5d-8071-a7425be4d9ff/authorino/0.log"
Jul 02 19:44:41.667718 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:41.667684    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rf6ht_cfeb62ae-7ebf-4946-a261-5211cec45c42/limitador/0.log"
Jul 02 19:44:41.784166 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:41.784129    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-spxl9_a4be75f8-77fc-49d9-8c57-80fd3c9d5083/manager/0.log"
Jul 02 19:44:42.373812 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:42.373774    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-578747f885-k8c66_4130351d-3433-484c-aa43-e942b64f1fec/kube-auth-proxy/0.log"
Jul 02 19:44:43.657167 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:43.657122    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbr5526_953f209e-d0ae-4d6f-aa34-1fba05ff3012/main/0.log"
Jul 02 19:44:43.785293 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:43.785264    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gctqh_e8ae2989-a185-4467-a550-e962cfa3d66b/main/0.log"
Jul 02 19:44:43.899622 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:43.899587    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-fmbsp_11bba824-b0c1-4777-8ac8-8385c64c3660/main/0.log"
Jul 02 19:44:51.486723 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:51.486690    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hzv6h_9660efa6-60d1-4a9f-92e5-8a51085714cf/global-pull-secret-syncer/0.log"
Jul 02 19:44:51.645573 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:51.645535    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p2rbw_daad7711-32e7-4070-ba51-dfba7bcac052/konnectivity-agent/0.log"
Jul 02 19:44:51.669988 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:51.669958    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-135.ec2.internal_6b9d5e80a9c624391d0c3c32b810d9cd/haproxy/0.log"
Jul 02 19:44:56.990198 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:56.990159    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b97fcd9c9-vm7fq_752867ab-6548-4e5d-8071-a7425be4d9ff/authorino/0.log"
Jul 02 19:44:57.305350 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:57.305319    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rf6ht_cfeb62ae-7ebf-4946-a261-5211cec45c42/limitador/0.log"
Jul 02 19:44:57.380628 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:57.380591    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-spxl9_a4be75f8-77fc-49d9-8c57-80fd3c9d5083/manager/0.log"
Jul 02 19:44:59.748049 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:44:59.747976    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5979df99dc-cmfqr_a40d889b-05f8-4639-a404-fd29fad2cba8/metrics-server/0.log"
Jul 02 19:45:00.000709 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.000635    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzc9h_2f3c21c0-9a67-42a3-9a8b-e3b30b33c197/node-exporter/0.log"
Jul 02 19:45:00.033479 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.033448    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzc9h_2f3c21c0-9a67-42a3-9a8b-e3b30b33c197/kube-rbac-proxy/0.log"
Jul 02 19:45:00.060015 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.059985    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tzc9h_2f3c21c0-9a67-42a3-9a8b-e3b30b33c197/init-textfile/0.log"
Jul 02 19:45:00.209792 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.209752    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8b359a-b29d-4687-816e-63bac52cba94/prometheus/0.log"
Jul 02 19:45:00.234025 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.233996    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8b359a-b29d-4687-816e-63bac52cba94/config-reloader/0.log"
Jul 02 19:45:00.256728 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.256653    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8b359a-b29d-4687-816e-63bac52cba94/thanos-sidecar/0.log"
Jul 02 19:45:00.280273 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.280248    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8b359a-b29d-4687-816e-63bac52cba94/kube-rbac-proxy-web/0.log"
Jul 02 19:45:00.303925 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.303898    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8b359a-b29d-4687-816e-63bac52cba94/kube-rbac-proxy/0.log"
Jul 02 19:45:00.328782 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.328754    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8b359a-b29d-4687-816e-63bac52cba94/kube-rbac-proxy-thanos/0.log"
Jul 02 19:45:00.353012 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.352986    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ec8b359a-b29d-4687-816e-63bac52cba94/init-config-reloader/0.log"
Jul 02 19:45:00.381391 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.381365    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-66gtj_a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab/prometheus-operator/0.log"
Jul 02 19:45:00.402891 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.402864    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-66gtj_a4e41f10-2cc3-4d6c-a3bf-d11d6ac2e6ab/kube-rbac-proxy/0.log"
Jul 02 19:45:00.431268 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:00.431236    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-4dvxh_5af495cf-edcb-4f06-adef-81e390ad59e4/prometheus-operator-admission-webhook/0.log"
Jul 02 19:45:01.936151 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.936118    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"]
Jul 02 19:45:01.936572 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.936493    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb65072-14ea-47cb-a810-59cd42baaf89" containerName="main"
Jul 02 19:45:01.936572 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.936506    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb65072-14ea-47cb-a810-59cd42baaf89" containerName="main"
Jul 02 19:45:01.936646 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.936575    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb65072-14ea-47cb-a810-59cd42baaf89" containerName="main"
Jul 02 19:45:01.939745 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.939728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:01.943401 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.943377    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88s92\"/\"openshift-service-ca.crt\""
Jul 02 19:45:01.944464 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.944448    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-88s92\"/\"default-dockercfg-ll29f\""
Jul 02 19:45:01.944550 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.944502    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88s92\"/\"kube-root-ca.crt\""
Jul 02 19:45:01.955372 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:01.955342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"]
Jul 02 19:45:02.082045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.082002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-podres\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.082045 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.082052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hhdl\" (UniqueName: \"kubernetes.io/projected/56d674a6-7838-440b-b866-415e45f1a2af-kube-api-access-6hhdl\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.082271 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.082113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-sys\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.082271 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.082220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-lib-modules\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.082271 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.082241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-proc\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183488 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-sys\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183655 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-lib-modules\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183655 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183576    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-sys\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183655 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-proc\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183655 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-podres\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183787 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hhdl\" (UniqueName: \"kubernetes.io/projected/56d674a6-7838-440b-b866-415e45f1a2af-kube-api-access-6hhdl\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183787 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183683    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-proc\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183787 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183713    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-lib-modules\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.183915 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.183790    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56d674a6-7838-440b-b866-415e45f1a2af-podres\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.192301 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.192251    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hhdl\" (UniqueName: \"kubernetes.io/projected/56d674a6-7838-440b-b866-415e45f1a2af-kube-api-access-6hhdl\") pod \"perf-node-gather-daemonset-7cjbp\" (UID: \"56d674a6-7838-440b-b866-415e45f1a2af\") " pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.249984 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.249943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.389309 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.389277    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"]
Jul 02 19:45:02.392961 ip-10-0-131-135 kubenswrapper[2577]: W0702 19:45:02.392919    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod56d674a6_7838_440b_b866_415e45f1a2af.slice/crio-9e79faadf6d4f8bcb143c3c79df788fccf3fc660db5811b2561b05383656a4b3 WatchSource:0}: Error finding container 9e79faadf6d4f8bcb143c3c79df788fccf3fc660db5811b2561b05383656a4b3: Status 404 returned error can't find the container with id 9e79faadf6d4f8bcb143c3c79df788fccf3fc660db5811b2561b05383656a4b3
Jul 02 19:45:02.777497 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.777463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp" event={"ID":"56d674a6-7838-440b-b866-415e45f1a2af","Type":"ContainerStarted","Data":"53528b68c16e6312946b6ad82be20af0ccf3e97544894b597168a1a621474e35"}
Jul 02 19:45:02.777665 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.777543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp" event={"ID":"56d674a6-7838-440b-b866-415e45f1a2af","Type":"ContainerStarted","Data":"9e79faadf6d4f8bcb143c3c79df788fccf3fc660db5811b2561b05383656a4b3"}
Jul 02 19:45:02.777665 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.777649    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:02.794988 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:02.794942    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp" podStartSLOduration=1.794927924 podStartE2EDuration="1.794927924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:45:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:45:02.794720114 +0000 UTC m=+2516.099740673" watchObservedRunningTime="2026-07-02 19:45:02.794927924 +0000 UTC m=+2516.099948460"
Jul 02 19:45:03.745726 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:03.745694    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-pxgkb_a1cf4665-a7d6-49eb-9ea9-ec858f56393c/volume-data-source-validator/0.log"
Jul 02 19:45:04.887019 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:04.886987    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zmjh9_b9018a08-409d-419f-aec9-99e32e873a2a/dns/0.log"
Jul 02 19:45:04.909291 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:04.909260    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zmjh9_b9018a08-409d-419f-aec9-99e32e873a2a/kube-rbac-proxy/0.log"
Jul 02 19:45:04.981998 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:04.981967    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dxxf5_51685037-4e29-498f-b7d1-c5ec0ae703dc/dns-node-resolver/0.log"
Jul 02 19:45:05.608451 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:05.608423    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-t4gth_9cf2cc53-d9b7-4938-b30a-53971958348b/node-ca/0.log"
Jul 02 19:45:06.717145 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:06.717113    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-578747f885-k8c66_4130351d-3433-484c-aa43-e942b64f1fec/kube-auth-proxy/0.log"
Jul 02 19:45:07.591152 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:07.591116    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cphb5_1fda4583-47ac-4729-8968-08d0f1c9473c/serve-healthcheck-canary/0.log"
Jul 02 19:45:08.103609 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:08.103566    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-qg7s9_25d5e7bb-b846-431c-8dbe-28dc4951a632/insights-operator/0.log"
Jul 02 19:45:08.104140 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:08.104122    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-qg7s9_25d5e7bb-b846-431c-8dbe-28dc4951a632/insights-operator/1.log"
Jul 02 19:45:08.287666 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:08.287637    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znp2q_5c122118-acd6-4901-ab11-74b2ca8b594a/kube-rbac-proxy/0.log"
Jul 02 19:45:08.311055 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:08.311020    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znp2q_5c122118-acd6-4901-ab11-74b2ca8b594a/exporter/0.log"
Jul 02 19:45:08.333195 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:08.333169    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-znp2q_5c122118-acd6-4901-ab11-74b2ca8b594a/extractor/0.log"
Jul 02 19:45:08.793238 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:08.793205    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-88s92/perf-node-gather-daemonset-7cjbp"
Jul 02 19:45:11.090561 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:11.090523    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb89c69-n9sf5_663e855f-1137-40e0-8ea5-e89c2e5a593f/manager/0.log"
Jul 02 19:45:11.127020 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:11.126988    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cb89c69-n9sf5_663e855f-1137-40e0-8ea5-e89c2e5a593f/copy-manifests/0.log"
Jul 02 19:45:11.949145 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:11.949059    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-578747f885-k8c66_4130351d-3433-484c-aa43-e942b64f1fec/kube-auth-proxy/0.log"
Jul 02 19:45:12.578355 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:12.578326    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-744887b959-ttxw8_ef3bd11b-9cbb-48ec-ac92-ee1844081e12/manager/0.log"
Jul 02 19:45:12.606369 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:12.606339    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bnztb_bc4949ca-7247-4d3b-97b6-32e04de98c18/openshift-lws-operator/0.log"
Jul 02 19:45:13.292569 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:13.292539    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-578747f885-k8c66_4130351d-3433-484c-aa43-e942b64f1fec/kube-auth-proxy/0.log"
Jul 02 19:45:18.828049 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:18.828019    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tcsk_faf38419-9534-4231-a8b5-d4ed655b1a51/kube-multus-additional-cni-plugins/0.log"
Jul 02 19:45:18.851924 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:18.851891    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tcsk_faf38419-9534-4231-a8b5-d4ed655b1a51/egress-router-binary-copy/0.log"
Jul 02 19:45:18.877060 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:18.877032    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tcsk_faf38419-9534-4231-a8b5-d4ed655b1a51/cni-plugins/0.log"
Jul 02 19:45:18.904432 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:18.904406    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tcsk_faf38419-9534-4231-a8b5-d4ed655b1a51/bond-cni-plugin/0.log"
Jul 02 19:45:18.955563 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:18.955532    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tcsk_faf38419-9534-4231-a8b5-d4ed655b1a51/routeoverride-cni/0.log"
Jul 02 19:45:19.008366 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:19.008338    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tcsk_faf38419-9534-4231-a8b5-d4ed655b1a51/whereabouts-cni-bincopy/0.log"
Jul 02 19:45:19.053343 ip-10-0-131-135 kubenswrapper[2577]: I0702 19:45:19.053313    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4tcsk_faf38419-9534-4231-a8b5-d4ed655b1a51/whereabouts-cni/0.log"