Jul 15 20:45:35.607717 ip-10-0-140-96 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 20:45:35.607729 ip-10-0-140-96 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 20:45:35.607739 ip-10-0-140-96 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 20:45:35.607966 ip-10-0-140-96 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 20:45:45.608046 ip-10-0-140-96 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 20:45:45.608067 ip-10-0-140-96 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 516f5c7638934e928310120e19b0c6d3 --
Jul 15 20:47:46.423765 ip-10-0-140-96 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 20:47:46.864688 ip-10-0-140-96 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:47:46.864688 ip-10-0-140-96 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 20:47:46.864688 ip-10-0-140-96 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:47:46.864688 ip-10-0-140-96 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 20:47:46.864688 ip-10-0-140-96 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 20:47:46.866917 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.866813    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 20:47:46.871404 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871387    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:47:46.871404 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871404    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871409    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871413    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871416    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871420    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871423    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871426    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871430    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871433    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871436    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871439    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871442    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871445    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871447    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871451    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871454    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871456    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871459    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871462    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871465    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871468    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:47:46.871479 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871470    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871473    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871476    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871480    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871484    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871487    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871489    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871505    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871508    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871511    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871514    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871518    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871521    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871524    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871527    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871530    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871535    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871539    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871542    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:47:46.872012 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871546    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871548    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871551    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871554    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871557    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871559    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871562    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871565    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871567    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871570    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871573    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871576    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871578    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871581    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871584    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871588    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871591    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871594    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871597    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871600    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:47:46.872487 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871603    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871606    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871609    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871612    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871614    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871617    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871620    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871625    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871629    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871633    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871638    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871641    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871644    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871648    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871651    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871654    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871657    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871660    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871663    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:47:46.873016 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871666    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871668    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871671    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871674    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871677    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871679    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871682    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871685    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871689    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871692    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871695    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871698    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871700    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871703    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871706    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871708    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871711    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871714    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.871717    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872516    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:47:46.873776 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872523    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872527    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872530    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872533    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872536    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872541    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872546    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872551    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872554    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872557    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872560    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872563    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872566    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872570    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872573    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872577    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872579    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872582    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872586    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:47:46.874351 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872588    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872592    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872595    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872597    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872600    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872603    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872606    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872609    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872612    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872616    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872619    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872622    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872625    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872627    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872630    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872633    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872636    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872639    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872642    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872644    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:47:46.874859 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872647    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872650    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872654    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872656    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872659    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872662    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872665    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872668    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872671    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872674    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872677    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872679    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872682    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872685    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872688    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872691    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872694    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872696    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872699    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:47:46.875586 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872702    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872705    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872708    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872711    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872713    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872716    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872719    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872721    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872724    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872727    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872731    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872735    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872739    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872742    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872745    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872748    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872751    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872753    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872756    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872759    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:47:46.876452 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872763    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872766    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872768    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872771    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872774    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872776    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872779    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872782    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872785    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872788    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872790    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872793    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872796    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872799    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872801    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872804    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872807    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872809    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872812    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.872815    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:47:46.877398 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875806    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875821    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875827    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875832    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875838    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875843    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875848    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875854    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875859    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875864    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875868    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875874    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875879    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875884    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875889    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875894    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875899    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875904    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875909    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875914    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:47:46.878254 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875919    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875923    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875929    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875934    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875940    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875945    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875950    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875955    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875960    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875965    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875970    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875975    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875984    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875990    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.875997    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876002    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876007    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876012    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876017    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:47:46.878806 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876022    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876027    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876031    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876039    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876046    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876052    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876057    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876061    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876066    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876071    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876075    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876080    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876084    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876089    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876094    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876098    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876103    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876109    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876113    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:47:46.879386 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876118    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876122    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876127    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876131    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876136    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876140    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876145    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876150    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876155    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876159    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876164    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876169    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876174    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876178    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876183    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876187    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876191    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876196    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876205    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876212    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:47:46.880009 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876217    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876222    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876226    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876231    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876235    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876241    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876246    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876250    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876254    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876259    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876264    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876268    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876272    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876277    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876282    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876287    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876292    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876297    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876301    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876306    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:47:46.880761 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.876310    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876413    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876426    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876445    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876452    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876458    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876463    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876471    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876478    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876504    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876511    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876516    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876523    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876528    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876533    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876538    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876543    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876548    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876555    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876562    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876567    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876573    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876578    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876584    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 20:47:46.881273 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876591    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876596    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876601    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876607    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876612    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876617    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876623    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876629    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876634    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876641    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876646    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876652    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876657    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876662    2565 flags.go:64] FLAG: --enable-server="true"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876667    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876677    2565 flags.go:64] FLAG: --event-burst="100"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876682    2565 flags.go:64] FLAG: --event-qps="50"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876687    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876692    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876697    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876704    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876709    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876715    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876720    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876725    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 20:47:46.882001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876730    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876735    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876741    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876746    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876750    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876756    2565 flags.go:64] FLAG: --feature-gates=""
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876762    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876768    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876773    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876779    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876784    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876789    2565 flags.go:64] FLAG: --help="false"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876794    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-140-96.ec2.internal"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876800    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876805    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876810    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876816    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876821    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876826    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876831    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876836    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876841    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876847    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876852    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 20:47:46.882737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876858    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876863    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876868    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876874    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876880    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876885    2565 flags.go:64] FLAG: --lock-file=""
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876890    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876896    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876901    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876910    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876923    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876929    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876934    2565 flags.go:64] FLAG: --logging-format="text"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876944    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876950    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876955    2565 flags.go:64] FLAG: --manifest-url=""
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876960    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876969    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876974    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876981    2565 flags.go:64] FLAG: --max-pods="110"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876987    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876992    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.876997    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877002    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877008    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 20:47:46.883368 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877013    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877018    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877033    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877038    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877043    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877048    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877053    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877063    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877068    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877074    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877079    2565 flags.go:64] FLAG: --port="10250"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877084    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877090    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ff8bd8b42570f59"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877095    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877100    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877105    2565 flags.go:64] FLAG: --register-node="true"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877111    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877117    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877122    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877128    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877136    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877145    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877150    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877156    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877161    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 20:47:46.884041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877166    2565 flags.go:64] FLAG: --runonce="false"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877171    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877176    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877181    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877187    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877192    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877197    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877202    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877207    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877212    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877217    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877222    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877227    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877233    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877239    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877244    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877254    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877259    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877264    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877271    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877276    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877281    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877286    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877291    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877296    2565 flags.go:64] FLAG: --v="2"
Jul 15 20:47:46.884720 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877304    2565 flags.go:64] FLAG: --version="false"
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877310    2565 flags.go:64] FLAG: --vmodule=""
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877320    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.877329    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877577    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877586    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877592    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877597    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877602    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877607    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877612    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877617    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877621    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877626    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877630    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877635    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877639    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877644    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877649    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877653    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877658    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:47:46.885443 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877662    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877668    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877672    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877676    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877681    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877685    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877691    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877696    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877703    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877710    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877715    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877720    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877725    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877733    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877741    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877747    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877752    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877757    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877762    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:47:46.886047 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877766    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877772    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877776    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877781    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877786    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877790    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877795    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877800    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877805    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877809    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877814    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877819    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877823    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877828    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877833    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877837    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877842    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877846    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877851    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:47:46.886585 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877855    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877860    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877865    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877869    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877874    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877879    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877883    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877889    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877897    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877903    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877908    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877912    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877917    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877922    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877927    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877932    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877936    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877941    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877945    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:47:46.887072 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877952    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877958    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877963    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877968    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877973    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877978    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877983    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877988    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877993    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.877997    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878002    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878007    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878012    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878017    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878022    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878026    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878031    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878035    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878040    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878044    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:47:46.887594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878051    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878057    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878061    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878069    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.878075    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.879047    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.886595    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.886614    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.886638    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.886644    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886720    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886725    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886729    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886734    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:47:46.888219 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886738    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886742    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886745    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886748    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886751    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886753    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886756    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886759    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886761    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886764    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886767    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886770    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886773    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886776    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886778    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886782    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886785    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886787    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886790    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886793    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:47:46.888630 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886796    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886799    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886802    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886806    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886810    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886815    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886818    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886820    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886823    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886826    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886829    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886831    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886834    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886837    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886840    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886843    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886845    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886848    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886850    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:47:46.889144 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886853    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886856    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886859    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886861    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886864    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886867    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886869    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886872    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886875    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886878    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886881    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886884    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886887    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886889    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886892    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886895    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886898    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886901    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886904    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:47:46.889728 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886907    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886910    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886913    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886915    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886918    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886920    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886923    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886926    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886929    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886931    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886934    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886937    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886939    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886942    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886945    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886947    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886950    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886953    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886956    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886958    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:47:46.890225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886961    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886964    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886967    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886970    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886973    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886976    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886978    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886981    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886984    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886987    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886990    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886993    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.886997    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887002    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887005    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887009    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:47:46.890756 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887012    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.887018    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887177    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887182    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887185    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887188    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887191    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887194    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887198    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887201    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887204    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887207    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887210    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887213    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887216    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 20:47:46.891176 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887218    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887221    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887225    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887227    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887231    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887234    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887237    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887240    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887243    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887246    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887249    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887252    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887255    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887257    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887260    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887263    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887266    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887269    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887271    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887274    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 20:47:46.891594 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887277    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887279    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887282    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887285    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887288    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887290    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887293    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887295    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887298    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887301    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887303    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887306    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887309    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887312    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887315    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887318    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887321    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887323    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887326    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 20:47:46.892108 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887329    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887331    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887334    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887337    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887340    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887343    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887346    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887348    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887352    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887357    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887360    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887363    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887366    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887370    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887374    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887377    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887379    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887382    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887385    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 20:47:46.892678 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887388    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887390    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887394    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887399    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887402    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887404    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887407    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887410    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887413    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887416    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887418    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887421    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887424    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887427    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887429    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887432    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887434    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887437    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887440    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887443    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 20:47:46.893186 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887445    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887448    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887451    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887454    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887457    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887459    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887462    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:46.887464    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.887469    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.887619    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.889769    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.891066    2565 server.go:1019] "Starting client certificate rotation"
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.891174    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 20:47:46.893715 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.891930    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 20:47:46.894549 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.894533    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 20:47:46.896056 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.896032    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 20:47:46.905053 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.905038    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 15 20:47:46.907036 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.907012    2565 log.go:25] "Validated CRI v1 image API"
Jul 15 20:47:46.907937 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.907917    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 20:47:46.911647 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.911623    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8c849152-5700-48fd-8840-595b3855ac5e:/dev/nvme0n1p4 d4c1c5d1-9e1c-4244-9ffb-81645e978f84:/dev/nvme0n1p3]
Jul 15 20:47:46.911749 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.911646    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 20:47:46.918472 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.918351    2565 manager.go:216] Machine: {Timestamp:2026-07-15 20:47:46.917791859 +0000 UTC m=+0.367143507 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102196 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23265df39c6a28fc8b46ab7e4bc98c SystemUUID:ec23265d-f39c-6a28-fc8b-46ab7e4bc98c BootID:516f5c76-3893-4e92-8310-120e19b0c6d3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5f:5d:65:e1:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5f:5d:65:e1:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:9d:fa:c4:70:e2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 20:47:46.918472 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.918457    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 20:47:46.918633 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.918559    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 20:47:46.921869 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.921838    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 20:47:46.922052 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.921872    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 20:47:46.923709 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.923696    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 20:47:46.923764 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.923714    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 20:47:46.923764 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.923725    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 20:47:46.924456 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.924446    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 20:47:46.925843 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.925831    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 20:47:46.928619 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.928599    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 20:47:46.929565 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.929553    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 20:47:46.929690 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.929680    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 20:47:46.929723 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.929714    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 20:47:46.929763 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.929725    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 20:47:46.929763 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.929737    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 20:47:46.929763 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.929747    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 15 20:47:46.929763 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.929757    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 20:47:46.930148 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.930134    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 20:47:46.930206 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.930157    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 20:47:46.933474 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.933460    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 20:47:46.935356 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.935342    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 20:47:46.935401 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.935374    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 20:47:46.935565 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.935554    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 20:47:46.935601 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.935571    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 20:47:46.935601 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.935577    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 20:47:46.935601 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.935583    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 20:47:46.935601 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.935591    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 20:47:46.935601 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.935597    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 20:47:46.936107 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.936098    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 20:47:46.936107 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.936107    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 20:47:46.936166 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.936114    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 20:47:46.936166 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.936121    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 20:47:46.936166 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.936141    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 20:47:46.936166 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.936150    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 20:47:46.936287 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.936180    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 20:47:46.936287 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.936186    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 20:47:46.939931 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.939904    2565 server.go:1268] "Started kubelet"
Jul 15 20:47:46.940032 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.939972    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 20:47:46.940220 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.940099    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 20:47:46.940220 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.940190    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 20:47:46.941027 ip-10-0-140-96 systemd[1]: Started Kubernetes Kubelet.
Jul 15 20:47:46.941188 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.941170    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 20:47:46.942415 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.942200    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 20:47:46.947052 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.947029    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 20:47:46.947052 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.947035    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 20:47:46.947186 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.947060    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 20:47:46.947186 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.947109    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 20:47:46.948176 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.947146    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-96.ec2.internal.18c29193ee81deed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-96.ec2.internal,UID:ip-10-0-140-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-96.ec2.internal,},FirstTimestamp:2026-07-15 20:47:46.939846381 +0000 UTC m=+0.389198006,LastTimestamp:2026-07-15 20:47:46.939846381 +0000 UTC m=+0.389198006,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-96.ec2.internal,}"
Jul 15 20:47:46.949298 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.949283    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 20:47:46.949298 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.949293    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 20:47:46.949531 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.949511    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:46.949973 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.949946    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 20:47:46.949973 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.949946    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 20:47:46.950123 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.949985    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 20:47:46.950123 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950077    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 20:47:46.950123 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950089    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 20:47:46.950374 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950353    2565 factory.go:55] Registering systemd factory
Jul 15 20:47:46.950374 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950376    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 15 20:47:46.950714 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950695    2565 factory.go:153] Registering CRI-O factory
Jul 15 20:47:46.950714 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950716    2565 factory.go:223] Registration of the crio container factory successfully
Jul 15 20:47:46.950846 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950767    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 20:47:46.950846 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950790    2565 factory.go:103] Registering Raw factory
Jul 15 20:47:46.950846 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.950801    2565 manager.go:1196] Started watching for new ooms in manager
Jul 15 20:47:46.951196 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.951183    2565 manager.go:349] Starting recovery of all containers
Jul 15 20:47:46.961850 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.961656    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 20:47:46.961994 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.961690    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 20:47:46.964959 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.964940    2565 manager.go:354] Recovery completed
Jul 15 20:47:46.966532 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.966504    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 15 20:47:46.969722 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.969710    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:47:46.972639 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.972615    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:47:46.972708 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.972652    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:47:46.972708 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.972663    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:47:46.973286 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.973267    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 20:47:46.973286 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.973282    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 20:47:46.973401 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.973288    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:47:46.973401 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.973298    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 20:47:46.974703 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.974690    2565 policy_none.go:49] "None policy: Start"
Jul 15 20:47:46.974765 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.974708    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 20:47:46.974765 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.974719    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 20:47:46.975735 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.975721    2565 policy_none.go:47] "Start"
Jul 15 20:47:46.975819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.975803    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:47:46.975855 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.975835    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:47:46.975855 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:46.975849    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:47:46.987428 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.987349    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-96.ec2.internal.18c29193f07639b2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-96.ec2.internal,UID:ip-10-0-140-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-96.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-96.ec2.internal,},FirstTimestamp:2026-07-15 20:47:46.972637618 +0000 UTC m=+0.421989247,LastTimestamp:2026-07-15 20:47:46.972637618 +0000 UTC m=+0.421989247,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-96.ec2.internal,}"
Jul 15 20:47:46.999820 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:46.999606    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-96.ec2.internal.18c29193f0768648  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-96.ec2.internal,UID:ip-10-0-140-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-96.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-96.ec2.internal,},FirstTimestamp:2026-07-15 20:47:46.972657224 +0000 UTC m=+0.422008849,LastTimestamp:2026-07-15 20:47:46.972657224 +0000 UTC m=+0.422008849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-96.ec2.internal,}"
Jul 15 20:47:47.000709 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.000690    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lzq98"
Jul 15 20:47:47.009996 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.009968    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lzq98"
Jul 15 20:47:47.010163 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.010150    2565 manager.go:337] "Starting Device Plugin manager"
Jul 15 20:47:47.010209 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.010187    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 20:47:47.010209 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.010200    2565 server.go:87] "Starting device plugin registration server"
Jul 15 20:47:47.010527 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.010512    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 20:47:47.010604 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.010533    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 20:47:47.010662 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.010629    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 20:47:47.010719 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.010707    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 20:47:47.010769 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.010720    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 20:47:47.010965 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.010833    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-96.ec2.internal.18c29193f076adb9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-96.ec2.internal,UID:ip-10-0-140-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-96.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-96.ec2.internal,},FirstTimestamp:2026-07-15 20:47:46.972667321 +0000 UTC m=+0.422018946,LastTimestamp:2026-07-15 20:47:46.972667321 +0000 UTC m=+0.422018946,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-96.ec2.internal,}"
Jul 15 20:47:47.011408 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.011382    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 20:47:47.011514 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.011454    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.110917 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.110880    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:47:47.112189 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.112172    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:47:47.112270 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.112206    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:47:47.112270 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.112217    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:47:47.112270 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.112245    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.119171 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.119110    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.119171 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.119137    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-96.ec2.internal\": node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.131936 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.131905    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.134616 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.134591    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 20:47:47.135920 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.135905    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 20:47:47.135990 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.135944    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 20:47:47.135990 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.135968    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 20:47:47.136089 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.136011    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 20:47:47.138265 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.138246    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:47:47.232578 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.232536    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.237039 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.237017    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal"]
Jul 15 20:47:47.237098 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.237093    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:47:47.238769 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.238750    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:47:47.238874 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.238782    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:47:47.238874 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.238793    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:47:47.240121 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240108    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:47:47.240281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.240327 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240299    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:47:47.240871 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240855    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:47:47.240871 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240866    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:47:47.240960 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240885    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:47:47.240960 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240888    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:47:47.240960 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240896    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:47:47.240960 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.240899    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:47:47.242012 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.241998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.242057 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.242024    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:47:47.242794 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.242777    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:47:47.242880 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.242805    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:47:47.242880 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.242817    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:47:47.252510 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.252473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e025e382ea3745601551769bd3d27549-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"e025e382ea3745601551769bd3d27549\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.252610 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.252502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e025e382ea3745601551769bd3d27549-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"e025e382ea3745601551769bd3d27549\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.252610 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.252547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a91adefed4c6e2e0477c8cea8cc9bc10-config\") pod \"kube-apiserver-proxy-ip-10-0-140-96.ec2.internal\" (UID: \"a91adefed4c6e2e0477c8cea8cc9bc10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.267349 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.267325    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-96.ec2.internal\" not found" node="ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.272057 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.272042    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-96.ec2.internal\" not found" node="ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.333534 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.333504    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.353220 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.353191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a91adefed4c6e2e0477c8cea8cc9bc10-config\") pod \"kube-apiserver-proxy-ip-10-0-140-96.ec2.internal\" (UID: \"a91adefed4c6e2e0477c8cea8cc9bc10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.353220 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.353222    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e025e382ea3745601551769bd3d27549-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"e025e382ea3745601551769bd3d27549\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.353385 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.353241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e025e382ea3745601551769bd3d27549-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"e025e382ea3745601551769bd3d27549\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.353385 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.353271    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e025e382ea3745601551769bd3d27549-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"e025e382ea3745601551769bd3d27549\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.353385 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.353306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a91adefed4c6e2e0477c8cea8cc9bc10-config\") pod \"kube-apiserver-proxy-ip-10-0-140-96.ec2.internal\" (UID: \"a91adefed4c6e2e0477c8cea8cc9bc10\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.353385 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.353314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e025e382ea3745601551769bd3d27549-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal\" (UID: \"e025e382ea3745601551769bd3d27549\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.434738 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.434648    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.541285 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.541239    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.569758 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.569718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.574977 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.574755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:47.643561 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.643513    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.750865 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.750779    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.853007 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.852968    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:47.891528 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.891471    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 20:47:47.892237 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:47.891695    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 20:47:47.953095 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:47.953060    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:48.013747 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.013697    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 20:42:47 +0000 UTC" deadline="2027-12-15 21:18:20.931522668 +0000 UTC"
Jul 15 20:47:48.013747 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.013743    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12432h30m32.917784384s"
Jul 15 20:47:48.027900 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.027866    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 20:47:48.029281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.029260    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 20:47:48.029454 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.029302    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 20:47:48.029454 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.029318    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeHasSufficientPID"
Jul 15 20:47:48.032170 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.032149    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:47:48.053640 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:48.053605    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-96.ec2.internal\" not found"
Jul 15 20:47:48.104812 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.104179    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:47:48.107392 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:48.107354    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91adefed4c6e2e0477c8cea8cc9bc10.slice/crio-4cd3af11a6c6700afd700d498e4617d1fb3526f8d35616b323d5f7174a712f16 WatchSource:0}: Error finding container 4cd3af11a6c6700afd700d498e4617d1fb3526f8d35616b323d5f7174a712f16: Status 404 returned error can't find the container with id 4cd3af11a6c6700afd700d498e4617d1fb3526f8d35616b323d5f7174a712f16
Jul 15 20:47:48.107644 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:48.107624    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode025e382ea3745601551769bd3d27549.slice/crio-239763b4ad58288c86eb6b3af22128bc324240a69e61af6d224628ddba4a1b79 WatchSource:0}: Error finding container 239763b4ad58288c86eb6b3af22128bc324240a69e61af6d224628ddba4a1b79: Status 404 returned error can't find the container with id 239763b4ad58288c86eb6b3af22128bc324240a69e61af6d224628ddba4a1b79
Jul 15 20:47:48.111385 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.111366    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:47:48.139696 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.139642    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" event={"ID":"a91adefed4c6e2e0477c8cea8cc9bc10","Type":"ContainerStarted","Data":"4cd3af11a6c6700afd700d498e4617d1fb3526f8d35616b323d5f7174a712f16"}
Jul 15 20:47:48.140674 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.140651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" event={"ID":"e025e382ea3745601551769bd3d27549","Type":"ContainerStarted","Data":"239763b4ad58288c86eb6b3af22128bc324240a69e61af6d224628ddba4a1b79"}
Jul 15 20:47:48.149906 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.149869    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:48.165439 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.165393    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 20:47:48.167365 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.167345    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal"
Jul 15 20:47:48.177438 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.177409    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 20:47:48.260173 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.260092    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:47:48.931354 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.931325    2565 apiserver.go:52] "Watching apiserver"
Jul 15 20:47:48.940838 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.940810    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 20:47:48.941286 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.941254    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-s5ccb","openshift-network-operator/iptables-alerter-jxxsn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl","openshift-cluster-node-tuning-operator/tuned-99jbp","openshift-dns/node-resolver-cv2qk","openshift-multus/multus-8wctb","openshift-network-diagnostics/network-check-target-t9knt","openshift-ovn-kubernetes/ovnkube-node-rdlc8","kube-system/global-pull-secret-syncer-sc9np","kube-system/konnectivity-agent-nf4gs","kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal","openshift-image-registry/node-ca-97qm5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal","openshift-multus/multus-additional-cni-plugins-hpg88"]
Jul 15 20:47:48.942845 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.942809    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:48.942952 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:48.942897    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:47:48.944132 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.944113    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.945241 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.945128    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:48.946265 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.946244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.947549 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.947189    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 20:47:48.947549 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.947223    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v5f2t\""
Jul 15 20:47:48.947549 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.947504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:48.947939 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.947768    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 20:47:48.948789 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.948762    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 20:47:48.948885 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.948868    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 20:47:48.949004 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.948921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 20:47:48.949072 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.949043    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 20:47:48.949851 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.949756    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 20:47:48.949851 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.949789    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 20:47:48.951991 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.951645    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 20:47:48.951991 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.951752    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-j29r7\""
Jul 15 20:47:48.952494 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.952476    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.953196 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.952988    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:47:48.953196 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.949789    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 20:47:48.953398 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.953372    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:48.953501 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:48.953473    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:47:48.954745 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.954653    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 20:47:48.954854 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.954790    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 20:47:48.954957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.954906    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rnmn2\""
Jul 15 20:47:48.954957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.954908    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7l685\""
Jul 15 20:47:48.955226 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.955206    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 20:47:48.955705 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.955613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:48.958683 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.957698    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 20:47:48.958683 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.957877    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 20:47:48.958683 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.958047    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 20:47:48.958683 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.958225    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 20:47:48.958683 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.958376    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f8wqk\""
Jul 15 20:47:48.958683 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:48.958475    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:47:48.958683 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.958596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:48.960090 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.960069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:47:48.961789 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.961765    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:48.962458 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.962301    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 20:47:48.962458 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.962375    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 20:47:48.962458 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.962435    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-djkxp\""
Jul 15 20:47:48.963095 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.962891    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 20:47:48.963202 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963092    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:47:48.963264 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963211    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:48.963352 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-socket-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:48.963417 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-registration-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:48.963417 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-sys-fs\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:48.963545 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-run\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.963545 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m57fb\" (UniqueName: \"kubernetes.io/projected/06d423e1-0aaf-4190-8af6-bd047d77f767-kube-api-access-m57fb\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.963545 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-node-log\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.963697 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-device-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:48.963697 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-modprobe-d\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.963697 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963630    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1208e0be-53b0-47ad-a161-1554e19fb995-tmp\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.963697 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:48.963888 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963706    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-k8s-cni-cncf-io\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.963888 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-kubelet\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.963888 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963787    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-cni-netd\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.963888 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6409d118-ba7a-46a7-8198-968fd28b9954-dbus\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:48.963888 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963847    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-systemd\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.963888 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963854    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wn45h\""
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovnkube-script-lib\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-lib-modules\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.963977    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-system-cni-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964016    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt4gz\" (UniqueName: \"kubernetes.io/projected/1208e0be-53b0-47ad-a161-1554e19fb995-kube-api-access-dt4gz\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6409d118-ba7a-46a7-8198-968fd28b9954-kubelet-config\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovnkube-config\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysctl-conf\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-host\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.964281 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afaee93c-636f-450c-83ea-2c3cb136e163-hosts-file\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-cni-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-var-lib-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-ovn\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964396    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-log-socket\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfs6p\" (UniqueName: \"kubernetes.io/projected/1ce29ad6-6afe-4203-af98-587b4c97689e-kube-api-access-hfs6p\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-os-release\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-cni-bin\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-hostroot\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964631    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rv75\" (UniqueName: \"kubernetes.io/projected/afaee93c-636f-450c-83ea-2c3cb136e163-kube-api-access-2rv75\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964712    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-cnibin\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-kubelet\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-cni-bin\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-kubernetes\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.964819 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-etc-kubernetes\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-systemd-units\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-env-overrides\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysconfig\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964927    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-etc-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-systemd\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.964982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-multus-certs\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965007    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-run-netns\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-var-lib-kubelet\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1208e0be-53b0-47ad-a161-1554e19fb995-etc-tuned\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-netns\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-cni-multus\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-conf-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysctl-d\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovn-node-metrics-cert\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.965677 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbtdc\" (UniqueName: \"kubernetes.io/projected/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-kube-api-access-pbtdc\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.966433 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965279    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afaee93c-636f-450c-83ea-2c3cb136e163-tmp-dir\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:48.966433 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965317    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d423e1-0aaf-4190-8af6-bd047d77f767-cni-binary-copy\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.966433 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-slash\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:48.966433 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-sys\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:48.966433 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-socket-dir-parent\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.966433 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.965468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-daemon-config\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:48.970374 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.970353    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 20:47:48.971328 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.971307    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 20:47:48.971414 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.971366    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ft2pv\""
Jul 15 20:47:48.971697 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.971680    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 20:47:48.972041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.972024    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 20:47:48.972481 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.972215    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 20:47:48.972945 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.972250    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 20:47:48.972945 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.972471    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vxg4d\""
Jul 15 20:47:48.989328 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:48.989276    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 20:47:49.004975 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.004805    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 20:47:49.005804 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.005779    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6qt4h"
Jul 15 20:47:49.016813 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.016782    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6qt4h"
Jul 15 20:47:49.050804 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.050775    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 20:47:49.065762 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065730    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:49.065929 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.065929 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rv75\" (UniqueName: \"kubernetes.io/projected/afaee93c-636f-450c-83ea-2c3cb136e163-kube-api-access-2rv75\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:49.065929 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-cnibin\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.065929 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.065929 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-kubelet\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.065929 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065902    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-cni-bin\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.065929 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-kubernetes\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-etc-kubernetes\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.065978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-systemd-units\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066001    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-env-overrides\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066023    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysconfig\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066049    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tc8k\" (UniqueName: \"kubernetes.io/projected/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-kube-api-access-9tc8k\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-etc-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-systemd\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066138    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-multus-certs\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-run-netns\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066188    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-var-lib-kubelet\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1208e0be-53b0-47ad-a161-1554e19fb995-etc-tuned\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-netns\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-cni-multus\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.066296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-conf-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066318    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysctl-d\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066366    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovn-node-metrics-cert\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtdc\" (UniqueName: \"kubernetes.io/projected/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-kube-api-access-pbtdc\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afaee93c-636f-450c-83ea-2c3cb136e163-tmp-dir\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d423e1-0aaf-4190-8af6-bd047d77f767-cni-binary-copy\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/adf4b109-9939-43ae-9915-f9567149710c-serviceca\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-slash\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066605    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-sys\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-systemd\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066629    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-socket-dir-parent\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-daemon-config\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-socket-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-registration-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.067087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-sys-fs\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-run\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066793    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m57fb\" (UniqueName: \"kubernetes.io/projected/06d423e1-0aaf-4190-8af6-bd047d77f767-kube-api-access-m57fb\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47a3070e-0bd9-4581-adc0-a6872fc9b4a4-agent-certs\") pod \"konnectivity-agent-nf4gs\" (UID: \"47a3070e-0bd9-4581-adc0-a6872fc9b4a4\") " pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-node-log\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-device-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066887    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-kubelet\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066907    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-modprobe-d\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066933    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1208e0be-53b0-47ad-a161-1554e19fb995-tmp\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-cni-bin\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066961    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-kubernetes\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.066989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-k8s-cni-cncf-io\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-kubelet\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067029    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-k8s-cni-cncf-io\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067065    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-multus-certs\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067081    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-etc-kubernetes\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmw9b\" (UniqueName: \"kubernetes.io/projected/bab8e407-a26a-4f3b-a174-2c422856c23e-kube-api-access-rmw9b\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:49.067927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-systemd-units\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-cni-netd\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6409d118-ba7a-46a7-8198-968fd28b9954-dbus\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-cni-netd\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47a3070e-0bd9-4581-adc0-a6872fc9b4a4-konnectivity-ca\") pod \"konnectivity-agent-nf4gs\" (UID: \"47a3070e-0bd9-4581-adc0-a6872fc9b4a4\") " pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-cnibin\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067219    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-run-netns\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067264    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-var-lib-kubelet\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067292    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-os-release\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067315    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/adf4b109-9939-43ae-9915-f9567149710c-host\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067340    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-systemd\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067364    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovnkube-script-lib\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-lib-modules\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-system-cni-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-system-cni-dir\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66r5g\" (UniqueName: \"kubernetes.io/projected/4de84318-20d2-486a-969a-8a311cf332aa-kube-api-access-66r5g\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.068857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt4gz\" (UniqueName: \"kubernetes.io/projected/1208e0be-53b0-47ad-a161-1554e19fb995-kube-api-access-dt4gz\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6409d118-ba7a-46a7-8198-968fd28b9954-kubelet-config\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-host-slash\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rfk\" (UniqueName: \"kubernetes.io/projected/adf4b109-9939-43ae-9915-f9567149710c-kube-api-access-55rfk\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-env-overrides\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.067967    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysconfig\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-etc-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068083    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-kubelet\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovnkube-config\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysctl-conf\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-host\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afaee93c-636f-450c-83ea-2c3cb136e163-hosts-file\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6409d118-ba7a-46a7-8198-968fd28b9954-dbus\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-cni-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-cnibin\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.069710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-var-lib-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-ovn\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068370    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-iptables-alerter-script\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-log-socket\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068478    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfs6p\" (UniqueName: \"kubernetes.io/projected/1ce29ad6-6afe-4203-af98-587b4c97689e-kube-api-access-hfs6p\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-os-release\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-cni-bin\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-hostroot\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068572    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068644    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-hostroot\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068686    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-node-log\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-device-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.068835    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-modprobe-d\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069133    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-run-netns\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-cni-multus\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-conf-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.070557 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysctl-d\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovnkube-config\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.069572    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.069651    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret podName:6409d118-ba7a-46a7-8198-968fd28b9954 nodeName:}" failed. No retries permitted until 2026-07-15 20:47:49.569614443 +0000 UTC m=+3.018966060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret") pod "global-pull-secret-syncer-sc9np" (UID: "6409d118-ba7a-46a7-8198-968fd28b9954") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-systemd\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069791    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-var-lib-openvswitch\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.069920    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-etc-selinux\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-etc-sysctl-conf\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-host\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afaee93c-636f-450c-83ea-2c3cb136e163-hosts-file\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-cni-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070222    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovnkube-script-lib\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-socket-dir-parent\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afaee93c-636f-450c-83ea-2c3cb136e163-tmp-dir\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-run-ovn\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070613    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-lib-modules\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.071420 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-log-socket\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-system-cni-dir\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.070956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-host-var-lib-cni-bin\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071030    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-socket-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-host-slash\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d423e1-0aaf-4190-8af6-bd047d77f767-os-release\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6409d118-ba7a-46a7-8198-968fd28b9954-kubelet-config\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-run\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-sys-fs\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1ce29ad6-6afe-4203-af98-587b4c97689e-registration-dir\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071279    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d423e1-0aaf-4190-8af6-bd047d77f767-cni-binary-copy\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.071340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1208e0be-53b0-47ad-a161-1554e19fb995-sys\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.072350 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.072114    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06d423e1-0aaf-4190-8af6-bd047d77f767-multus-daemon-config\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.073130 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.073108    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:47:49.073209 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.073134    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:47:49.073209 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.073148    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xzqft for pod openshift-network-diagnostics/network-check-target-t9knt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:49.073209 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.073202    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft podName:8130151f-9c0a-4a3c-a87b-b13a80538a0d nodeName:}" failed. No retries permitted until 2026-07-15 20:47:49.573185655 +0000 UTC m=+3.022537267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqft" (UniqueName: "kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft") pod "network-check-target-t9knt" (UID: "8130151f-9c0a-4a3c-a87b-b13a80538a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:49.075441 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.075347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-ovn-node-metrics-cert\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.076053 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.076032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rv75\" (UniqueName: \"kubernetes.io/projected/afaee93c-636f-450c-83ea-2c3cb136e163-kube-api-access-2rv75\") pod \"node-resolver-cv2qk\" (UID: \"afaee93c-636f-450c-83ea-2c3cb136e163\") " pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:49.079603 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.079542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtdc\" (UniqueName: \"kubernetes.io/projected/6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c-kube-api-access-pbtdc\") pod \"ovnkube-node-rdlc8\" (UID: \"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.080520 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.080442    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfs6p\" (UniqueName: \"kubernetes.io/projected/1ce29ad6-6afe-4203-af98-587b4c97689e-kube-api-access-hfs6p\") pod \"aws-ebs-csi-driver-node-mh8cl\" (UID: \"1ce29ad6-6afe-4203-af98-587b4c97689e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.084672 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.084650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1208e0be-53b0-47ad-a161-1554e19fb995-etc-tuned\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.084823 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.084683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1208e0be-53b0-47ad-a161-1554e19fb995-tmp\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.085040 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.085019    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt4gz\" (UniqueName: \"kubernetes.io/projected/1208e0be-53b0-47ad-a161-1554e19fb995-kube-api-access-dt4gz\") pod \"tuned-99jbp\" (UID: \"1208e0be-53b0-47ad-a161-1554e19fb995\") " pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.086986 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.086962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m57fb\" (UniqueName: \"kubernetes.io/projected/06d423e1-0aaf-4190-8af6-bd047d77f767-kube-api-access-m57fb\") pod \"multus-8wctb\" (UID: \"06d423e1-0aaf-4190-8af6-bd047d77f767\") " pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.169055 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.169259 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/adf4b109-9939-43ae-9915-f9567149710c-serviceca\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.169259 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47a3070e-0bd9-4581-adc0-a6872fc9b4a4-agent-certs\") pod \"konnectivity-agent-nf4gs\" (UID: \"47a3070e-0bd9-4581-adc0-a6872fc9b4a4\") " pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:47:49.169259 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169148    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmw9b\" (UniqueName: \"kubernetes.io/projected/bab8e407-a26a-4f3b-a174-2c422856c23e-kube-api-access-rmw9b\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169657    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47a3070e-0bd9-4581-adc0-a6872fc9b4a4-konnectivity-ca\") pod \"konnectivity-agent-nf4gs\" (UID: \"47a3070e-0bd9-4581-adc0-a6872fc9b4a4\") " pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-cnibin\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-os-release\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/adf4b109-9939-43ae-9915-f9567149710c-host\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169750    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/adf4b109-9939-43ae-9915-f9567149710c-serviceca\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-system-cni-dir\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-system-cni-dir\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66r5g\" (UniqueName: \"kubernetes.io/projected/4de84318-20d2-486a-969a-8a311cf332aa-kube-api-access-66r5g\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-host-slash\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169854    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-cnibin\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-os-release\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rfk\" (UniqueName: \"kubernetes.io/projected/adf4b109-9939-43ae-9915-f9567149710c-kube-api-access-55rfk\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/adf4b109-9939-43ae-9915-f9567149710c-host\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169905    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-host-slash\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.170634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169968    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.169998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-iptables-alerter-script\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.170040    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.170100    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs podName:bab8e407-a26a-4f3b-a174-2c422856c23e nodeName:}" failed. No retries permitted until 2026-07-15 20:47:49.670082148 +0000 UTC m=+3.119433763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs") pod "network-metrics-daemon-s5ccb" (UID: "bab8e407-a26a-4f3b-a174-2c422856c23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.170042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.170149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tc8k\" (UniqueName: \"kubernetes.io/projected/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-kube-api-access-9tc8k\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.170190    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.170287    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4de84318-20d2-486a-969a-8a311cf332aa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.170348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47a3070e-0bd9-4581-adc0-a6872fc9b4a4-konnectivity-ca\") pod \"konnectivity-agent-nf4gs\" (UID: \"47a3070e-0bd9-4581-adc0-a6872fc9b4a4\") " pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.170582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-cni-binary-copy\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.170690    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4de84318-20d2-486a-969a-8a311cf332aa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.171562 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.170827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-iptables-alerter-script\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.173852 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.173804    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47a3070e-0bd9-4581-adc0-a6872fc9b4a4-agent-certs\") pod \"konnectivity-agent-nf4gs\" (UID: \"47a3070e-0bd9-4581-adc0-a6872fc9b4a4\") " pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:47:49.184828 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.184758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmw9b\" (UniqueName: \"kubernetes.io/projected/bab8e407-a26a-4f3b-a174-2c422856c23e-kube-api-access-rmw9b\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:49.185249 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.185224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rfk\" (UniqueName: \"kubernetes.io/projected/adf4b109-9939-43ae-9915-f9567149710c-kube-api-access-55rfk\") pod \"node-ca-97qm5\" (UID: \"adf4b109-9939-43ae-9915-f9567149710c\") " pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.186220 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.186194    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66r5g\" (UniqueName: \"kubernetes.io/projected/4de84318-20d2-486a-969a-8a311cf332aa-kube-api-access-66r5g\") pod \"multus-additional-cni-plugins-hpg88\" (UID: \"4de84318-20d2-486a-969a-8a311cf332aa\") " pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.186528 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.186486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tc8k\" (UniqueName: \"kubernetes.io/projected/c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1-kube-api-access-9tc8k\") pod \"iptables-alerter-jxxsn\" (UID: \"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1\") " pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.260033 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.259996    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:47:49.269857 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.269583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl"
Jul 15 20:47:49.278808 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.278774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-99jbp"
Jul 15 20:47:49.286560 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.286528    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cv2qk"
Jul 15 20:47:49.303535 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.303499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8wctb"
Jul 15 20:47:49.313705 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.313668    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jxxsn"
Jul 15 20:47:49.321866 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.321845    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:47:49.330835 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.330806    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hpg88"
Jul 15 20:47:49.337234 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.337132    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-97qm5"
Jul 15 20:47:49.573815 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.573727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:49.573815 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.573796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:49.574050 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.573896    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:49.574050 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.573917    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:47:49.574050 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.573937    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:47:49.574050 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.573949    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xzqft for pod openshift-network-diagnostics/network-check-target-t9knt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:49.574050 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.573972    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret podName:6409d118-ba7a-46a7-8198-968fd28b9954 nodeName:}" failed. No retries permitted until 2026-07-15 20:47:50.573955485 +0000 UTC m=+4.023307096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret") pod "global-pull-secret-syncer-sc9np" (UID: "6409d118-ba7a-46a7-8198-968fd28b9954") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:49.574050 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.573997    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft podName:8130151f-9c0a-4a3c-a87b-b13a80538a0d nodeName:}" failed. No retries permitted until 2026-07-15 20:47:50.573980029 +0000 UTC m=+4.023331653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqft" (UniqueName: "kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft") pod "network-check-target-t9knt" (UID: "8130151f-9c0a-4a3c-a87b-b13a80538a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:49.674577 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:49.674542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:49.674754 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.674690    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:49.674754 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:49.674750    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs podName:bab8e407-a26a-4f3b-a174-2c422856c23e nodeName:}" failed. No retries permitted until 2026-07-15 20:47:50.674736706 +0000 UTC m=+4.124088315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs") pod "network-metrics-daemon-s5ccb" (UID: "bab8e407-a26a-4f3b-a174-2c422856c23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:49.694734 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:49.694708    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafaee93c_636f_450c_83ea_2c3cb136e163.slice/crio-d6b0a09641e6aebe07b0e06260f3443e23bf0bf1e2600ce8d98e422bb6af56c6 WatchSource:0}: Error finding container d6b0a09641e6aebe07b0e06260f3443e23bf0bf1e2600ce8d98e422bb6af56c6: Status 404 returned error can't find the container with id d6b0a09641e6aebe07b0e06260f3443e23bf0bf1e2600ce8d98e422bb6af56c6
Jul 15 20:47:49.696223 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:49.696082    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f3d74e_0b96_49c3_b0af_fb5ed23a1ed1.slice/crio-4343faddf97792d2ab8fa790add8f00e3dd2a25bfa980e4ddbf6d1a0d9eaccdb WatchSource:0}: Error finding container 4343faddf97792d2ab8fa790add8f00e3dd2a25bfa980e4ddbf6d1a0d9eaccdb: Status 404 returned error can't find the container with id 4343faddf97792d2ab8fa790add8f00e3dd2a25bfa980e4ddbf6d1a0d9eaccdb
Jul 15 20:47:50.009968 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:50.009935    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a3070e_0bd9_4581_adc0_a6872fc9b4a4.slice/crio-104980a8c83d8832611eb2dbcb9aece06803ab551db863f592856854dd16db46 WatchSource:0}: Error finding container 104980a8c83d8832611eb2dbcb9aece06803ab551db863f592856854dd16db46: Status 404 returned error can't find the container with id 104980a8c83d8832611eb2dbcb9aece06803ab551db863f592856854dd16db46
Jul 15 20:47:50.011045 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:50.011019    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf4b109_9939_43ae_9915_f9567149710c.slice/crio-3b8026450f8d9ed478c283e3a2572d1824fefde3e09886c96e578f28d2845b71 WatchSource:0}: Error finding container 3b8026450f8d9ed478c283e3a2572d1824fefde3e09886c96e578f28d2845b71: Status 404 returned error can't find the container with id 3b8026450f8d9ed478c283e3a2572d1824fefde3e09886c96e578f28d2845b71
Jul 15 20:47:50.011988 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:50.011835    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d423e1_0aaf_4190_8af6_bd047d77f767.slice/crio-b7c5fe0a259a88a31677fb383cb9c819499ac9a2600d8fde6b32a8206162ad24 WatchSource:0}: Error finding container b7c5fe0a259a88a31677fb383cb9c819499ac9a2600d8fde6b32a8206162ad24: Status 404 returned error can't find the container with id b7c5fe0a259a88a31677fb383cb9c819499ac9a2600d8fde6b32a8206162ad24
Jul 15 20:47:50.012868 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:50.012846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de84318_20d2_486a_969a_8a311cf332aa.slice/crio-8c9a3cea2a19c6e6214d319c189c982665df6f6decd29a4f49ee07a91f8054ef WatchSource:0}: Error finding container 8c9a3cea2a19c6e6214d319c189c982665df6f6decd29a4f49ee07a91f8054ef: Status 404 returned error can't find the container with id 8c9a3cea2a19c6e6214d319c189c982665df6f6decd29a4f49ee07a91f8054ef
Jul 15 20:47:50.014410 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:50.014354    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6079b6dd_e5a8_4daa_a68b_db2d9bcd5f6c.slice/crio-92dda854feea95582cbfa0164eac0e3e6e86cda716b27aad3dba7505af38726f WatchSource:0}: Error finding container 92dda854feea95582cbfa0164eac0e3e6e86cda716b27aad3dba7505af38726f: Status 404 returned error can't find the container with id 92dda854feea95582cbfa0164eac0e3e6e86cda716b27aad3dba7505af38726f
Jul 15 20:47:50.015994 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:50.015877    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1208e0be_53b0_47ad_a161_1554e19fb995.slice/crio-35898ffaceb3cc9083d31da5892bc90d3626596307229da0c9ce13965347b1aa WatchSource:0}: Error finding container 35898ffaceb3cc9083d31da5892bc90d3626596307229da0c9ce13965347b1aa: Status 404 returned error can't find the container with id 35898ffaceb3cc9083d31da5892bc90d3626596307229da0c9ce13965347b1aa
Jul 15 20:47:50.018957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.018653    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:42:49 +0000 UTC" deadline="2028-01-22 21:36:52.640344837 +0000 UTC"
Jul 15 20:47:50.018957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.018682    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13344h49m2.621667354s"
Jul 15 20:47:50.018957 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:47:50.018762    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce29ad6_6afe_4203_af98_587b4c97689e.slice/crio-7280b41940ea5616ecf8988f231ee08ca49dab0606163e103bf913b217b9d378 WatchSource:0}: Error finding container 7280b41940ea5616ecf8988f231ee08ca49dab0606163e103bf913b217b9d378: Status 404 returned error can't find the container with id 7280b41940ea5616ecf8988f231ee08ca49dab0606163e103bf913b217b9d378
Jul 15 20:47:50.137228 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.136946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:50.137404 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.137333    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:47:50.147436 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.147211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" event={"ID":"a91adefed4c6e2e0477c8cea8cc9bc10","Type":"ContainerStarted","Data":"5c843e6443690c1a3f882afe7e6f0c8499480395d20b956798128a348c02fa59"}
Jul 15 20:47:50.150014 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.149751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl" event={"ID":"1ce29ad6-6afe-4203-af98-587b4c97689e","Type":"ContainerStarted","Data":"7280b41940ea5616ecf8988f231ee08ca49dab0606163e103bf913b217b9d378"}
Jul 15 20:47:50.152198 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.152152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99jbp" event={"ID":"1208e0be-53b0-47ad-a161-1554e19fb995","Type":"ContainerStarted","Data":"35898ffaceb3cc9083d31da5892bc90d3626596307229da0c9ce13965347b1aa"}
Jul 15 20:47:50.155443 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.154613    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpg88" event={"ID":"4de84318-20d2-486a-969a-8a311cf332aa","Type":"ContainerStarted","Data":"8c9a3cea2a19c6e6214d319c189c982665df6f6decd29a4f49ee07a91f8054ef"}
Jul 15 20:47:50.157041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.157012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8wctb" event={"ID":"06d423e1-0aaf-4190-8af6-bd047d77f767","Type":"ContainerStarted","Data":"b7c5fe0a259a88a31677fb383cb9c819499ac9a2600d8fde6b32a8206162ad24"}
Jul 15 20:47:50.161646 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.161146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nf4gs" event={"ID":"47a3070e-0bd9-4581-adc0-a6872fc9b4a4","Type":"ContainerStarted","Data":"104980a8c83d8832611eb2dbcb9aece06803ab551db863f592856854dd16db46"}
Jul 15 20:47:50.163778 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.163747    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jxxsn" event={"ID":"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1","Type":"ContainerStarted","Data":"4343faddf97792d2ab8fa790add8f00e3dd2a25bfa980e4ddbf6d1a0d9eaccdb"}
Jul 15 20:47:50.166445 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.166399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"92dda854feea95582cbfa0164eac0e3e6e86cda716b27aad3dba7505af38726f"}
Jul 15 20:47:50.170190 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.170151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97qm5" event={"ID":"adf4b109-9939-43ae-9915-f9567149710c","Type":"ContainerStarted","Data":"3b8026450f8d9ed478c283e3a2572d1824fefde3e09886c96e578f28d2845b71"}
Jul 15 20:47:50.172410 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.172364    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cv2qk" event={"ID":"afaee93c-636f-450c-83ea-2c3cb136e163","Type":"ContainerStarted","Data":"d6b0a09641e6aebe07b0e06260f3443e23bf0bf1e2600ce8d98e422bb6af56c6"}
Jul 15 20:47:50.583157 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.583074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:50.583157 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.583129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:50.583392 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.583229    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:50.583392 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.583275    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret podName:6409d118-ba7a-46a7-8198-968fd28b9954 nodeName:}" failed. No retries permitted until 2026-07-15 20:47:52.583262659 +0000 UTC m=+6.032614270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret") pod "global-pull-secret-syncer-sc9np" (UID: "6409d118-ba7a-46a7-8198-968fd28b9954") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:50.583599 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.583585    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:47:50.583652 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.583603    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:47:50.583652 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.583612    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xzqft for pod openshift-network-diagnostics/network-check-target-t9knt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:50.583652 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.583646    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft podName:8130151f-9c0a-4a3c-a87b-b13a80538a0d nodeName:}" failed. No retries permitted until 2026-07-15 20:47:52.583636666 +0000 UTC m=+6.032988276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqft" (UniqueName: "kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft") pod "network-check-target-t9knt" (UID: "8130151f-9c0a-4a3c-a87b-b13a80538a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:50.684383 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:50.683799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:50.684383 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.683965    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:50.684383 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:50.684028    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs podName:bab8e407-a26a-4f3b-a174-2c422856c23e nodeName:}" failed. No retries permitted until 2026-07-15 20:47:52.684009815 +0000 UTC m=+6.133361428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs") pod "network-metrics-daemon-s5ccb" (UID: "bab8e407-a26a-4f3b-a174-2c422856c23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:51.019282 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:51.019214    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:42:49 +0000 UTC" deadline="2028-03-23 00:29:07.537675862 +0000 UTC"
Jul 15 20:47:51.019282 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:51.019279    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14787h41m16.518401727s"
Jul 15 20:47:51.137647 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:51.137554    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:51.137647 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:51.137598    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:51.137857 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:51.137693    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:47:51.137857 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:51.137830    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:47:51.185069 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:51.185029    2565 generic.go:356] "Generic (PLEG): container finished" podID="e025e382ea3745601551769bd3d27549" containerID="1b52bea50949f2d7b5786fb557832dec8597f52bda8301846e38a22ab891ced8" exitCode=0
Jul 15 20:47:51.186026 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:51.185996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" event={"ID":"e025e382ea3745601551769bd3d27549","Type":"ContainerDied","Data":"1b52bea50949f2d7b5786fb557832dec8597f52bda8301846e38a22ab891ced8"}
Jul 15 20:47:51.208824 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:51.208766    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-96.ec2.internal" podStartSLOduration=3.20874192 podStartE2EDuration="3.20874192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:47:50.173120086 +0000 UTC m=+3.622471747" watchObservedRunningTime="2026-07-15 20:47:51.20874192 +0000 UTC m=+4.658093553"
Jul 15 20:47:52.140737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:52.140701    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:52.141279 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.140854    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:47:52.206650 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:52.206611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" event={"ID":"e025e382ea3745601551769bd3d27549","Type":"ContainerStarted","Data":"af5611f1e2315b63e4c58ace05580656e47ec366e3913eaf719f5aa5b354fa9d"}
Jul 15 20:47:52.599027 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:52.598910    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:52.599027 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:52.598990    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:52.599253 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.599125    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:52.599253 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.599183    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret podName:6409d118-ba7a-46a7-8198-968fd28b9954 nodeName:}" failed. No retries permitted until 2026-07-15 20:47:56.599165747 +0000 UTC m=+10.048517365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret") pod "global-pull-secret-syncer-sc9np" (UID: "6409d118-ba7a-46a7-8198-968fd28b9954") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:52.599627 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.599608    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:47:52.599716 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.599637    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:47:52.599716 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.599650    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xzqft for pod openshift-network-diagnostics/network-check-target-t9knt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:52.599716 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.599697    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft podName:8130151f-9c0a-4a3c-a87b-b13a80538a0d nodeName:}" failed. No retries permitted until 2026-07-15 20:47:56.599681389 +0000 UTC m=+10.049033005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqft" (UniqueName: "kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft") pod "network-check-target-t9knt" (UID: "8130151f-9c0a-4a3c-a87b-b13a80538a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:52.700669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:52.700055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:52.700669 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.700231    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:52.700669 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:52.700295    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs podName:bab8e407-a26a-4f3b-a174-2c422856c23e nodeName:}" failed. No retries permitted until 2026-07-15 20:47:56.700275726 +0000 UTC m=+10.149627356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs") pod "network-metrics-daemon-s5ccb" (UID: "bab8e407-a26a-4f3b-a174-2c422856c23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:53.136939 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:53.136303    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:53.136939 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:53.136443    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:47:53.136939 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:53.136805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:53.136939 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:53.136896    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:47:54.136495 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:54.136459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:54.136964 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:54.136627    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:47:55.137291 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:55.137205    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:55.137744 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:55.137344    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:47:55.137744 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:55.137593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:55.137744 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:55.137687    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:47:56.136201 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:56.136157    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:56.136460 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.136433    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:47:56.638373 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:56.638329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:56.638825 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:56.638427    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:56.638825 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.638693    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:47:56.638825 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.638716    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:47:56.638825 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.638733    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xzqft for pod openshift-network-diagnostics/network-check-target-t9knt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:56.638825 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.638792    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft podName:8130151f-9c0a-4a3c-a87b-b13a80538a0d nodeName:}" failed. No retries permitted until 2026-07-15 20:48:04.638772837 +0000 UTC m=+18.088124450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqft" (UniqueName: "kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft") pod "network-check-target-t9knt" (UID: "8130151f-9c0a-4a3c-a87b-b13a80538a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:47:56.639054 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.638868    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:56.639054 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.638902    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret podName:6409d118-ba7a-46a7-8198-968fd28b9954 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:04.638890859 +0000 UTC m=+18.088242474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret") pod "global-pull-secret-syncer-sc9np" (UID: "6409d118-ba7a-46a7-8198-968fd28b9954") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:47:56.739407 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:56.739342    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:56.739608 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.739532    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:56.739674 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:56.739609    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs podName:bab8e407-a26a-4f3b-a174-2c422856c23e nodeName:}" failed. No retries permitted until 2026-07-15 20:48:04.739585207 +0000 UTC m=+18.188936820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs") pod "network-metrics-daemon-s5ccb" (UID: "bab8e407-a26a-4f3b-a174-2c422856c23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:47:57.137227 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:57.137143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:57.137377 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:57.137266    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:47:57.137464 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:57.137383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:57.137558 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:57.137526    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:47:58.137134 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:58.137060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:47:58.137591 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:58.137211    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:47:59.137279 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:59.137241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:47:59.137752 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:47:59.137241    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:47:59.137752 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:59.137374    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:47:59.137752 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:47:59.137456    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:00.136812 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:00.136779    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:00.137012 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:00.136914    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:01.137025 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:01.136948    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:01.137529 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:01.137099    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:01.137529 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:01.137152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:01.137529 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:01.137281    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:02.136515 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:02.136483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:02.136709 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:02.136606    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:03.136779 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:03.136741    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:03.137224 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:03.136744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:03.137224 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:03.136880    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:03.137224 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:03.136941    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:04.136712 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:04.136664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:04.136981 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.136808    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:04.700327 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:04.700294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:04.700471 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:04.700348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:04.700519 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.700463    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:48:04.700553 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.700533    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret podName:6409d118-ba7a-46a7-8198-968fd28b9954 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.700517119 +0000 UTC m=+34.149868728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret") pod "global-pull-secret-syncer-sc9np" (UID: "6409d118-ba7a-46a7-8198-968fd28b9954") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:48:04.700553 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.700466    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:48:04.700633 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.700564    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:48:04.700633 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.700576    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xzqft for pod openshift-network-diagnostics/network-check-target-t9knt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:48:04.700633 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.700619    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft podName:8130151f-9c0a-4a3c-a87b-b13a80538a0d nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.700604826 +0000 UTC m=+34.149956436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqft" (UniqueName: "kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft") pod "network-check-target-t9knt" (UID: "8130151f-9c0a-4a3c-a87b-b13a80538a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:48:04.801253 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:04.801217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:04.801401 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.801368    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:48:04.801465 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:04.801448    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs podName:bab8e407-a26a-4f3b-a174-2c422856c23e nodeName:}" failed. No retries permitted until 2026-07-15 20:48:20.80143245 +0000 UTC m=+34.250784074 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs") pod "network-metrics-daemon-s5ccb" (UID: "bab8e407-a26a-4f3b-a174-2c422856c23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:48:05.137152 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:05.137073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:05.137591 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:05.137073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:05.137591 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:05.137190    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:05.137591 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:05.137275    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:06.136985 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:06.136941    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:06.137162 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:06.137101    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:07.137164 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:07.137126    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:07.137640 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:07.137219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:07.137640 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:07.137235    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:07.137640 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:07.137327    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:08.137178 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:08.137146    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:08.137672 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:08.137284    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:09.137121 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.136882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:09.137242 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.136940    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:09.137866 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:09.137233    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:09.137866 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:09.137267    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:09.241588 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.241398    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:48:09.241924 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.241905    2565 generic.go:356] "Generic (PLEG): container finished" podID="6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c" containerID="8bb84f12ede955d87e051c1cf2a80cc5ecc2d727e58ad79c0e433b6be91d2b6b" exitCode=1
Jul 15 20:48:09.242005 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.241969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"0a92047d0fc3505ac794083694930c2687a5899943ada972feecb23decfa9af7"}
Jul 15 20:48:09.242062 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.242046    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"da440eb1fa74abd38f96c2fae260800eb63a44c7292360c60f83c03265f3b660"}
Jul 15 20:48:09.242113 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.242100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"f2b22f3c9ca7ab08dacf3867111d4e6c63f782342965d58b672ccf56e9ff12af"}
Jul 15 20:48:09.242158 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.242145    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerDied","Data":"8bb84f12ede955d87e051c1cf2a80cc5ecc2d727e58ad79c0e433b6be91d2b6b"}
Jul 15 20:48:09.242193 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.242181    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"a50e13163f4363ab3693df10b57a40b67d9097a227e96b05c5c25f56ca18862f"}
Jul 15 20:48:09.243432 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.243389    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-97qm5" event={"ID":"adf4b109-9939-43ae-9915-f9567149710c","Type":"ContainerStarted","Data":"e142fd8b877e16ad046f8271a159111169d9326f2e96bedaecb0daaadaf31198"}
Jul 15 20:48:09.244554 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.244529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cv2qk" event={"ID":"afaee93c-636f-450c-83ea-2c3cb136e163","Type":"ContainerStarted","Data":"0f3f2e064b44c395f49d90966770fe49e1c4d5af6863a6d63b6cb8e3fb54e1a9"}
Jul 15 20:48:09.245853 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.245834    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl" event={"ID":"1ce29ad6-6afe-4203-af98-587b4c97689e","Type":"ContainerStarted","Data":"949aa931442c1d255461e3cd93244a52499e47d5338ab07a83d2af2bf6acd4b8"}
Jul 15 20:48:09.247045 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.247025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-99jbp" event={"ID":"1208e0be-53b0-47ad-a161-1554e19fb995","Type":"ContainerStarted","Data":"fdd60d7203bbc1108a40d2fff9cf35f334b6c205e708a98ca93fe7096977aafb"}
Jul 15 20:48:09.248436 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.248390    2565 generic.go:356] "Generic (PLEG): container finished" podID="4de84318-20d2-486a-969a-8a311cf332aa" containerID="bd159ceffd137e50291da9563f401125e4126b2637f3f89aa21a8e19e407dde0" exitCode=0
Jul 15 20:48:09.248507 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.248451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpg88" event={"ID":"4de84318-20d2-486a-969a-8a311cf332aa","Type":"ContainerDied","Data":"bd159ceffd137e50291da9563f401125e4126b2637f3f89aa21a8e19e407dde0"}
Jul 15 20:48:09.249873 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.249852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8wctb" event={"ID":"06d423e1-0aaf-4190-8af6-bd047d77f767","Type":"ContainerStarted","Data":"8c1bc9b08939e220bd6f1ca8eef0e2c1681fe3903481904c1fb96dca61c9c16c"}
Jul 15 20:48:09.251102 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.251081    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nf4gs" event={"ID":"47a3070e-0bd9-4581-adc0-a6872fc9b4a4","Type":"ContainerStarted","Data":"a2e60f8717d91ac293d02c72eb3782d739a4835f2612b7f75d5dd48872ed497c"}
Jul 15 20:48:09.265521 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.265480    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-96.ec2.internal" podStartSLOduration=21.265442171 podStartE2EDuration="21.265442171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:47:52.225552265 +0000 UTC m=+5.674903897" watchObservedRunningTime="2026-07-15 20:48:09.265442171 +0000 UTC m=+22.714793827"
Jul 15 20:48:09.266147 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.266118    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-97qm5" podStartSLOduration=3.7286068390000002 podStartE2EDuration="22.266108412s" totalImagesPullingTime="18.537501573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:09.265312039 +0000 UTC m=+22.714663908" watchObservedRunningTime="2026-07-15 20:48:09.266108412 +0000 UTC m=+22.715460040"
Jul 15 20:48:09.291024 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.290980    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8wctb" podStartSLOduration=3.5647330950000002 podStartE2EDuration="22.290964947s" totalImagesPullingTime="18.726231852s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:09.290769742 +0000 UTC m=+22.740121373" watchObservedRunningTime="2026-07-15 20:48:09.290964947 +0000 UTC m=+22.740316580"
Jul 15 20:48:09.332513 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.332470    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cv2qk" podStartSLOduration=3.501607838 podStartE2EDuration="22.332454476s" totalImagesPullingTime="18.830846638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:09.332003642 +0000 UTC m=+22.781355276" watchObservedRunningTime="2026-07-15 20:48:09.332454476 +0000 UTC m=+22.781806108"
Jul 15 20:48:09.350335 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.350289    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nf4gs" podStartSLOduration=3.792471741 podStartE2EDuration="22.350276748s" totalImagesPullingTime="18.557805007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:09.349801593 +0000 UTC m=+22.799153228" watchObservedRunningTime="2026-07-15 20:48:09.350276748 +0000 UTC m=+22.799628380"
Jul 15 20:48:09.371245 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.371192    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-99jbp" podStartSLOduration=3.818656967 podStartE2EDuration="22.371178593s" totalImagesPullingTime="18.552521626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:09.370834276 +0000 UTC m=+22.820185908" watchObservedRunningTime="2026-07-15 20:48:09.371178593 +0000 UTC m=+22.820530216"
Jul 15 20:48:09.713816 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.713777    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:48:09.714435 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:09.714398    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:48:10.136616 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.136596    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:10.136736 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:10.136712    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:10.242802 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.242758    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 20:48:10.257737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.257697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl" event={"ID":"1ce29ad6-6afe-4203-af98-587b4c97689e","Type":"ContainerStarted","Data":"3a532d4a3ac31bce98a4d66fda5f934b4cbf1bf58d719959f9b279323314353d"}
Jul 15 20:48:10.259409 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.259356    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jxxsn" event={"ID":"c2f3d74e-0b96-49c3-b0af-fb5ed23a1ed1","Type":"ContainerStarted","Data":"838b7ff8417814fa9a2244c582bd88c1981a0b9cbeecbc3cfdc5ca73b508345c"}
Jul 15 20:48:10.262484 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.262456    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:48:10.263169 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.262960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"2dba423e41c10e1a73f123ca2da31a140d7c5a095d505ceecb28f3ebe0b155d4"}
Jul 15 20:48:10.263714 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.263699    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:48:10.263792 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.263746    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nf4gs"
Jul 15 20:48:10.276729 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:10.276669    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jxxsn" podStartSLOduration=4.44735003 podStartE2EDuration="23.276651951s" totalImagesPullingTime="18.829301921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:10.276197964 +0000 UTC m=+23.725549617" watchObservedRunningTime="2026-07-15 20:48:10.276651951 +0000 UTC m=+23.726003583"
Jul 15 20:48:11.026096 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:11.025983    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T20:48:10.242782531Z","UUID":"758e1fdf-8744-4427-867d-b0b6b7f24b84","Handler":null,"Name":"","Endpoint":""}
Jul 15 20:48:11.027993 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:11.027968    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 20:48:11.028120 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:11.028017    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 20:48:11.137108 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:11.137079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:11.137108 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:11.137106    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:11.137407 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:11.137213    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:11.137407 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:11.137318    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:12.136952 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:12.136672    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:12.137481 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:12.137016    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:12.271628 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:12.271603    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:48:12.272008 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:12.271979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"d841223638baa8c798ce1352296a0d412da861cd1379d24f80b1d41f8c939278"}
Jul 15 20:48:12.277272 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:12.277235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl" event={"ID":"1ce29ad6-6afe-4203-af98-587b4c97689e","Type":"ContainerStarted","Data":"c630ac473f17176268ae664572002a411e199883248bdcd8e43b60f17b987a2e"}
Jul 15 20:48:12.301474 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:12.301402    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mh8cl" podStartSLOduration=4.095356478 podStartE2EDuration="25.301385754s" totalImagesPullingTime="21.206029276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:12.300898444 +0000 UTC m=+25.750250095" watchObservedRunningTime="2026-07-15 20:48:12.301385754 +0000 UTC m=+25.750737387"
Jul 15 20:48:13.137002 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:13.136966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:13.137576 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:13.137107    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:13.137576 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:13.137153    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:13.137576 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:13.137297    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:14.137148 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:14.136907    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:14.137761 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:14.137193    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:14.285038 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:14.285012    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:48:14.285432 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:14.285385    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"5c9c4a790f8ecdc5eadeb05ecc3c19ac2b2d83560bee87de15fc542619da8805"}
Jul 15 20:48:14.285663 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:14.285639    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:48:14.285852 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:14.285838    2565 scope.go:117] "RemoveContainer" containerID="8bb84f12ede955d87e051c1cf2a80cc5ecc2d727e58ad79c0e433b6be91d2b6b"
Jul 15 20:48:14.287250 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:14.287222    2565 generic.go:356] "Generic (PLEG): container finished" podID="4de84318-20d2-486a-969a-8a311cf332aa" containerID="d885f06ea0aa635e74cd209f08b91b70282cc6159d96ad95d4b2494af9b226f3" exitCode=0
Jul 15 20:48:14.287330 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:14.287260    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpg88" event={"ID":"4de84318-20d2-486a-969a-8a311cf332aa","Type":"ContainerDied","Data":"d885f06ea0aa635e74cd209f08b91b70282cc6159d96ad95d4b2494af9b226f3"}
Jul 15 20:48:14.301512 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:14.301487    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:48:15.136746 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.136713    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:15.137068 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.136757    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:15.137068 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:15.136850    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:15.137068 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:15.136982    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:15.293898 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.293865    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:48:15.294346 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.294229    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" event={"ID":"6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c","Type":"ContainerStarted","Data":"097faaea948adcae27b9dd620d83df602b58e810df4bb3440843af2582e47d05"}
Jul 15 20:48:15.294682 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.294659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:48:15.294811 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.294733    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:48:15.310403 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.310378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:48:15.325634 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.325583    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8" podStartSLOduration=9.626027992000001 podStartE2EDuration="28.325566458s" totalImagesPullingTime="18.699538466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:15.324083681 +0000 UTC m=+28.773435312" watchObservedRunningTime="2026-07-15 20:48:15.325566458 +0000 UTC m=+28.774918089"
Jul 15 20:48:15.643633 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.643429    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sc9np"]
Jul 15 20:48:15.643837 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.643709    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:15.643837 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:15.643809    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:15.646899 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.646871    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t9knt"]
Jul 15 20:48:15.647045 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.646965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:15.647106 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:15.647047    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:15.647454 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.647430    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s5ccb"]
Jul 15 20:48:15.647551 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:15.647525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:15.647625 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:15.647604    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:16.298379 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:16.298346    2565 generic.go:356] "Generic (PLEG): container finished" podID="4de84318-20d2-486a-969a-8a311cf332aa" containerID="d2f2c8b973699c7906d3fc1dcb0d3d8b9f2a6dbe0715ad0e9cb557febfbe8317" exitCode=0
Jul 15 20:48:16.298900 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:16.298446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpg88" event={"ID":"4de84318-20d2-486a-969a-8a311cf332aa","Type":"ContainerDied","Data":"d2f2c8b973699c7906d3fc1dcb0d3d8b9f2a6dbe0715ad0e9cb557febfbe8317"}
Jul 15 20:48:17.137066 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:17.137028    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:17.137250 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:17.137117    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:17.137250 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:17.137126    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:17.137361 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:17.137257    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:17.137361 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:17.137300    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:17.137504 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:17.137381    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:18.306179 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:18.306148    2565 generic.go:356] "Generic (PLEG): container finished" podID="4de84318-20d2-486a-969a-8a311cf332aa" containerID="15bd70432c0fe22cd243e91056897fffdc39d169f2c169b0c137d927d9992c00" exitCode=0
Jul 15 20:48:18.306891 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:18.306208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpg88" event={"ID":"4de84318-20d2-486a-969a-8a311cf332aa","Type":"ContainerDied","Data":"15bd70432c0fe22cd243e91056897fffdc39d169f2c169b0c137d927d9992c00"}
Jul 15 20:48:19.137046 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:19.137010    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:19.137046 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:19.137032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:19.137313 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:19.137040    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:19.137313 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:19.137130    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:19.137313 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:19.137225    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:19.137486 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:19.137308    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:20.719950 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:20.719849    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:20.720394 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:20.720020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:20.720394 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:20.720028    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 20:48:20.720394 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:20.720106    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret podName:6409d118-ba7a-46a7-8198-968fd28b9954 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:52.720084687 +0000 UTC m=+66.169436300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret") pod "global-pull-secret-syncer-sc9np" (UID: "6409d118-ba7a-46a7-8198-968fd28b9954") : object "kube-system"/"original-pull-secret" not registered
Jul 15 20:48:20.720394 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:20.720147    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 20:48:20.720394 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:20.720163    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 20:48:20.720394 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:20.720175    2565 projected.go:196] Error preparing data for projected volume kube-api-access-xzqft for pod openshift-network-diagnostics/network-check-target-t9knt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:48:20.720394 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:20.720224    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft podName:8130151f-9c0a-4a3c-a87b-b13a80538a0d nodeName:}" failed. No retries permitted until 2026-07-15 20:48:52.720213159 +0000 UTC m=+66.169564769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqft" (UniqueName: "kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft") pod "network-check-target-t9knt" (UID: "8130151f-9c0a-4a3c-a87b-b13a80538a0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 20:48:20.821125 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:20.821087    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:20.821301 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:20.821238    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:48:20.821364 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:20.821315    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs podName:bab8e407-a26a-4f3b-a174-2c422856c23e nodeName:}" failed. No retries permitted until 2026-07-15 20:48:52.821295205 +0000 UTC m=+66.270646815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs") pod "network-metrics-daemon-s5ccb" (UID: "bab8e407-a26a-4f3b-a174-2c422856c23e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 20:48:21.136354 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:21.136268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:21.136535 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:21.136268    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:21.136535 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:21.136434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:21.136535 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:21.136404    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sc9np" podUID="6409d118-ba7a-46a7-8198-968fd28b9954"
Jul 15 20:48:21.136535 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:21.136507    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t9knt" podUID="8130151f-9c0a-4a3c-a87b-b13a80538a0d"
Jul 15 20:48:21.136799 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:21.136597    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s5ccb" podUID="bab8e407-a26a-4f3b-a174-2c422856c23e"
Jul 15 20:48:22.316080 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.315846    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-96.ec2.internal" event="NodeReady"
Jul 15 20:48:22.316439 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.316224    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 20:48:22.369087 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.368901    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-s9n7s"]
Jul 15 20:48:22.370840 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.370820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.372714 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.372690    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dc68f489c-28h6z"]
Jul 15 20:48:22.373911 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.373666    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kll9v\""
Jul 15 20:48:22.373911 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.373875    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 20:48:22.375081 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.374106    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 20:48:22.377732 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.377714    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ttn6s"]
Jul 15 20:48:22.377883 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.377834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.379534 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.379516    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ttn6s"
Jul 15 20:48:22.380723 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.380703    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 20:48:22.380723 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.380719    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 20:48:22.380849 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.380783    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7hwd\""
Jul 15 20:48:22.383172 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.383153    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 20:48:22.383262 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.383191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 20:48:22.383362 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.383339    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 20:48:22.383438 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.383408    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 20:48:22.387918 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.387899    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pz297\""
Jul 15 20:48:22.388603 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.388585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s9n7s"]
Jul 15 20:48:22.388694 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.388626    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 20:48:22.395429 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.395393    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ttn6s"]
Jul 15 20:48:22.412200 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.412156    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dc68f489c-28h6z"]
Jul 15 20:48:22.530409 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-image-registry-private-configuration\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.530547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-certificates\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.530547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-bound-sa-token\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.530547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-trusted-ca\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.530668 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-installation-pull-secrets\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.530668 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grm2c\" (UniqueName: \"kubernetes.io/projected/e878706d-dbf6-460e-8b31-2da090515430-kube-api-access-grm2c\") pod \"ingress-canary-ttn6s\" (UID: \"e878706d-dbf6-460e-8b31-2da090515430\") " pod="openshift-ingress-canary/ingress-canary-ttn6s"
Jul 15 20:48:22.530668 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsrfv\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-kube-api-access-dsrfv\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.530812 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-ca-trust-extracted\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.530812 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e878706d-dbf6-460e-8b31-2da090515430-cert\") pod \"ingress-canary-ttn6s\" (UID: \"e878706d-dbf6-460e-8b31-2da090515430\") " pod="openshift-ingress-canary/ingress-canary-ttn6s"
Jul 15 20:48:22.530812 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9e685f-1743-444a-9224-f619d79ba4a6-tmp-dir\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.530812 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4x4f\" (UniqueName: \"kubernetes.io/projected/4d9e685f-1743-444a-9224-f619d79ba4a6-kube-api-access-b4x4f\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.530951 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d9e685f-1743-444a-9224-f619d79ba4a6-config-volume\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.530951 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.531014 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.530949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.632176 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e878706d-dbf6-460e-8b31-2da090515430-cert\") pod \"ingress-canary-ttn6s\" (UID: \"e878706d-dbf6-460e-8b31-2da090515430\") " pod="openshift-ingress-canary/ingress-canary-ttn6s"
Jul 15 20:48:22.632176 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9e685f-1743-444a-9224-f619d79ba4a6-tmp-dir\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.632176 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4x4f\" (UniqueName: \"kubernetes.io/projected/4d9e685f-1743-444a-9224-f619d79ba4a6-kube-api-access-b4x4f\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.632176 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d9e685f-1743-444a-9224-f619d79ba4a6-config-volume\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.632504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.632504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.632504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632455    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-image-registry-private-configuration\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.632504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632488    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-certificates\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.632504 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:22.632494    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:22.632511    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc68f489c-28h6z: secret "image-registry-tls" not found
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632513    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-bound-sa-token\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-trusted-ca\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9e685f-1743-444a-9224-f619d79ba4a6-tmp-dir\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:22.632558    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:22.632578    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls podName:6b100fb9-ab6f-4d65-befd-1c1a358e9a96 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:23.13255868 +0000 UTC m=+36.581910307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls") pod "image-registry-dc68f489c-28h6z" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96") : secret "image-registry-tls" not found
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:22.632628    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls podName:4d9e685f-1743-444a-9224-f619d79ba4a6 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:23.132611761 +0000 UTC m=+36.581963375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls") pod "dns-default-s9n7s" (UID: "4d9e685f-1743-444a-9224-f619d79ba4a6") : secret "dns-default-metrics-tls" not found
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-installation-pull-secrets\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grm2c\" (UniqueName: \"kubernetes.io/projected/e878706d-dbf6-460e-8b31-2da090515430-kube-api-access-grm2c\") pod \"ingress-canary-ttn6s\" (UID: \"e878706d-dbf6-460e-8b31-2da090515430\") " pod="openshift-ingress-canary/ingress-canary-ttn6s"
Jul 15 20:48:22.632743 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsrfv\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-kube-api-access-dsrfv\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.633191 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d9e685f-1743-444a-9224-f619d79ba4a6-config-volume\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.633191 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.632800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-ca-trust-extracted\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.633191 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.633072    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-certificates\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.633318 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.633299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-ca-trust-extracted\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.633595 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.633578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-trusted-ca\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.636626 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.636606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-image-registry-private-configuration\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.636724 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.636637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-installation-pull-secrets\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.636793 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.636725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e878706d-dbf6-460e-8b31-2da090515430-cert\") pod \"ingress-canary-ttn6s\" (UID: \"e878706d-dbf6-460e-8b31-2da090515430\") " pod="openshift-ingress-canary/ingress-canary-ttn6s"
Jul 15 20:48:22.643523 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.643500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4x4f\" (UniqueName: \"kubernetes.io/projected/4d9e685f-1743-444a-9224-f619d79ba4a6-kube-api-access-b4x4f\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:22.643610 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.643587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grm2c\" (UniqueName: \"kubernetes.io/projected/e878706d-dbf6-460e-8b31-2da090515430-kube-api-access-grm2c\") pod \"ingress-canary-ttn6s\" (UID: \"e878706d-dbf6-460e-8b31-2da090515430\") " pod="openshift-ingress-canary/ingress-canary-ttn6s"
Jul 15 20:48:22.643744 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.643730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsrfv\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-kube-api-access-dsrfv\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.643996 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.643975    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-bound-sa-token\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:22.733544 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.733497    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ttn6s"
Jul 15 20:48:22.871983 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:22.871954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ttn6s"]
Jul 15 20:48:22.875719 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:48:22.875689    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode878706d_dbf6_460e_8b31_2da090515430.slice/crio-45814e036ab9f92e5345fbcce2fba341e08961355edc0b9c92bdba2a77eb4e92 WatchSource:0}: Error finding container 45814e036ab9f92e5345fbcce2fba341e08961355edc0b9c92bdba2a77eb4e92: Status 404 returned error can't find the container with id 45814e036ab9f92e5345fbcce2fba341e08961355edc0b9c92bdba2a77eb4e92
Jul 15 20:48:23.136621 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.136588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:23.136621 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.136616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:23.136853 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.136647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:23.136853 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.136588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:23.136853 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.136588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:23.136853 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:23.136775    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:48:23.136853 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:23.136792    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc68f489c-28h6z: secret "image-registry-tls" not found
Jul 15 20:48:23.137082 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:23.136864    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:48:23.137082 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:23.136905    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls podName:6b100fb9-ab6f-4d65-befd-1c1a358e9a96 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:24.136886156 +0000 UTC m=+37.586237781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls") pod "image-registry-dc68f489c-28h6z" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96") : secret "image-registry-tls" not found
Jul 15 20:48:23.137082 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:23.136925    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls podName:4d9e685f-1743-444a-9224-f619d79ba4a6 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:24.136915544 +0000 UTC m=+37.586267155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls") pod "dns-default-s9n7s" (UID: "4d9e685f-1743-444a-9224-f619d79ba4a6") : secret "dns-default-metrics-tls" not found
Jul 15 20:48:23.139499 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.139481    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 20:48:23.140250 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.140229    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 20:48:23.140332 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.140267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 20:48:23.140383 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.140234    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lxhhk\""
Jul 15 20:48:23.140383 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.140267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5sgcj\""
Jul 15 20:48:23.140474 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.140232    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 20:48:23.322094 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.322058    2565 generic.go:356] "Generic (PLEG): container finished" podID="4de84318-20d2-486a-969a-8a311cf332aa" containerID="f69a9cbb9bf5006c0c1f5431c78a9599a83c2b2668c5ddbecd3dd701044fa2b8" exitCode=0
Jul 15 20:48:23.322547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.322140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpg88" event={"ID":"4de84318-20d2-486a-969a-8a311cf332aa","Type":"ContainerDied","Data":"f69a9cbb9bf5006c0c1f5431c78a9599a83c2b2668c5ddbecd3dd701044fa2b8"}
Jul 15 20:48:23.325033 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:23.324565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ttn6s" event={"ID":"e878706d-dbf6-460e-8b31-2da090515430","Type":"ContainerStarted","Data":"45814e036ab9f92e5345fbcce2fba341e08961355edc0b9c92bdba2a77eb4e92"}
Jul 15 20:48:24.145579 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:24.145542    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:24.145732 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:24.145635    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:24.145732 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:24.145685    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:48:24.145732 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:24.145716    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:48:24.145732 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:24.145727    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc68f489c-28h6z: secret "image-registry-tls" not found
Jul 15 20:48:24.145905 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:24.145752    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls podName:4d9e685f-1743-444a-9224-f619d79ba4a6 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.14573515 +0000 UTC m=+39.595086759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls") pod "dns-default-s9n7s" (UID: "4d9e685f-1743-444a-9224-f619d79ba4a6") : secret "dns-default-metrics-tls" not found
Jul 15 20:48:24.145905 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:24.145767    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls podName:6b100fb9-ab6f-4d65-befd-1c1a358e9a96 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:26.14576082 +0000 UTC m=+39.595112430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls") pod "image-registry-dc68f489c-28h6z" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96") : secret "image-registry-tls" not found
Jul 15 20:48:24.330041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:24.330004    2565 generic.go:356] "Generic (PLEG): container finished" podID="4de84318-20d2-486a-969a-8a311cf332aa" containerID="d7a0c844a4dec35d43e9d43ac8a26fce723a63a3375db6450ea80525ada2d734" exitCode=0
Jul 15 20:48:24.330480 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:24.330078    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpg88" event={"ID":"4de84318-20d2-486a-969a-8a311cf332aa","Type":"ContainerDied","Data":"d7a0c844a4dec35d43e9d43ac8a26fce723a63a3375db6450ea80525ada2d734"}
Jul 15 20:48:25.334943 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:25.334905    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ttn6s" event={"ID":"e878706d-dbf6-460e-8b31-2da090515430","Type":"ContainerStarted","Data":"7228b27bd9985d1574dd0659c2d018f1bc30cce6978901729296fcf7a5dcaf2d"}
Jul 15 20:48:25.338434 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:25.338393    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hpg88" event={"ID":"4de84318-20d2-486a-969a-8a311cf332aa","Type":"ContainerStarted","Data":"8e97e9725fc5921dd7374c07eb35f482b086038d30732ff9acd4312f035c57d4"}
Jul 15 20:48:25.351466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:25.351381    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ttn6s" podStartSLOduration=1.078540329 podStartE2EDuration="3.351362498s" totalImagesPullingTime="2.272822169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:25.351135547 +0000 UTC m=+38.800487178" watchObservedRunningTime="2026-07-15 20:48:25.351362498 +0000 UTC m=+38.800714135"
Jul 15 20:48:25.373113 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:25.373057    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hpg88" podStartSLOduration=9.034110045 podStartE2EDuration="38.373038343s" totalImagesPullingTime="29.338928298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:25.371861543 +0000 UTC m=+38.821213234" watchObservedRunningTime="2026-07-15 20:48:25.373038343 +0000 UTC m=+38.822389976"
Jul 15 20:48:26.162053 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:26.162003    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:26.162053 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:26.162051    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:26.162274 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:26.162152    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:48:26.162274 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:26.162163    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:48:26.162274 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:26.162187    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc68f489c-28h6z: secret "image-registry-tls" not found
Jul 15 20:48:26.162274 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:26.162217    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls podName:4d9e685f-1743-444a-9224-f619d79ba4a6 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:30.162202247 +0000 UTC m=+43.611553857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls") pod "dns-default-s9n7s" (UID: "4d9e685f-1743-444a-9224-f619d79ba4a6") : secret "dns-default-metrics-tls" not found
Jul 15 20:48:26.162274 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:26.162241    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls podName:6b100fb9-ab6f-4d65-befd-1c1a358e9a96 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:30.1622287 +0000 UTC m=+43.611580309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls") pod "image-registry-dc68f489c-28h6z" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96") : secret "image-registry-tls" not found
Jul 15 20:48:29.861873 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.861844    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-shmgt"]
Jul 15 20:48:29.893027 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.892994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shmgt"]
Jul 15 20:48:29.893156 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.893123    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:29.895334 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.895318    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 20:48:29.895433 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.895318    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 20:48:29.896189 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.896174    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 20:48:29.896251 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.896232    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wc9r4\""
Jul 15 20:48:29.896301 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.896263    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 20:48:29.989160 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.989127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7773-c922-48a6-85b7-88c5d91afd19-data-volume\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:29.989160 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.989158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfql4\" (UniqueName: \"kubernetes.io/projected/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-api-access-vfql4\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:29.989406 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.989198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:29.989406 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.989252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c4f7773-c922-48a6-85b7-88c5d91afd19-crio-socket\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:29.989406 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:29.989344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.090192 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.090154    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7773-c922-48a6-85b7-88c5d91afd19-data-volume\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.090367 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.090199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfql4\" (UniqueName: \"kubernetes.io/projected/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-api-access-vfql4\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.090367 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.090250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.090367 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.090268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c4f7773-c922-48a6-85b7-88c5d91afd19-crio-socket\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.090367 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.090334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.090586 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.090387    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:48:30.090586 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.090457    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:30.090586 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.090523    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:30.590502457 +0000 UTC m=+44.039854081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : configmap "kube-rbac-proxy" not found
Jul 15 20:48:30.090586 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.090543    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:30.590534159 +0000 UTC m=+44.039885776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:30.090586 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.090547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5c4f7773-c922-48a6-85b7-88c5d91afd19-crio-socket\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.090760 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.090586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c4f7773-c922-48a6-85b7-88c5d91afd19-data-volume\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.099809 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.099788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfql4\" (UniqueName: \"kubernetes.io/projected/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-api-access-vfql4\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.190945 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.190845    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:30.190945 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.190881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:30.191174 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.191006    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:48:30.191174 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.191017    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:48:30.191174 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.191039    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc68f489c-28h6z: secret "image-registry-tls" not found
Jul 15 20:48:30.191174 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.191071    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls podName:4d9e685f-1743-444a-9224-f619d79ba4a6 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:38.19105458 +0000 UTC m=+51.640406196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls") pod "dns-default-s9n7s" (UID: "4d9e685f-1743-444a-9224-f619d79ba4a6") : secret "dns-default-metrics-tls" not found
Jul 15 20:48:30.191174 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.191099    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls podName:6b100fb9-ab6f-4d65-befd-1c1a358e9a96 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:38.191083008 +0000 UTC m=+51.640434618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls") pod "image-registry-dc68f489c-28h6z" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96") : secret "image-registry-tls" not found
Jul 15 20:48:30.594039 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.593999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.594200 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:30.594069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:30.594200 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.594139    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:48:30.594200 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.594194    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:30.594296 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.594206    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:31.594191208 +0000 UTC m=+45.043542818 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : configmap "kube-rbac-proxy" not found
Jul 15 20:48:30.594296 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:30.594232    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:31.594221591 +0000 UTC m=+45.043573201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:31.602702 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:31.602669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:31.603167 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:31.602729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:31.603167 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:31.602788    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:48:31.603167 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:31.602814    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:31.603167 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:31.602853    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:33.602837761 +0000 UTC m=+47.052189371 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : configmap "kube-rbac-proxy" not found
Jul 15 20:48:31.603167 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:31.602867    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:33.602861035 +0000 UTC m=+47.052212645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:31.841995 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:31.841969    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cv2qk_afaee93c-636f-450c-83ea-2c3cb136e163/dns-node-resolver/0.log"
Jul 15 20:48:32.642080 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:32.642051    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97qm5_adf4b109-9939-43ae-9915-f9567149710c/node-ca/0.log"
Jul 15 20:48:33.619196 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:33.619156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:33.619371 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:33.619219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:33.619371 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:33.619277    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 20:48:33.619371 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:33.619339    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:37.619323876 +0000 UTC m=+51.068675486 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : configmap "kube-rbac-proxy" not found
Jul 15 20:48:33.619371 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:33.619352    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:33.619536 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:33.619400    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:37.619387791 +0000 UTC m=+51.068739406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:33.841569 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:33.841541    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ttn6s_e878706d-dbf6-460e-8b31-2da090515430/serve-healthcheck-canary/0.log"
Jul 15 20:48:37.650782 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:37.650741    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:37.651288 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:37.650812    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:37.651288 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:37.650924    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:37.651288 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:37.650989    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls podName:5c4f7773-c922-48a6-85b7-88c5d91afd19 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:45.650973381 +0000 UTC m=+59.100324991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls") pod "insights-runtime-extractor-shmgt" (UID: "5c4f7773-c922-48a6-85b7-88c5d91afd19") : secret "insights-runtime-extractor-tls" not found
Jul 15 20:48:37.651487 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:37.651376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5c4f7773-c922-48a6-85b7-88c5d91afd19-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:38.256124 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:38.256080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:38.256124 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:38.256120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:38.256387 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:38.256230    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 20:48:38.256387 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:38.256241    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 20:48:38.256387 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:38.256264    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dc68f489c-28h6z: secret "image-registry-tls" not found
Jul 15 20:48:38.256387 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:38.256288    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls podName:4d9e685f-1743-444a-9224-f619d79ba4a6 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:54.256271634 +0000 UTC m=+67.705623258 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls") pod "dns-default-s9n7s" (UID: "4d9e685f-1743-444a-9224-f619d79ba4a6") : secret "dns-default-metrics-tls" not found
Jul 15 20:48:38.256387 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:48:38.256317    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls podName:6b100fb9-ab6f-4d65-befd-1c1a358e9a96 nodeName:}" failed. No retries permitted until 2026-07-15 20:48:54.256298505 +0000 UTC m=+67.705650115 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls") pod "image-registry-dc68f489c-28h6z" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96") : secret "image-registry-tls" not found
Jul 15 20:48:45.713620 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:45.713575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:45.715909 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:45.715883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5c4f7773-c922-48a6-85b7-88c5d91afd19-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-shmgt\" (UID: \"5c4f7773-c922-48a6-85b7-88c5d91afd19\") " pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:45.802048 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:45.802011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-shmgt"
Jul 15 20:48:45.933558 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:45.933519    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-shmgt"]
Jul 15 20:48:45.938610 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:48:45.938581    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c4f7773_c922_48a6_85b7_88c5d91afd19.slice/crio-f7ee461c0a22e1e81e91d312f72a57dbaa8e11679be7a5b2ecde8c187acfc283 WatchSource:0}: Error finding container f7ee461c0a22e1e81e91d312f72a57dbaa8e11679be7a5b2ecde8c187acfc283: Status 404 returned error can't find the container with id f7ee461c0a22e1e81e91d312f72a57dbaa8e11679be7a5b2ecde8c187acfc283
Jul 15 20:48:46.386885 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:46.386844    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shmgt" event={"ID":"5c4f7773-c922-48a6-85b7-88c5d91afd19","Type":"ContainerStarted","Data":"f7ee461c0a22e1e81e91d312f72a57dbaa8e11679be7a5b2ecde8c187acfc283"}
Jul 15 20:48:47.315545 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:47.315519    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rdlc8"
Jul 15 20:48:51.399745 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:51.399705    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shmgt" event={"ID":"5c4f7773-c922-48a6-85b7-88c5d91afd19","Type":"ContainerStarted","Data":"78a3d684522fc86302e2b4dd43b500495e53a6315b2e1dcf76af5fe8c29e92a3"}
Jul 15 20:48:52.769790 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.769745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:52.770196 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.769837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:52.772817 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.772792    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 20:48:52.772936 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.772829    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 20:48:52.782400 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.782376    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 20:48:52.782525 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.782440    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6409d118-ba7a-46a7-8198-968fd28b9954-original-pull-secret\") pod \"global-pull-secret-syncer-sc9np\" (UID: \"6409d118-ba7a-46a7-8198-968fd28b9954\") " pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:52.792683 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.792656    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzqft\" (UniqueName: \"kubernetes.io/projected/8130151f-9c0a-4a3c-a87b-b13a80538a0d-kube-api-access-xzqft\") pod \"network-check-target-t9knt\" (UID: \"8130151f-9c0a-4a3c-a87b-b13a80538a0d\") " pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:52.850031 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.850001    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5sgcj\""
Jul 15 20:48:52.853337 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.853310    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sc9np"
Jul 15 20:48:52.858356 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.858333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:48:52.871184 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.871158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:52.874113 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.874092    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 20:48:52.884466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:52.884444    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bab8e407-a26a-4f3b-a174-2c422856c23e-metrics-certs\") pod \"network-metrics-daemon-s5ccb\" (UID: \"bab8e407-a26a-4f3b-a174-2c422856c23e\") " pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:53.163299 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:53.163228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lxhhk\""
Jul 15 20:48:53.171129 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:53.171095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s5ccb"
Jul 15 20:48:54.281742 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.281695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:54.282269 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.281752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:54.284305 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.284278    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9e685f-1743-444a-9224-f619d79ba4a6-metrics-tls\") pod \"dns-default-s9n7s\" (UID: \"4d9e685f-1743-444a-9224-f619d79ba4a6\") " pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:54.284490 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.284472    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"image-registry-dc68f489c-28h6z\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") " pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:54.488761 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.488733    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kll9v\""
Jul 15 20:48:54.497012 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.496987    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:54.512996 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.512968    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n7hwd\""
Jul 15 20:48:54.521183 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.521153    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:54.956968 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:54.956926    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dc68f489c-28h6z"]
Jul 15 20:48:55.075436 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:48:55.075393    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b100fb9_ab6f_4d65_befd_1c1a358e9a96.slice/crio-e499b8cdac09311c72d7ea1baedba9a698e2a15ab28078510a02bf61267d3271 WatchSource:0}: Error finding container e499b8cdac09311c72d7ea1baedba9a698e2a15ab28078510a02bf61267d3271: Status 404 returned error can't find the container with id e499b8cdac09311c72d7ea1baedba9a698e2a15ab28078510a02bf61267d3271
Jul 15 20:48:55.186204 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.186120    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t9knt"]
Jul 15 20:48:55.187152 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.187114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s5ccb"]
Jul 15 20:48:55.188018 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.187998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-s9n7s"]
Jul 15 20:48:55.188840 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.188811    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sc9np"]
Jul 15 20:48:55.191034 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:48:55.191006    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9e685f_1743_444a_9224_f619d79ba4a6.slice/crio-1f13090cbe07f637f808c39bff577b5b81793e268e0ca00beafbc6b390f7bf99 WatchSource:0}: Error finding container 1f13090cbe07f637f808c39bff577b5b81793e268e0ca00beafbc6b390f7bf99: Status 404 returned error can't find the container with id 1f13090cbe07f637f808c39bff577b5b81793e268e0ca00beafbc6b390f7bf99
Jul 15 20:48:55.191611 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:48:55.191588    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6409d118_ba7a_46a7_8198_968fd28b9954.slice/crio-4d3a7ccc58c2050c0c3a2094a46bc7c5399dc657cb757c4328a9982c630f7dce WatchSource:0}: Error finding container 4d3a7ccc58c2050c0c3a2094a46bc7c5399dc657cb757c4328a9982c630f7dce: Status 404 returned error can't find the container with id 4d3a7ccc58c2050c0c3a2094a46bc7c5399dc657cb757c4328a9982c630f7dce
Jul 15 20:48:55.192261 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:48:55.192227    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8130151f_9c0a_4a3c_a87b_b13a80538a0d.slice/crio-ea49fd2aafaaf0341a74efaf5748bce959de943180db3b8f1b6dacf81e24b1ef WatchSource:0}: Error finding container ea49fd2aafaaf0341a74efaf5748bce959de943180db3b8f1b6dacf81e24b1ef: Status 404 returned error can't find the container with id ea49fd2aafaaf0341a74efaf5748bce959de943180db3b8f1b6dacf81e24b1ef
Jul 15 20:48:55.193356 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:48:55.193335    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab8e407_a26a_4f3b_a174_2c422856c23e.slice/crio-9dc55164d99280206f1c829376c1bcfa38f5a0b0111543cd78e7884479fa3fc5 WatchSource:0}: Error finding container 9dc55164d99280206f1c829376c1bcfa38f5a0b0111543cd78e7884479fa3fc5: Status 404 returned error can't find the container with id 9dc55164d99280206f1c829376c1bcfa38f5a0b0111543cd78e7884479fa3fc5
Jul 15 20:48:55.411639 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.411551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sc9np" event={"ID":"6409d118-ba7a-46a7-8198-968fd28b9954","Type":"ContainerStarted","Data":"4d3a7ccc58c2050c0c3a2094a46bc7c5399dc657cb757c4328a9982c630f7dce"}
Jul 15 20:48:55.412827 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.412795    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t9knt" event={"ID":"8130151f-9c0a-4a3c-a87b-b13a80538a0d","Type":"ContainerStarted","Data":"ea49fd2aafaaf0341a74efaf5748bce959de943180db3b8f1b6dacf81e24b1ef"}
Jul 15 20:48:55.414037 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.414011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5ccb" event={"ID":"bab8e407-a26a-4f3b-a174-2c422856c23e","Type":"ContainerStarted","Data":"9dc55164d99280206f1c829376c1bcfa38f5a0b0111543cd78e7884479fa3fc5"}
Jul 15 20:48:55.415203 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.415178    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9n7s" event={"ID":"4d9e685f-1743-444a-9224-f619d79ba4a6","Type":"ContainerStarted","Data":"1f13090cbe07f637f808c39bff577b5b81793e268e0ca00beafbc6b390f7bf99"}
Jul 15 20:48:55.417095 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.417074    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shmgt" event={"ID":"5c4f7773-c922-48a6-85b7-88c5d91afd19","Type":"ContainerStarted","Data":"d1f4dce4e7582da43ff356335943462b7b3d5086275bd5dbec5e9335880f80c2"}
Jul 15 20:48:55.418653 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.418616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dc68f489c-28h6z" event={"ID":"6b100fb9-ab6f-4d65-befd-1c1a358e9a96","Type":"ContainerStarted","Data":"db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5"}
Jul 15 20:48:55.418751 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.418670    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dc68f489c-28h6z" event={"ID":"6b100fb9-ab6f-4d65-befd-1c1a358e9a96","Type":"ContainerStarted","Data":"e499b8cdac09311c72d7ea1baedba9a698e2a15ab28078510a02bf61267d3271"}
Jul 15 20:48:55.418808 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:55.418766    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:48:57.429842 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:57.429714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5ccb" event={"ID":"bab8e407-a26a-4f3b-a174-2c422856c23e","Type":"ContainerStarted","Data":"dba4766066cf46c663ee242b5b61a940ef5ea6249cc77a7db200bd750e5c5c94"}
Jul 15 20:48:58.436485 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.436447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s5ccb" event={"ID":"bab8e407-a26a-4f3b-a174-2c422856c23e","Type":"ContainerStarted","Data":"260ffa64b6b585886c5b805a441f0a8b9411922c8e2a945244c20bc3181bf38a"}
Jul 15 20:48:58.438520 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.438492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9n7s" event={"ID":"4d9e685f-1743-444a-9224-f619d79ba4a6","Type":"ContainerStarted","Data":"638ed4cc42919e53b90ef7cc4bf17565d8eedd6b0ff3985eb398725b7d2085ce"}
Jul 15 20:48:58.438653 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.438544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-s9n7s" event={"ID":"4d9e685f-1743-444a-9224-f619d79ba4a6","Type":"ContainerStarted","Data":"d0e5ccb181e4487a3b863893764f2ee2a3ac8b1d3d044d6fef5cc35d3d782ef0"}
Jul 15 20:48:58.438653 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.438627    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:48:58.462990 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.462934    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dc68f489c-28h6z" podStartSLOduration=61.462916247 podStartE2EDuration="1m1.462916247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:55.441196393 +0000 UTC m=+68.890548024" watchObservedRunningTime="2026-07-15 20:48:58.462916247 +0000 UTC m=+71.912267876"
Jul 15 20:48:58.497863 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.497800    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s5ccb" podStartSLOduration=70.097614966 podStartE2EDuration="1m11.497783209s" totalImagesPullingTime="1.400168243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:58.462732979 +0000 UTC m=+71.912084712" watchObservedRunningTime="2026-07-15 20:48:58.497783209 +0000 UTC m=+71.947134840"
Jul 15 20:48:58.498042 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.497910    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-s9n7s" podStartSLOduration=34.180596845 podStartE2EDuration="36.497902468s" totalImagesPullingTime="2.317305623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:48:58.496343359 +0000 UTC m=+71.945695015" watchObservedRunningTime="2026-07-15 20:48:58.497902468 +0000 UTC m=+71.947254113"
Jul 15 20:48:58.679217 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.679181    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"]
Jul 15 20:48:58.682321 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.682298    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"
Jul 15 20:48:58.684312 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.684284    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dc68f489c-28h6z"]
Jul 15 20:48:58.685954 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.685930    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 20:48:58.686851 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.686586    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 20:48:58.686851 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.686684    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6xn2k\""
Jul 15 20:48:58.686851 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.686696    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 20:48:58.687934 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.687914    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 20:48:58.705821 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.705793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"]
Jul 15 20:48:58.715808 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.715778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a809966-dddc-47fb-a372-ce80119f1b17-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c7575594-fn5mp\" (UID: \"0a809966-dddc-47fb-a372-ce80119f1b17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"
Jul 15 20:48:58.715962 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.715887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc6bf\" (UniqueName: \"kubernetes.io/projected/0a809966-dddc-47fb-a372-ce80119f1b17-kube-api-access-pc6bf\") pod \"managed-serviceaccount-addon-agent-77c7575594-fn5mp\" (UID: \"0a809966-dddc-47fb-a372-ce80119f1b17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"
Jul 15 20:48:58.795012 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.794976    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cfffc4cdb-k24hj"]
Jul 15 20:48:58.798076 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.798050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:58.812523 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.812491    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cfffc4cdb-k24hj"]
Jul 15 20:48:58.816570 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.816540    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a809966-dddc-47fb-a372-ce80119f1b17-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c7575594-fn5mp\" (UID: \"0a809966-dddc-47fb-a372-ce80119f1b17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"
Jul 15 20:48:58.816689 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.816616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc6bf\" (UniqueName: \"kubernetes.io/projected/0a809966-dddc-47fb-a372-ce80119f1b17-kube-api-access-pc6bf\") pod \"managed-serviceaccount-addon-agent-77c7575594-fn5mp\" (UID: \"0a809966-dddc-47fb-a372-ce80119f1b17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"
Jul 15 20:48:58.819903 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.819874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a809966-dddc-47fb-a372-ce80119f1b17-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-77c7575594-fn5mp\" (UID: \"0a809966-dddc-47fb-a372-ce80119f1b17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"
Jul 15 20:48:58.844244 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.844216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc6bf\" (UniqueName: \"kubernetes.io/projected/0a809966-dddc-47fb-a372-ce80119f1b17-kube-api-access-pc6bf\") pod \"managed-serviceaccount-addon-agent-77c7575594-fn5mp\" (UID: \"0a809966-dddc-47fb-a372-ce80119f1b17\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"
Jul 15 20:48:58.917164 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.917129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-image-registry-private-configuration\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:58.917164 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.917167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-trusted-ca\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:58.917387 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.917192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-registry-tls\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:58.917387 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.917218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-registry-certificates\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:58.917387 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.917296    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-ca-trust-extracted\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:58.917387 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.917319    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-bound-sa-token\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:58.917387 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.917346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khd6q\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-kube-api-access-khd6q\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:58.917605 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:58.917441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-installation-pull-secrets\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.004278 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.004240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"
Jul 15 20:48:59.018079 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-ca-trust-extracted\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.018221 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-bound-sa-token\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.018221 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khd6q\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-kube-api-access-khd6q\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.018221 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-installation-pull-secrets\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.018221 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-image-registry-private-configuration\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.018221 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018209    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-trusted-ca\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.018514 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-registry-tls\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.018514 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-registry-certificates\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.018514 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.018468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-ca-trust-extracted\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.019142 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.019118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-registry-certificates\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.019241 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.019210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-trusted-ca\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.021237 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.021210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-registry-tls\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.021325 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.021240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-installation-pull-secrets\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.021383 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.021350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-image-registry-private-configuration\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.038264 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.038232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-bound-sa-token\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.039733 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.039713    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khd6q\" (UniqueName: \"kubernetes.io/projected/5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4-kube-api-access-khd6q\") pod \"image-registry-7cfffc4cdb-k24hj\" (UID: \"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4\") " pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:48:59.108209 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:48:59.108172    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:49:01.879007 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:01.878962    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-284pl"]
Jul 15 20:49:01.883968 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:01.883946    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-284pl"
Jul 15 20:49:01.887068 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:01.887045    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 20:49:01.887663 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:01.887645    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 20:49:01.894261 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:01.894235    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vdmv6\""
Jul 15 20:49:01.909149 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:01.909111    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-284pl"]
Jul 15 20:49:01.943584 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:01.943541    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfqwl\" (UniqueName: \"kubernetes.io/projected/99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a-kube-api-access-lfqwl\") pod \"downloads-68c9cbb497-284pl\" (UID: \"99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a\") " pod="openshift-console/downloads-68c9cbb497-284pl"
Jul 15 20:49:02.045324 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.045275    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfqwl\" (UniqueName: \"kubernetes.io/projected/99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a-kube-api-access-lfqwl\") pod \"downloads-68c9cbb497-284pl\" (UID: \"99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a\") " pod="openshift-console/downloads-68c9cbb497-284pl"
Jul 15 20:49:02.055034 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.054827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfqwl\" (UniqueName: \"kubernetes.io/projected/99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a-kube-api-access-lfqwl\") pod \"downloads-68c9cbb497-284pl\" (UID: \"99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a\") " pod="openshift-console/downloads-68c9cbb497-284pl"
Jul 15 20:49:02.188871 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.188836    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp"]
Jul 15 20:49:02.192190 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:49:02.192138    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a809966_dddc_47fb_a372_ce80119f1b17.slice/crio-7a0f5313699154b23f978b7ce83c49f540ae764c63ee33e6d8aeaf6940b5818f WatchSource:0}: Error finding container 7a0f5313699154b23f978b7ce83c49f540ae764c63ee33e6d8aeaf6940b5818f: Status 404 returned error can't find the container with id 7a0f5313699154b23f978b7ce83c49f540ae764c63ee33e6d8aeaf6940b5818f
Jul 15 20:49:02.194810 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.194732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-284pl"
Jul 15 20:49:02.215054 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.215019    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cfffc4cdb-k24hj"]
Jul 15 20:49:02.218280 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:49:02.218243    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6e35fc_b81f_45c8_95a4_1d5f6fe41ac4.slice/crio-5cf94666c6cc6359c761f762a7a439ce7900161f7e223a46d91a928c41915324 WatchSource:0}: Error finding container 5cf94666c6cc6359c761f762a7a439ce7900161f7e223a46d91a928c41915324: Status 404 returned error can't find the container with id 5cf94666c6cc6359c761f762a7a439ce7900161f7e223a46d91a928c41915324
Jul 15 20:49:02.342760 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.342721    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-284pl"]
Jul 15 20:49:02.347496 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:49:02.347470    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99dfb8a1_4876_41c2_bb4e_7d2d64c32e5a.slice/crio-1ec87857fdfb9ef7b31ea7c09e288510654e03410b9ace36b4e382eeacf41211 WatchSource:0}: Error finding container 1ec87857fdfb9ef7b31ea7c09e288510654e03410b9ace36b4e382eeacf41211: Status 404 returned error can't find the container with id 1ec87857fdfb9ef7b31ea7c09e288510654e03410b9ace36b4e382eeacf41211
Jul 15 20:49:02.458981 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.458896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-shmgt" event={"ID":"5c4f7773-c922-48a6-85b7-88c5d91afd19","Type":"ContainerStarted","Data":"1153596f2c1db968d3e4980e48ab01a2039e9832dc8dbb1dc216a2c0cd5e978a"}
Jul 15 20:49:02.460533 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.460506    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj" event={"ID":"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4","Type":"ContainerStarted","Data":"0816d7a021379effca72fe848dcd12db6f0fda0059b0388a79ff9aa56796140b"}
Jul 15 20:49:02.460647 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.460548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj" event={"ID":"5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4","Type":"ContainerStarted","Data":"5cf94666c6cc6359c761f762a7a439ce7900161f7e223a46d91a928c41915324"}
Jul 15 20:49:02.460647 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.460575    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:49:02.461976 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.461951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sc9np" event={"ID":"6409d118-ba7a-46a7-8198-968fd28b9954","Type":"ContainerStarted","Data":"5359b35786a376d6d706b287e6212d419bb830db1a39a41b10cf7e0c0036a0a9"}
Jul 15 20:49:02.463473 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.463452    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t9knt" event={"ID":"8130151f-9c0a-4a3c-a87b-b13a80538a0d","Type":"ContainerStarted","Data":"e117e8a12ed2fdbf7763871eecc069d1decd28100935e9a425aa1a9a01c1d1ba"}
Jul 15 20:49:02.463574 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.463535    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:49:02.464669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.464637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-284pl" event={"ID":"99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a","Type":"ContainerStarted","Data":"1ec87857fdfb9ef7b31ea7c09e288510654e03410b9ace36b4e382eeacf41211"}
Jul 15 20:49:02.465688 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.465669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp" event={"ID":"0a809966-dddc-47fb-a372-ce80119f1b17","Type":"ContainerStarted","Data":"7a0f5313699154b23f978b7ce83c49f540ae764c63ee33e6d8aeaf6940b5818f"}
Jul 15 20:49:02.487010 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.486964    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-shmgt" podStartSLOduration=17.600093897 podStartE2EDuration="33.48694752s" totalImagesPullingTime="15.886853623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:48:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:02.486490559 +0000 UTC m=+75.935842212" watchObservedRunningTime="2026-07-15 20:49:02.48694752 +0000 UTC m=+75.936299152"
Jul 15 20:49:02.518949 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.518901    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj" podStartSLOduration=4.518886398 podStartE2EDuration="4.518886398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:02.517947781 +0000 UTC m=+75.967299414" watchObservedRunningTime="2026-07-15 20:49:02.518886398 +0000 UTC m=+75.968238007"
Jul 15 20:49:02.535201 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.535146    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sc9np" podStartSLOduration=68.69874362 podStartE2EDuration="1m15.535130817s" totalImagesPullingTime="6.836387197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:02.534715983 +0000 UTC m=+75.984067627" watchObservedRunningTime="2026-07-15 20:49:02.535130817 +0000 UTC m=+75.984482447"
Jul 15 20:49:02.555068 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:02.555006    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t9knt" podStartSLOduration=68.730267263 podStartE2EDuration="1m15.554986618s" totalImagesPullingTime="6.824719355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:02.554737997 +0000 UTC m=+76.004089658" watchObservedRunningTime="2026-07-15 20:49:02.554986618 +0000 UTC m=+76.004338251"
Jul 15 20:49:05.128969 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.128713    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x6v5w"]
Jul 15 20:49:05.137813 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.137774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.140610 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.140585    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 20:49:05.141600 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.141578    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-h64l9\""
Jul 15 20:49:05.141708 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.141648    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 20:49:05.141767 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.141710    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 20:49:05.141767 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.141748    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 20:49:05.142065 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.141985    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 20:49:05.143681 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.143662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x6v5w"]
Jul 15 20:49:05.275554 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.275514    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3f1700-05f3-4624-98e8-ccb027cf426a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.275740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.275575    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3f1700-05f3-4624-98e8-ccb027cf426a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.275740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.275666    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql8kv\" (UniqueName: \"kubernetes.io/projected/2f3f1700-05f3-4624-98e8-ccb027cf426a-kube-api-access-ql8kv\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.275740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.275729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f3f1700-05f3-4624-98e8-ccb027cf426a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.376121 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.376079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql8kv\" (UniqueName: \"kubernetes.io/projected/2f3f1700-05f3-4624-98e8-ccb027cf426a-kube-api-access-ql8kv\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.376308 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.376151    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f3f1700-05f3-4624-98e8-ccb027cf426a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.376308 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.376191    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3f1700-05f3-4624-98e8-ccb027cf426a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.376308 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.376229    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3f1700-05f3-4624-98e8-ccb027cf426a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.377721 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.377672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f3f1700-05f3-4624-98e8-ccb027cf426a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.379180 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.379124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f3f1700-05f3-4624-98e8-ccb027cf426a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.379559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.379541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f3f1700-05f3-4624-98e8-ccb027cf426a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.386527 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.386506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql8kv\" (UniqueName: \"kubernetes.io/projected/2f3f1700-05f3-4624-98e8-ccb027cf426a-kube-api-access-ql8kv\") pod \"prometheus-operator-64785b6675-x6v5w\" (UID: \"2f3f1700-05f3-4624-98e8-ccb027cf426a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:05.450261 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:05.450224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w"
Jul 15 20:49:06.013644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:06.013620    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-x6v5w"]
Jul 15 20:49:06.017511 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:49:06.017481    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3f1700_05f3_4624_98e8_ccb027cf426a.slice/crio-2786c7b387b6ca789d4c91ce3eb27760c14b770ecee11033d9158dc16d0d2c76 WatchSource:0}: Error finding container 2786c7b387b6ca789d4c91ce3eb27760c14b770ecee11033d9158dc16d0d2c76: Status 404 returned error can't find the container with id 2786c7b387b6ca789d4c91ce3eb27760c14b770ecee11033d9158dc16d0d2c76
Jul 15 20:49:06.483701 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:06.483660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w" event={"ID":"2f3f1700-05f3-4624-98e8-ccb027cf426a","Type":"ContainerStarted","Data":"2786c7b387b6ca789d4c91ce3eb27760c14b770ecee11033d9158dc16d0d2c76"}
Jul 15 20:49:06.485036 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:06.485008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp" event={"ID":"0a809966-dddc-47fb-a372-ce80119f1b17","Type":"ContainerStarted","Data":"dce8ef0c352879eba55338c0255d900b5edb9b7a92f504fac1997785e2c26fa2"}
Jul 15 20:49:06.502504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:06.502392    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-77c7575594-fn5mp" podStartSLOduration=4.766406879 podStartE2EDuration="8.502368739s" totalImagesPullingTime="3.73596186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:06.501531947 +0000 UTC m=+79.950883580" watchObservedRunningTime="2026-07-15 20:49:06.502368739 +0000 UTC m=+79.951720374"
Jul 15 20:49:08.449095 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:08.448957    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-s9n7s"
Jul 15 20:49:08.496710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:08.496523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w" event={"ID":"2f3f1700-05f3-4624-98e8-ccb027cf426a","Type":"ContainerStarted","Data":"fc27666e33e50e65adfa366dcf6e7780766866f158656e710ebfef9e32d5fa7e"}
Jul 15 20:49:08.496710 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:08.496590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w" event={"ID":"2f3f1700-05f3-4624-98e8-ccb027cf426a","Type":"ContainerStarted","Data":"7a46f8d41363b223ef9536a1f20f64445740f618785677497eecfa820623b6b5"}
Jul 15 20:49:08.521997 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:08.521932    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-x6v5w" podStartSLOduration=2.099867672 podStartE2EDuration="3.52190829s" totalImagesPullingTime="1.422040618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:08.520150968 +0000 UTC m=+81.969502620" watchObservedRunningTime="2026-07-15 20:49:08.52190829 +0000 UTC m=+81.971259923"
Jul 15 20:49:10.535137 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.535014    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-qkvww"]
Jul 15 20:49:10.540228 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.540203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.542590 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.542567    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 15 20:49:10.542889 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.542872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dbhv8\""
Jul 15 20:49:10.543468 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.543452    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 15 20:49:10.543563 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.543545    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 15 20:49:10.556957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.556927    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-qkvww"]
Jul 15 20:49:10.570611 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.568952    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-75mz8"]
Jul 15 20:49:10.573944 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.573921    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.576503 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.576306    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 20:49:10.576503 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.576345    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2qz5x\""
Jul 15 20:49:10.576503 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.576401    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 20:49:10.576708 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.576681    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 20:49:10.617666 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.617628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.617843 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.617688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b8b716f-ec48-48b6-80d3-f4430da2cb59-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.617843 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.617749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.617843 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.617818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdmvn\" (UniqueName: \"kubernetes.io/projected/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-api-access-fdmvn\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.618025 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.617872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.618025 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.617905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b8b716f-ec48-48b6-80d3-f4430da2cb59-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.718743 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.718701    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbvm\" (UniqueName: \"kubernetes.io/projected/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-kube-api-access-bjbvm\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.718935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.718757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.718935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.718808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-wtmp\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.718935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.718834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-metrics-client-ca\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.718935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.718905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b8b716f-ec48-48b6-80d3-f4430da2cb59-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.719200 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.718980    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-sys\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.719200 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-root\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.719200 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.719200 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-textfile\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.719200 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719134    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.719200 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b8b716f-ec48-48b6-80d3-f4430da2cb59-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.719503 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.719503 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdmvn\" (UniqueName: \"kubernetes.io/projected/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-api-access-fdmvn\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.719503 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-tls\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.719503 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.719503 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/1b8b716f-ec48-48b6-80d3-f4430da2cb59-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.719503 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:10.719438    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 15 20:49:10.719503 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:10.719497    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-tls podName:1b8b716f-ec48-48b6-80d3-f4430da2cb59 nodeName:}" failed. No retries permitted until 2026-07-15 20:49:11.219478123 +0000 UTC m=+84.668829738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-qkvww" (UID: "1b8b716f-ec48-48b6-80d3-f4430da2cb59") : secret "kube-state-metrics-tls" not found
Jul 15 20:49:10.719955 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.720032 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.719970    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b8b716f-ec48-48b6-80d3-f4430da2cb59-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.721995 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.721954    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.728834 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.728786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdmvn\" (UniqueName: \"kubernetes.io/projected/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-api-access-fdmvn\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:10.820165 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-sys\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820165 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-root\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820165 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820129    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-textfile\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820487 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-root\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820487 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-sys\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820487 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820487 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820403    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-tls\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820487 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbvm\" (UniqueName: \"kubernetes.io/projected/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-kube-api-access-bjbvm\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820728 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820728 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-wtmp\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820728 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-textfile\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820728 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-metrics-client-ca\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820926 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:10.820892    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 15 20:49:10.820982 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.820926    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-wtmp\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.820982 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:10.820961    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-tls podName:30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8 nodeName:}" failed. No retries permitted until 2026-07-15 20:49:11.320941958 +0000 UTC m=+84.770293582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-tls") pod "node-exporter-75mz8" (UID: "30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8") : secret "node-exporter-tls" not found
Jul 15 20:49:10.821346 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.821325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-metrics-client-ca\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.821459 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.821354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.823333 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.823299    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:10.832550 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:10.832522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbvm\" (UniqueName: \"kubernetes.io/projected/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-kube-api-access-bjbvm\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:11.225068 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.224983    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:11.227761 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.227737    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1b8b716f-ec48-48b6-80d3-f4430da2cb59-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-qkvww\" (UID: \"1b8b716f-ec48-48b6-80d3-f4430da2cb59\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:11.325691 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.325644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-tls\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:11.327921 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.327899    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8-node-exporter-tls\") pod \"node-exporter-75mz8\" (UID: \"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8\") " pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:11.451937 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.451788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww"
Jul 15 20:49:11.484764 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.484684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-75mz8"
Jul 15 20:49:11.514331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.513233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-75mz8" event={"ID":"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8","Type":"ContainerStarted","Data":"d3eb43130dc0a0215af86f68b363f600c993fba92cedf20148974df37e13f740"}
Jul 15 20:49:11.618535 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.618501    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-qkvww"]
Jul 15 20:49:11.621900 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:49:11.621868    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8b716f_ec48_48b6_80d3_f4430da2cb59.slice/crio-a5cb6fb9c093da95a2db5e6c194dfb6613e022500956b6e347bcc8d8a40c1056 WatchSource:0}: Error finding container a5cb6fb9c093da95a2db5e6c194dfb6613e022500956b6e347bcc8d8a40c1056: Status 404 returned error can't find the container with id a5cb6fb9c093da95a2db5e6c194dfb6613e022500956b6e347bcc8d8a40c1056
Jul 15 20:49:11.672363 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.672329    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:49:11.678280 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.677941    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.683548 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.683509    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 20:49:11.683733 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.683620    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l526b\""
Jul 15 20:49:11.683733 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.683630    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 20:49:11.683733 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.683665    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 20:49:11.683957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.683745    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 20:49:11.683957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.683843    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 20:49:11.683957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.683880    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 20:49:11.683957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.683929    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 20:49:11.685037 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.685015    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 20:49:11.685150 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.685041    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 20:49:11.707600 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.707571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.730866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.730931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.730959    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-web-config\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.730991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-out\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731172    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whw7k\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-kube-api-access-whw7k\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731214    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731236    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.731466 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.731271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.823994 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.823958    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79449cf79d-9m8fw"]
Jul 15 20:49:11.827467 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.827445    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:11.830048 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.830026    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 20:49:11.830186 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.830047    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 20:49:11.830186 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.830112    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nmh6g\""
Jul 15 20:49:11.830309 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.830246    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 20:49:11.830309 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.830252    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 20:49:11.830555 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.830534    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 20:49:11.832031 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832136 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832136 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832089    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832251 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832251 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832251 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-web-config\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832251 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832210    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-out\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832251 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832512 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832512 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832512 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.832320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.832655 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:11.832638    2565 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 15 20:49:11.832727 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:11.832710    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls podName:6f8bd56e-5700-48bf-9a6b-825ecbe6842b nodeName:}" failed. No retries permitted until 2026-07-15 20:49:12.332690866 +0000 UTC m=+85.782042476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b") : secret "alertmanager-main-tls" not found
Jul 15 20:49:11.833444 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.833334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.833444 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.833375    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.833595 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.833449    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.833595 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.833481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whw7k\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-kube-api-access-whw7k\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.835815 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.835787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.836116 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.836092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-out\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.836208 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.836183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.836283 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.836210    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.836479 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.836428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.836703 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.836663    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.837411 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.837389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-web-config\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.838061 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.838020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.839178 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.839144    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.839673 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.839650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79449cf79d-9m8fw"]
Jul 15 20:49:11.846254 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.846225    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whw7k\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-kube-api-access-whw7k\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:11.934454 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.934395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-serving-cert\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:11.934454 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.934462    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26kt6\" (UniqueName: \"kubernetes.io/projected/c8886a49-0140-4ef2-84b8-4071f05e642b-kube-api-access-26kt6\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:11.934693 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.934504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-oauth-serving-cert\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:11.934693 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.934540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-service-ca\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:11.934693 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.934606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-oauth-config\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:11.934693 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:11.934629    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-console-config\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.035659 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.035625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-serving-cert\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.035659 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.035661    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26kt6\" (UniqueName: \"kubernetes.io/projected/c8886a49-0140-4ef2-84b8-4071f05e642b-kube-api-access-26kt6\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.035913 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.035699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-oauth-serving-cert\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.035913 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.035736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-service-ca\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.035913 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.035774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-oauth-config\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.035913 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.035796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-console-config\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.036599 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.036570    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-console-config\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.036728 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.036650    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-oauth-serving-cert\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.036797 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.036763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-service-ca\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.038351 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.038330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-oauth-config\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.038604 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.038584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-serving-cert\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.045126 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.045086    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26kt6\" (UniqueName: \"kubernetes.io/projected/c8886a49-0140-4ef2-84b8-4071f05e642b-kube-api-access-26kt6\") pod \"console-79449cf79d-9m8fw\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") " pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.162106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.162018    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:12.335249 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.335084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79449cf79d-9m8fw"]
Jul 15 20:49:12.340932 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.340243    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:12.346850 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.346810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:12.519247 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.519176    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79449cf79d-9m8fw" event={"ID":"c8886a49-0140-4ef2-84b8-4071f05e642b","Type":"ContainerStarted","Data":"58e3e2cb18704fcd8c227b6fcd17a22637478381791db0a11b68c0dc28c79333"}
Jul 15 20:49:12.520595 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.520550    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww" event={"ID":"1b8b716f-ec48-48b6-80d3-f4430da2cb59","Type":"ContainerStarted","Data":"a5cb6fb9c093da95a2db5e6c194dfb6613e022500956b6e347bcc8d8a40c1056"}
Jul 15 20:49:12.590614 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.590577    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:49:12.844096 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:12.844065    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:49:13.529148 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:13.529110    2565 generic.go:356] "Generic (PLEG): container finished" podID="30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8" containerID="a71cae01dc33deb152ccc89a9ddcfeb8c065592f77943cfa072882c6c029407f" exitCode=0
Jul 15 20:49:13.529290 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:13.529240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-75mz8" event={"ID":"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8","Type":"ContainerDied","Data":"a71cae01dc33deb152ccc89a9ddcfeb8c065592f77943cfa072882c6c029407f"}
Jul 15 20:49:13.532452 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:13.532352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerStarted","Data":"aff28692520535293b4e3a5402c4e68d4d6243fd23316ecfa0b37538b9bb29a5"}
Jul 15 20:49:13.534019 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:13.533952    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww" event={"ID":"1b8b716f-ec48-48b6-80d3-f4430da2cb59","Type":"ContainerStarted","Data":"e7b4f14c9820b9344dfadbf6d505be931f3c750f5a803ccdcd63efeafba44ec0"}
Jul 15 20:49:15.293000 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.292959    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"]
Jul 15 20:49:15.296190 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.296165    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:15.298361 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.298336    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 20:49:15.298489 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.298406    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-c6kmb\""
Jul 15 20:49:15.307167 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.307144    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"]
Jul 15 20:49:15.369377 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.369330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wghph\" (UniqueName: \"kubernetes.io/projected/12c651a3-757d-4479-b0db-c6b300011890-kube-api-access-wghph\") pod \"monitoring-plugin-5f68df7f58-wcmp6\" (UID: \"12c651a3-757d-4479-b0db-c6b300011890\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:15.369540 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.369472    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12c651a3-757d-4479-b0db-c6b300011890-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-wcmp6\" (UID: \"12c651a3-757d-4479-b0db-c6b300011890\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:15.470869 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.470832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wghph\" (UniqueName: \"kubernetes.io/projected/12c651a3-757d-4479-b0db-c6b300011890-kube-api-access-wghph\") pod \"monitoring-plugin-5f68df7f58-wcmp6\" (UID: \"12c651a3-757d-4479-b0db-c6b300011890\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:15.471083 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.470908    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12c651a3-757d-4479-b0db-c6b300011890-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-wcmp6\" (UID: \"12c651a3-757d-4479-b0db-c6b300011890\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:15.471083 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:15.471014    2565 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 15 20:49:15.471083 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:15.471081    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12c651a3-757d-4479-b0db-c6b300011890-monitoring-plugin-cert podName:12c651a3-757d-4479-b0db-c6b300011890 nodeName:}" failed. No retries permitted until 2026-07-15 20:49:15.971063444 +0000 UTC m=+89.420415061 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/12c651a3-757d-4479-b0db-c6b300011890-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-wcmp6" (UID: "12c651a3-757d-4479-b0db-c6b300011890") : secret "monitoring-plugin-cert" not found
Jul 15 20:49:15.480464 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.480432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wghph\" (UniqueName: \"kubernetes.io/projected/12c651a3-757d-4479-b0db-c6b300011890-kube-api-access-wghph\") pod \"monitoring-plugin-5f68df7f58-wcmp6\" (UID: \"12c651a3-757d-4479-b0db-c6b300011890\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:15.975833 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.975792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12c651a3-757d-4479-b0db-c6b300011890-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-wcmp6\" (UID: \"12c651a3-757d-4479-b0db-c6b300011890\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:15.978668 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:15.978643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/12c651a3-757d-4479-b0db-c6b300011890-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-wcmp6\" (UID: \"12c651a3-757d-4479-b0db-c6b300011890\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:16.209413 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:16.209374    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:18.692111 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:18.692076    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:49:23.325024 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.324992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"]
Jul 15 20:49:23.329090 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:49:23.329059    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c651a3_757d_4479_b0db_c6b300011890.slice/crio-f85e145740af53dea98745753be2596ec4cb2a47a22bdd3517c37d2526f76544 WatchSource:0}: Error finding container f85e145740af53dea98745753be2596ec4cb2a47a22bdd3517c37d2526f76544: Status 404 returned error can't find the container with id f85e145740af53dea98745753be2596ec4cb2a47a22bdd3517c37d2526f76544
Jul 15 20:49:23.475131 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.475101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cfffc4cdb-k24hj"
Jul 15 20:49:23.584142 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.584063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-284pl" event={"ID":"99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a","Type":"ContainerStarted","Data":"d9d7b97b5fa40bdf412c6c9ef98b9e683882dda8f81d2f116638c8bf2cd83fd6"}
Jul 15 20:49:23.584575 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.584520    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-284pl"
Jul 15 20:49:23.586835 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.586803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-75mz8" event={"ID":"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8","Type":"ContainerStarted","Data":"8d8e97e3658665e8811de5f2bebc9b5c0ede4337a35bb8a3d249cb0b296e73e7"}
Jul 15 20:49:23.586958 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.586853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-75mz8" event={"ID":"30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8","Type":"ContainerStarted","Data":"477f8f3bdef351cbc0975c853f32224b052d3ae86d5d89a20d27fe402a9181e6"}
Jul 15 20:49:23.588594 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.588571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79449cf79d-9m8fw" event={"ID":"c8886a49-0140-4ef2-84b8-4071f05e642b","Type":"ContainerStarted","Data":"e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12"}
Jul 15 20:49:23.590667 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.590639    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerID="b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13" exitCode=0
Jul 15 20:49:23.590752 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.590721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerDied","Data":"b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13"}
Jul 15 20:49:23.592250 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.592230    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-284pl"
Jul 15 20:49:23.593326 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.593299    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww" event={"ID":"1b8b716f-ec48-48b6-80d3-f4430da2cb59","Type":"ContainerStarted","Data":"9be6a1bd1a4f824f14956c07bc9a25eb8c4df9147c8ec3b323322f5815be70ee"}
Jul 15 20:49:23.593435 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.593355    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww" event={"ID":"1b8b716f-ec48-48b6-80d3-f4430da2cb59","Type":"ContainerStarted","Data":"c4206f8fce151aed561cd1c732250333fbc39375fd96815b4819405aa7675e16"}
Jul 15 20:49:23.594671 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.594649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6" event={"ID":"12c651a3-757d-4479-b0db-c6b300011890","Type":"ContainerStarted","Data":"f85e145740af53dea98745753be2596ec4cb2a47a22bdd3517c37d2526f76544"}
Jul 15 20:49:23.602462 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.602372    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-284pl" podStartSLOduration=1.7642392679999999 podStartE2EDuration="22.602350593s" totalImagesPullingTime="20.838111325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:23.602059217 +0000 UTC m=+97.051410878" watchObservedRunningTime="2026-07-15 20:49:23.602350593 +0000 UTC m=+97.051702225"
Jul 15 20:49:23.620518 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.620411    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-qkvww" podStartSLOduration=11.864754312 podStartE2EDuration="13.620388855s" totalImagesPullingTime="1.755634543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:23.619344388 +0000 UTC m=+97.068696040" watchObservedRunningTime="2026-07-15 20:49:23.620388855 +0000 UTC m=+97.069740488"
Jul 15 20:49:23.643859 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.643798    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-75mz8" podStartSLOduration=12.342041699 podStartE2EDuration="13.643777555s" totalImagesPullingTime="1.215264533s" totalInitContainerRuntime="86.471323ms" isStatefulPod=true podCreationTimestamp="2026-07-15 20:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:23.642878357 +0000 UTC m=+97.092230003" watchObservedRunningTime="2026-07-15 20:49:23.643777555 +0000 UTC m=+97.093129189"
Jul 15 20:49:23.692302 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.692189    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79449cf79d-9m8fw" podStartSLOduration=1.845243373 podStartE2EDuration="12.692172799s" totalImagesPullingTime="10.846929426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:23.690793183 +0000 UTC m=+97.140144839" watchObservedRunningTime="2026-07-15 20:49:23.692172799 +0000 UTC m=+97.141524430"
Jul 15 20:49:23.710246 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:23.710196    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-dc68f489c-28h6z" podUID="6b100fb9-ab6f-4d65-befd-1c1a358e9a96" containerName="registry" containerID="cri-o://db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5" gracePeriod=30
Jul 15 20:49:24.025891 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.025631    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:49:24.148765 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.148725    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") pod \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") "
Jul 15 20:49:24.149495 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.149200    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-ca-trust-extracted\") pod \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") "
Jul 15 20:49:24.149495 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.149238    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-certificates\") pod \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") "
Jul 15 20:49:24.149495 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.149288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsrfv\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-kube-api-access-dsrfv\") pod \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") "
Jul 15 20:49:24.149495 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.149320    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-trusted-ca\") pod \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") "
Jul 15 20:49:24.149495 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.149353    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-image-registry-private-configuration\") pod \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") "
Jul 15 20:49:24.149495 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.149377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-bound-sa-token\") pod \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") "
Jul 15 20:49:24.149495 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.149406    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-installation-pull-secrets\") pod \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\" (UID: \"6b100fb9-ab6f-4d65-befd-1c1a358e9a96\") "
Jul 15 20:49:24.150892 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.150824    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6b100fb9-ab6f-4d65-befd-1c1a358e9a96" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:49:24.151502 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.151451    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6b100fb9-ab6f-4d65-befd-1c1a358e9a96" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:49:24.152008 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.151958    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6b100fb9-ab6f-4d65-befd-1c1a358e9a96" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:49:24.152211 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.152183    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-kube-api-access-dsrfv" (OuterVolumeSpecName: "kube-api-access-dsrfv") pod "6b100fb9-ab6f-4d65-befd-1c1a358e9a96" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96"). InnerVolumeSpecName "kube-api-access-dsrfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:49:24.152665 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.152637    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6b100fb9-ab6f-4d65-befd-1c1a358e9a96" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:49:24.153122 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.153089    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6b100fb9-ab6f-4d65-befd-1c1a358e9a96" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:49:24.153628 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.153549    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6b100fb9-ab6f-4d65-befd-1c1a358e9a96" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:49:24.160957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.160918    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6b100fb9-ab6f-4d65-befd-1c1a358e9a96" (UID: "6b100fb9-ab6f-4d65-befd-1c1a358e9a96"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:49:24.250852 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.250762    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-bound-sa-token\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:24.250852 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.250796    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-installation-pull-secrets\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:24.250852 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.250810    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-tls\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:24.250852 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.250824    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-ca-trust-extracted\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:24.250852 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.250838    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-registry-certificates\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:24.250852 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.250852    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsrfv\" (UniqueName: \"kubernetes.io/projected/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-kube-api-access-dsrfv\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:24.251265 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.250865    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-trusted-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:24.251265 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.250882    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b100fb9-ab6f-4d65-befd-1c1a358e9a96-image-registry-private-configuration\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:24.605126 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.604216    2565 generic.go:356] "Generic (PLEG): container finished" podID="6b100fb9-ab6f-4d65-befd-1c1a358e9a96" containerID="db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5" exitCode=0
Jul 15 20:49:24.606756 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.606542    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dc68f489c-28h6z" event={"ID":"6b100fb9-ab6f-4d65-befd-1c1a358e9a96","Type":"ContainerDied","Data":"db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5"}
Jul 15 20:49:24.606756 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.606607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dc68f489c-28h6z" event={"ID":"6b100fb9-ab6f-4d65-befd-1c1a358e9a96","Type":"ContainerDied","Data":"e499b8cdac09311c72d7ea1baedba9a698e2a15ab28078510a02bf61267d3271"}
Jul 15 20:49:24.606756 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.606637    2565 scope.go:117] "RemoveContainer" containerID="db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5"
Jul 15 20:49:24.607666 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.606397    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dc68f489c-28h6z"
Jul 15 20:49:24.639391 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.639329    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dc68f489c-28h6z"]
Jul 15 20:49:24.648810 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:24.648691    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dc68f489c-28h6z"]
Jul 15 20:49:25.144532 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:25.144146    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b100fb9-ab6f-4d65-befd-1c1a358e9a96" path="/var/lib/kubelet/pods/6b100fb9-ab6f-4d65-befd-1c1a358e9a96/volumes"
Jul 15 20:49:25.231679 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:25.231583    2565 scope.go:117] "RemoveContainer" containerID="db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5"
Jul 15 20:49:25.232086 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:25.232052    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5\": container with ID starting with db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5 not found: ID does not exist" containerID="db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5"
Jul 15 20:49:25.232199 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:25.232098    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5"} err="failed to get container status \"db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5\": rpc error: code = NotFound desc = could not find container \"db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5\": container with ID starting with db2155e797fab35c31814018652170cee0e89f83d3a6b3a3e0454f71437afaf5 not found: ID does not exist"
Jul 15 20:49:26.617805 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:26.617770    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerStarted","Data":"f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a"}
Jul 15 20:49:26.619544 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:26.619513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6" event={"ID":"12c651a3-757d-4479-b0db-c6b300011890","Type":"ContainerStarted","Data":"8f1fb4c7aca33f81e36912110370402798e4e877f8f9482cf63a967c99860932"}
Jul 15 20:49:26.619774 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:26.619728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:26.626108 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:26.626086    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6"
Jul 15 20:49:26.647832 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:26.647767    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-wcmp6" podStartSLOduration=8.840601609 podStartE2EDuration="11.647743864s" totalImagesPullingTime="2.807142255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:26.647389726 +0000 UTC m=+100.096741385" watchObservedRunningTime="2026-07-15 20:49:26.647743864 +0000 UTC m=+100.097095499"
Jul 15 20:49:27.627866 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:27.627823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerStarted","Data":"0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71"}
Jul 15 20:49:27.628311 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:27.627900    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerStarted","Data":"ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e"}
Jul 15 20:49:27.628311 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:27.627942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerStarted","Data":"061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0"}
Jul 15 20:49:27.628311 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:27.627972    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerStarted","Data":"f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565"}
Jul 15 20:49:29.641735 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:29.641689    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerStarted","Data":"7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91"}
Jul 15 20:49:29.697339 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:29.697271    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.051667969 podStartE2EDuration="18.697249242s" totalImagesPullingTime="14.643798106s" totalInitContainerRuntime="1.783167ms" isStatefulPod=false podCreationTimestamp="2026-07-15 20:49:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:49:29.695327795 +0000 UTC m=+103.144679426" watchObservedRunningTime="2026-07-15 20:49:29.697249242 +0000 UTC m=+103.146600875"
Jul 15 20:49:30.633667 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:30.633630    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79449cf79d-9m8fw"]
Jul 15 20:49:32.162605 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:32.162566    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:33.471553 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:33.471524    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t9knt"
Jul 15 20:49:55.657968 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:55.657901    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79449cf79d-9m8fw" podUID="c8886a49-0140-4ef2-84b8-4071f05e642b" containerName="console" containerID="cri-o://e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12" gracePeriod=15
Jul 15 20:49:55.933591 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:55.933505    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:56.009482 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.009407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-oauth-config\") pod \"c8886a49-0140-4ef2-84b8-4071f05e642b\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") "
Jul 15 20:49:56.009669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.009535    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26kt6\" (UniqueName: \"kubernetes.io/projected/c8886a49-0140-4ef2-84b8-4071f05e642b-kube-api-access-26kt6\") pod \"c8886a49-0140-4ef2-84b8-4071f05e642b\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") "
Jul 15 20:49:56.009669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.009578    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-oauth-serving-cert\") pod \"c8886a49-0140-4ef2-84b8-4071f05e642b\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") "
Jul 15 20:49:56.009669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.009607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-serving-cert\") pod \"c8886a49-0140-4ef2-84b8-4071f05e642b\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") "
Jul 15 20:49:56.009669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.009635    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-console-config\") pod \"c8886a49-0140-4ef2-84b8-4071f05e642b\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") "
Jul 15 20:49:56.009669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.009668    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-service-ca\") pod \"c8886a49-0140-4ef2-84b8-4071f05e642b\" (UID: \"c8886a49-0140-4ef2-84b8-4071f05e642b\") "
Jul 15 20:49:56.010331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.010265    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c8886a49-0140-4ef2-84b8-4071f05e642b" (UID: "c8886a49-0140-4ef2-84b8-4071f05e642b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:49:56.010331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.010289    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-service-ca" (OuterVolumeSpecName: "service-ca") pod "c8886a49-0140-4ef2-84b8-4071f05e642b" (UID: "c8886a49-0140-4ef2-84b8-4071f05e642b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:49:56.010528 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.010339    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-console-config" (OuterVolumeSpecName: "console-config") pod "c8886a49-0140-4ef2-84b8-4071f05e642b" (UID: "c8886a49-0140-4ef2-84b8-4071f05e642b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:49:56.011872 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.011840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c8886a49-0140-4ef2-84b8-4071f05e642b" (UID: "c8886a49-0140-4ef2-84b8-4071f05e642b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:49:56.011977 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.011910    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c8886a49-0140-4ef2-84b8-4071f05e642b" (UID: "c8886a49-0140-4ef2-84b8-4071f05e642b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:49:56.011977 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.011918    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8886a49-0140-4ef2-84b8-4071f05e642b-kube-api-access-26kt6" (OuterVolumeSpecName: "kube-api-access-26kt6") pod "c8886a49-0140-4ef2-84b8-4071f05e642b" (UID: "c8886a49-0140-4ef2-84b8-4071f05e642b"). InnerVolumeSpecName "kube-api-access-26kt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:49:56.110475 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.110408    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26kt6\" (UniqueName: \"kubernetes.io/projected/c8886a49-0140-4ef2-84b8-4071f05e642b-kube-api-access-26kt6\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:56.110475 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.110469    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-oauth-serving-cert\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:56.110475 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.110481    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-serving-cert\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:56.110714 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.110494    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-console-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:56.110714 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.110507    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8886a49-0140-4ef2-84b8-4071f05e642b-service-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:56.110714 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.110518    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8886a49-0140-4ef2-84b8-4071f05e642b-console-oauth-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:49:56.750652 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.750612    2565 generic.go:356] "Generic (PLEG): container finished" podID="c8886a49-0140-4ef2-84b8-4071f05e642b" containerID="e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12" exitCode=0
Jul 15 20:49:56.751045 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.750682    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79449cf79d-9m8fw"
Jul 15 20:49:56.751045 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.750691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79449cf79d-9m8fw" event={"ID":"c8886a49-0140-4ef2-84b8-4071f05e642b","Type":"ContainerDied","Data":"e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12"}
Jul 15 20:49:56.751045 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.750745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79449cf79d-9m8fw" event={"ID":"c8886a49-0140-4ef2-84b8-4071f05e642b","Type":"ContainerDied","Data":"58e3e2cb18704fcd8c227b6fcd17a22637478381791db0a11b68c0dc28c79333"}
Jul 15 20:49:56.751045 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.750765    2565 scope.go:117] "RemoveContainer" containerID="e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12"
Jul 15 20:49:56.759577 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.759559    2565 scope.go:117] "RemoveContainer" containerID="e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12"
Jul 15 20:49:56.759839 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:49:56.759819    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12\": container with ID starting with e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12 not found: ID does not exist" containerID="e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12"
Jul 15 20:49:56.759888 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.759853    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12"} err="failed to get container status \"e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12\": rpc error: code = NotFound desc = could not find container \"e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12\": container with ID starting with e582dd5763eeafea77a7ff345a6245007afdb28a60710c442576e1871a689e12 not found: ID does not exist"
Jul 15 20:49:56.783157 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.783123    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79449cf79d-9m8fw"]
Jul 15 20:49:56.787168 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:56.787139    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79449cf79d-9m8fw"]
Jul 15 20:49:57.140995 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:49:57.140917    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8886a49-0140-4ef2-84b8-4071f05e642b" path="/var/lib/kubelet/pods/c8886a49-0140-4ef2-84b8-4071f05e642b/volumes"
Jul 15 20:50:30.945443 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:30.945385    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:50:30.945935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:30.945781    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="alertmanager" containerID="cri-o://f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a" gracePeriod=120
Jul 15 20:50:30.945935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:30.945838    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy-metric" containerID="cri-o://0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71" gracePeriod=120
Jul 15 20:50:30.945935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:30.945859    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy" containerID="cri-o://ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e" gracePeriod=120
Jul 15 20:50:30.945935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:30.945905    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="config-reloader" containerID="cri-o://f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565" gracePeriod=120
Jul 15 20:50:30.945935 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:30.945853    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy-web" containerID="cri-o://061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0" gracePeriod=120
Jul 15 20:50:30.946176 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:30.946015    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="prom-label-proxy" containerID="cri-o://7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91" gracePeriod=120
Jul 15 20:50:31.878331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878291    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerID="7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91" exitCode=0
Jul 15 20:50:31.878331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878318    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerID="0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71" exitCode=0
Jul 15 20:50:31.878331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878329    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerID="ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e" exitCode=0
Jul 15 20:50:31.878331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878337    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerID="f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565" exitCode=0
Jul 15 20:50:31.878331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878344    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerID="f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a" exitCode=0
Jul 15 20:50:31.878644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerDied","Data":"7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91"}
Jul 15 20:50:31.878644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878446    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerDied","Data":"0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71"}
Jul 15 20:50:31.878644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerDied","Data":"ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e"}
Jul 15 20:50:31.878644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerDied","Data":"f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565"}
Jul 15 20:50:31.878644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:31.878522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerDied","Data":"f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a"}
Jul 15 20:50:32.195215 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.195191    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:32.302239 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302197    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-web-config\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302239 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302248    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whw7k\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-kube-api-access-whw7k\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302514 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302274    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-volume\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302514 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302295    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-metrics-client-ca\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302514 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302317    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302514 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302341    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-tls-assets\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302514 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-trusted-ca-bundle\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302759 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302678    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-out\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302759 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302721    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-main-db\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302860 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302757    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-cluster-tls-config\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302860 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302794    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.302860 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302793    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:50:32.302860 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302818    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:50:32.302860 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302824    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-web\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.303095 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.302885    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\" (UID: \"6f8bd56e-5700-48bf-9a6b-825ecbe6842b\") "
Jul 15 20:50:32.303175 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.303150    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:50:32.303610 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.303589    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-metrics-client-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.305171 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.305146    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.305669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.305648    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-alertmanager-main-db\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.305996 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.305863    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:50:32.305996 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.305904    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:50:32.305996 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.305970    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-volume" (OuterVolumeSpecName: "config-volume") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:50:32.306334 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.306291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:50:32.306561 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.306538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:50:32.306561 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.306546    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-out" (OuterVolumeSpecName: "config-out") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:50:32.307485 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.307466    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-kube-api-access-whw7k" (OuterVolumeSpecName: "kube-api-access-whw7k") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "kube-api-access-whw7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:50:32.307877 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.307854    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:50:32.310103 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.309969    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:50:32.315712 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.315690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-web-config" (OuterVolumeSpecName: "web-config") pod "6f8bd56e-5700-48bf-9a6b-825ecbe6842b" (UID: "6f8bd56e-5700-48bf-9a6b-825ecbe6842b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:50:32.406529 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406479    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-cluster-tls-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406529 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406524    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406529 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406536    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406529 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406545    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406795 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406554    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-web-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406795 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406562    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whw7k\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-kube-api-access-whw7k\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406795 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406571    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-volume\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406795 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406579    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-secret-alertmanager-main-tls\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406795 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406588    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-tls-assets\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.406795 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.406597    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f8bd56e-5700-48bf-9a6b-825ecbe6842b-config-out\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:50:32.885220 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.885191    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerID="061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0" exitCode=0
Jul 15 20:50:32.885390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.885257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerDied","Data":"061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0"}
Jul 15 20:50:32.885390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.885310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f8bd56e-5700-48bf-9a6b-825ecbe6842b","Type":"ContainerDied","Data":"aff28692520535293b4e3a5402c4e68d4d6243fd23316ecfa0b37538b9bb29a5"}
Jul 15 20:50:32.885390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.885260    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:32.885390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.885343    2565 scope.go:117] "RemoveContainer" containerID="7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91"
Jul 15 20:50:32.894485 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.894460    2565 scope.go:117] "RemoveContainer" containerID="0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71"
Jul 15 20:50:32.902397 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.902379    2565 scope.go:117] "RemoveContainer" containerID="ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e"
Jul 15 20:50:32.908643 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.908623    2565 scope.go:117] "RemoveContainer" containerID="061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0"
Jul 15 20:50:32.913539 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.913516    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:50:32.916287 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.916264    2565 scope.go:117] "RemoveContainer" containerID="f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565"
Jul 15 20:50:32.917737 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.917718    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:50:32.923247 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.923228    2565 scope.go:117] "RemoveContainer" containerID="f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a"
Jul 15 20:50:32.930004 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.929987    2565 scope.go:117] "RemoveContainer" containerID="b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13"
Jul 15 20:50:32.936639 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.936618    2565 scope.go:117] "RemoveContainer" containerID="7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91"
Jul 15 20:50:32.936897 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:50:32.936878    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91\": container with ID starting with 7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91 not found: ID does not exist" containerID="7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91"
Jul 15 20:50:32.936949 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.936905    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91"} err="failed to get container status \"7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91\": rpc error: code = NotFound desc = could not find container \"7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91\": container with ID starting with 7d5d2b654dd4d00940ad3024beeef179bb5fee907a77c603ed942eace3af8d91 not found: ID does not exist"
Jul 15 20:50:32.936949 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.936923    2565 scope.go:117] "RemoveContainer" containerID="0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71"
Jul 15 20:50:32.937136 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:50:32.937121    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71\": container with ID starting with 0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71 not found: ID does not exist" containerID="0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71"
Jul 15 20:50:32.937173 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.937142    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71"} err="failed to get container status \"0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71\": rpc error: code = NotFound desc = could not find container \"0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71\": container with ID starting with 0fc7c97a6ded9a5eef7208ef1021fd9ab6dedcedb6fd7040b9b10a0ccb933b71 not found: ID does not exist"
Jul 15 20:50:32.937173 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.937157    2565 scope.go:117] "RemoveContainer" containerID="ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e"
Jul 15 20:50:32.937346 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:50:32.937331    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e\": container with ID starting with ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e not found: ID does not exist" containerID="ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e"
Jul 15 20:50:32.937383 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.937351    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e"} err="failed to get container status \"ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e\": rpc error: code = NotFound desc = could not find container \"ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e\": container with ID starting with ffc1ae74c645129c07bf121b3edea88cbfe8618f7fdfa6606e173b42e51c950e not found: ID does not exist"
Jul 15 20:50:32.937383 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.937365    2565 scope.go:117] "RemoveContainer" containerID="061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0"
Jul 15 20:50:32.937560 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:50:32.937545    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0\": container with ID starting with 061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0 not found: ID does not exist" containerID="061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0"
Jul 15 20:50:32.937603 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.937564    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0"} err="failed to get container status \"061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0\": rpc error: code = NotFound desc = could not find container \"061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0\": container with ID starting with 061758788f58c8491a02c4eb10cdf9638d356454e07dd0ce350bdf80359bb5f0 not found: ID does not exist"
Jul 15 20:50:32.937603 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.937576    2565 scope.go:117] "RemoveContainer" containerID="f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565"
Jul 15 20:50:32.937762 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:50:32.937746    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565\": container with ID starting with f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565 not found: ID does not exist" containerID="f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565"
Jul 15 20:50:32.937803 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.937765    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565"} err="failed to get container status \"f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565\": rpc error: code = NotFound desc = could not find container \"f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565\": container with ID starting with f481c43f94e2670143345fd9636751820d354d96736d5cb5556e2b02dbb9e565 not found: ID does not exist"
Jul 15 20:50:32.937803 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.937777    2565 scope.go:117] "RemoveContainer" containerID="f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a"
Jul 15 20:50:32.938002 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:50:32.937968    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a\": container with ID starting with f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a not found: ID does not exist" containerID="f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a"
Jul 15 20:50:32.938042 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.938006    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a"} err="failed to get container status \"f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a\": rpc error: code = NotFound desc = could not find container \"f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a\": container with ID starting with f43aa41f62e1361789fbfbbbb0adecfea5f0bea51afd18bdd96fbf956df4df8a not found: ID does not exist"
Jul 15 20:50:32.938042 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.938019    2565 scope.go:117] "RemoveContainer" containerID="b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13"
Jul 15 20:50:32.938193 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:50:32.938179    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13\": container with ID starting with b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13 not found: ID does not exist" containerID="b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13"
Jul 15 20:50:32.938230 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.938196    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13"} err="failed to get container status \"b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13\": rpc error: code = NotFound desc = could not find container \"b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13\": container with ID starting with b75f71938d77810a6cd350ce349f29af2e984ee806baf7281b1a33e5a76e7a13 not found: ID does not exist"
Jul 15 20:50:32.951088 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951061    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:50:32.951330 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951320    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="init-config-reloader"
Jul 15 20:50:32.951369 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951332    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="init-config-reloader"
Jul 15 20:50:32.951369 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951343    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy"
Jul 15 20:50:32.951369 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951349    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy"
Jul 15 20:50:32.951369 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951357    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="alertmanager"
Jul 15 20:50:32.951369 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951362    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="alertmanager"
Jul 15 20:50:32.951369 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951368    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="config-reloader"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951373    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="config-reloader"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951380    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8886a49-0140-4ef2-84b8-4071f05e642b" containerName="console"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951385    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8886a49-0140-4ef2-84b8-4071f05e642b" containerName="console"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951394    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy-web"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951399    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy-web"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951404    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="prom-label-proxy"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951409    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="prom-label-proxy"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951435    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b100fb9-ab6f-4d65-befd-1c1a358e9a96" containerName="registry"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951440    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b100fb9-ab6f-4d65-befd-1c1a358e9a96" containerName="registry"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951446    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy-metric"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951451    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy-metric"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951492    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b100fb9-ab6f-4d65-befd-1c1a358e9a96" containerName="registry"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951499    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy-metric"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951504    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="prom-label-proxy"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951510    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8886a49-0140-4ef2-84b8-4071f05e642b" containerName="console"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951514    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="config-reloader"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951521    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="alertmanager"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951526    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy-web"
Jul 15 20:50:32.951559 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.951531    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" containerName="kube-rbac-proxy"
Jul 15 20:50:32.954985 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.954969    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:32.957644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.957622    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 20:50:32.957730 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.957653    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 20:50:32.957730 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.957685    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 20:50:32.957873 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.957860    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 20:50:32.957945 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.957864    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 20:50:32.958032 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.958014    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 20:50:32.958083 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.958053    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 20:50:32.958136 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.958090    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 20:50:32.958136 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.958100    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l526b\""
Jul 15 20:50:32.963833 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.963811    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 20:50:32.979493 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:32.979470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:50:33.110808 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.110773    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.110808 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.110807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.110838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51db3a-58d0-4727-b841-2b8f381bb4c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.110906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.110937    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f51db3a-58d0-4727-b841-2b8f381bb4c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.110956    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111001 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.110979    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f51db3a-58d0-4727-b841-2b8f381bb4c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111205 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.111005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f51db3a-58d0-4727-b841-2b8f381bb4c5-config-out\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111205 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.111051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f51db3a-58d0-4727-b841-2b8f381bb4c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111205 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.111066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slrsv\" (UniqueName: \"kubernetes.io/projected/9f51db3a-58d0-4727-b841-2b8f381bb4c5-kube-api-access-slrsv\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111205 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.111081    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111205 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.111094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-web-config\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.111205 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.111144    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.141500 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.141384    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8bd56e-5700-48bf-9a6b-825ecbe6842b" path="/var/lib/kubelet/pods/6f8bd56e-5700-48bf-9a6b-825ecbe6842b/volumes"
Jul 15 20:50:33.211598 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.211598 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f51db3a-58d0-4727-b841-2b8f381bb4c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f51db3a-58d0-4727-b841-2b8f381bb4c5-config-out\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211787    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f51db3a-58d0-4727-b841-2b8f381bb4c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slrsv\" (UniqueName: \"kubernetes.io/projected/9f51db3a-58d0-4727-b841-2b8f381bb4c5-kube-api-access-slrsv\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-web-config\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211890    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211958    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.211998    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51db3a-58d0-4727-b841-2b8f381bb4c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.212043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212106 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.212075    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f51db3a-58d0-4727-b841-2b8f381bb4c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212684 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.212404    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f51db3a-58d0-4727-b841-2b8f381bb4c5-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.212741 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.212687    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f51db3a-58d0-4727-b841-2b8f381bb4c5-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.213366 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.213337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f51db3a-58d0-4727-b841-2b8f381bb4c5-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.214515 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.214491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f51db3a-58d0-4727-b841-2b8f381bb4c5-config-out\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.214624 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.214583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f51db3a-58d0-4727-b841-2b8f381bb4c5-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.214751 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.214729    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.214808 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.214755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.214923 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.214904    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-web-config\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.215376 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.215350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.215502 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.215483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.216028 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.216012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.216540 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.216524    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f51db3a-58d0-4727-b841-2b8f381bb4c5-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.221032 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.221012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slrsv\" (UniqueName: \"kubernetes.io/projected/9f51db3a-58d0-4727-b841-2b8f381bb4c5-kube-api-access-slrsv\") pod \"alertmanager-main-0\" (UID: \"9f51db3a-58d0-4727-b841-2b8f381bb4c5\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.265589 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.265549    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 20:50:33.402583 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.402556    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 20:50:33.404488 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:50:33.404464    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f51db3a_58d0_4727_b841_2b8f381bb4c5.slice/crio-c8a048a9fe6c93d0a30ec1d571ec0ecf79f1e2ef58aa1ab84a948c43ce770b40 WatchSource:0}: Error finding container c8a048a9fe6c93d0a30ec1d571ec0ecf79f1e2ef58aa1ab84a948c43ce770b40: Status 404 returned error can't find the container with id c8a048a9fe6c93d0a30ec1d571ec0ecf79f1e2ef58aa1ab84a948c43ce770b40
Jul 15 20:50:33.890657 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.890624    2565 generic.go:356] "Generic (PLEG): container finished" podID="9f51db3a-58d0-4727-b841-2b8f381bb4c5" containerID="eb96cda711b34431bef6456eb83bebb2b807a2ec807739c43b83df910ee7f660" exitCode=0
Jul 15 20:50:33.890806 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.890683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f51db3a-58d0-4727-b841-2b8f381bb4c5","Type":"ContainerDied","Data":"eb96cda711b34431bef6456eb83bebb2b807a2ec807739c43b83df910ee7f660"}
Jul 15 20:50:33.890806 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:33.890731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f51db3a-58d0-4727-b841-2b8f381bb4c5","Type":"ContainerStarted","Data":"c8a048a9fe6c93d0a30ec1d571ec0ecf79f1e2ef58aa1ab84a948c43ce770b40"}
Jul 15 20:50:34.896816 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:34.896777    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f51db3a-58d0-4727-b841-2b8f381bb4c5","Type":"ContainerStarted","Data":"309de3b6ca798c3cdc2342c9f5fb517edccadfa5326ff1ffb866d34678d057b9"}
Jul 15 20:50:34.897212 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:34.896865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f51db3a-58d0-4727-b841-2b8f381bb4c5","Type":"ContainerStarted","Data":"2171f8f3e7703b770980eec24a0ca95049d378e00c5229f5da8ba9d99c42f100"}
Jul 15 20:50:34.897212 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:34.896894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f51db3a-58d0-4727-b841-2b8f381bb4c5","Type":"ContainerStarted","Data":"bc9c8596065e408fbedc50aa88cda1242e5d219900f75a9f769ccf5a5de562ba"}
Jul 15 20:50:34.897212 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:34.896937    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f51db3a-58d0-4727-b841-2b8f381bb4c5","Type":"ContainerStarted","Data":"689a82285b9a2b41d0e37c8245a06922f23e254e36a7e353d1e28462c52b64f3"}
Jul 15 20:50:34.897212 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:34.896960    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f51db3a-58d0-4727-b841-2b8f381bb4c5","Type":"ContainerStarted","Data":"d0eeff9be6c15e5a72c4cded2e573111e3f6b8c1212f341eaa475588cd789d38"}
Jul 15 20:50:34.897212 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:34.896999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f51db3a-58d0-4727-b841-2b8f381bb4c5","Type":"ContainerStarted","Data":"89b93e7d6ebdea4e169de673960c3f15d5e1e8f72241225609fcb02cee7256cf"}
Jul 15 20:50:34.927692 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:34.927639    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.909672015 podStartE2EDuration="2.927622719s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.950704ms" isStatefulPod=false podCreationTimestamp="2026-07-15 20:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:50:34.927085101 +0000 UTC m=+168.376436734" watchObservedRunningTime="2026-07-15 20:50:34.927622719 +0000 UTC m=+168.376974350"
Jul 15 20:50:35.004974 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.004942    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"]
Jul 15 20:50:35.008859 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.008832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.011199 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.011170    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 15 20:50:35.011199 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.011194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qbsxz\""
Jul 15 20:50:35.011372 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.011195    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 15 20:50:35.011372 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.011211    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 15 20:50:35.011372 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.011202    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 15 20:50:35.011644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.011627    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 15 20:50:35.017837 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.017814    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 15 20:50:35.025525 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.025500    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"]
Jul 15 20:50:35.129880 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.129844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-secret-telemeter-client\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.130044 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.129920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-federate-client-tls\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.130044 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.129945    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-serving-certs-ca-bundle\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.130044 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.130036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-metrics-client-ca\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.130153 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.130054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.130153 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.130080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.130153 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.130113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lwcx\" (UniqueName: \"kubernetes.io/projected/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-kube-api-access-7lwcx\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.130153 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.130143    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-telemeter-client-tls\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.231216 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.231131    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-secret-telemeter-client\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.231216 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.231168    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-federate-client-tls\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.231216 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.231189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-serving-certs-ca-bundle\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.231216 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.231221    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-metrics-client-ca\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.231547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.231239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.231547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.231258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.231547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.231276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lwcx\" (UniqueName: \"kubernetes.io/projected/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-kube-api-access-7lwcx\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.231547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.231302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-telemeter-client-tls\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.232032 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.232000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-serving-certs-ca-bundle\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.232128 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.232050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-metrics-client-ca\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.232185 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.232130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.233872 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.233851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-telemeter-client-tls\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.233961 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.233938    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-secret-telemeter-client\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.234015 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.233999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.234108 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.234087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-federate-client-tls\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.239324 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.239300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lwcx\" (UniqueName: \"kubernetes.io/projected/c3ddcd80-570f-4088-bbd4-2e3e43ce28e8-kube-api-access-7lwcx\") pod \"telemeter-client-6f89c9cf78-lmjbk\" (UID: \"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8\") " pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.320004 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.319966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"
Jul 15 20:50:35.489824 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.489793    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk"]
Jul 15 20:50:35.493121 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:50:35.493094    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ddcd80_570f_4088_bbd4_2e3e43ce28e8.slice/crio-86f7e19d3ee96624126ff80e865319f2d882affdda88b2f566edfa0316ca589f WatchSource:0}: Error finding container 86f7e19d3ee96624126ff80e865319f2d882affdda88b2f566edfa0316ca589f: Status 404 returned error can't find the container with id 86f7e19d3ee96624126ff80e865319f2d882affdda88b2f566edfa0316ca589f
Jul 15 20:50:35.902209 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:35.902113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk" event={"ID":"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8","Type":"ContainerStarted","Data":"86f7e19d3ee96624126ff80e865319f2d882affdda88b2f566edfa0316ca589f"}
Jul 15 20:50:38.917769 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:38.917734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk" event={"ID":"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8","Type":"ContainerStarted","Data":"e8b9c338a884d111bec3460623c3f92e006555be4c822d3e41e42bfe37bd80e0"}
Jul 15 20:50:38.918182 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:38.917792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk" event={"ID":"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8","Type":"ContainerStarted","Data":"04e14de019c1e45fec28c68f78318a947005714d0a44d0a9bd263f99a683f278"}
Jul 15 20:50:38.918182 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:38.917812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk" event={"ID":"c3ddcd80-570f-4088-bbd4-2e3e43ce28e8","Type":"ContainerStarted","Data":"b3ad187c846f4471a769036e8db3a9ab5307fc63e653dfa46cae93b15ca61b8e"}
Jul 15 20:50:38.944721 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:38.944666    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6f89c9cf78-lmjbk" podStartSLOduration=2.566046442 podStartE2EDuration="4.944639241s" totalImagesPullingTime="2.378592799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:50:38.943119444 +0000 UTC m=+172.392471077" watchObservedRunningTime="2026-07-15 20:50:38.944639241 +0000 UTC m=+172.393990872"
Jul 15 20:50:39.660188 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.660151    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f585d759f-2qx67"]
Jul 15 20:50:39.662505 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.662488    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.665630 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.665607    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 20:50:39.667841 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.667817    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 20:50:39.667939 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.667819    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 20:50:39.667939 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.667848    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 20:50:39.668043 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.668024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nmh6g\""
Jul 15 20:50:39.668480 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.668458    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-trusted-ca-bundle\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.668574 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.668504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-oauth-config\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.668574 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.668557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-service-ca\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.668696 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.668612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-serving-cert\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.668696 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.668637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvhk2\" (UniqueName: \"kubernetes.io/projected/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-kube-api-access-tvhk2\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.668696 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.668664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-config\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.668859 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.668694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-oauth-serving-cert\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.686627 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.686603    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 20:50:39.691408 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.691382    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f585d759f-2qx67"]
Jul 15 20:50:39.714591 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.714560    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 20:50:39.769740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.769696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-service-ca\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.769896 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.769755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-serving-cert\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.769896 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.769785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvhk2\" (UniqueName: \"kubernetes.io/projected/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-kube-api-access-tvhk2\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.769896 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.769811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-config\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.769896 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.769838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-oauth-serving-cert\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.769896 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.769872    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-trusted-ca-bundle\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.770165 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.770002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-oauth-config\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.770632 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.770601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-service-ca\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.770734 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.770632    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-config\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.770734 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.770666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-oauth-serving-cert\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.770851 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.770753    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-trusted-ca-bundle\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.772356 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.772335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-serving-cert\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.772455 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.772395    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-oauth-config\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.778844 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.778819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvhk2\" (UniqueName: \"kubernetes.io/projected/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-kube-api-access-tvhk2\") pod \"console-5f585d759f-2qx67\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") " pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:39.972022 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:39.971927    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:40.105113 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:40.105079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f585d759f-2qx67"]
Jul 15 20:50:40.109703 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:50:40.109662    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf1265c_c7ec_40cb_894b_27a24b8ffe34.slice/crio-b2497a67578c2048697d16881a148b247914c44b6d1baf02df056a3dfa6fc3df WatchSource:0}: Error finding container b2497a67578c2048697d16881a148b247914c44b6d1baf02df056a3dfa6fc3df: Status 404 returned error can't find the container with id b2497a67578c2048697d16881a148b247914c44b6d1baf02df056a3dfa6fc3df
Jul 15 20:50:40.927663 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:40.927625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f585d759f-2qx67" event={"ID":"8cf1265c-c7ec-40cb-894b-27a24b8ffe34","Type":"ContainerStarted","Data":"86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a"}
Jul 15 20:50:40.927836 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:40.927675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f585d759f-2qx67" event={"ID":"8cf1265c-c7ec-40cb-894b-27a24b8ffe34","Type":"ContainerStarted","Data":"b2497a67578c2048697d16881a148b247914c44b6d1baf02df056a3dfa6fc3df"}
Jul 15 20:50:40.950296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:40.950248    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f585d759f-2qx67" podStartSLOduration=1.950229752 podStartE2EDuration="1.950229752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:50:40.949476806 +0000 UTC m=+174.398828458" watchObservedRunningTime="2026-07-15 20:50:40.950229752 +0000 UTC m=+174.399581383"
Jul 15 20:50:49.972938 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:49.972899    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:49.973327 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:49.972964    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:49.977850 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:49.977820    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:50:50.969534 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:50:50.969505    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:51:53.507914 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.507880    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-797bccb74d-4t4ms"]
Jul 15 20:51:53.511030 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.511012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.524041 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.524012    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797bccb74d-4t4ms"]
Jul 15 20:51:53.558171 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.558131    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-oauth-config\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.558171 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.558167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-oauth-serving-cert\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.558390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.558199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srsqv\" (UniqueName: \"kubernetes.io/projected/6e553c0c-e970-491c-a6a2-ed94682886c9-kube-api-access-srsqv\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.558390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.558289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-console-config\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.558390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.558321    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-serving-cert\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.558390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.558358    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-service-ca\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.558390 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.558391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-trusted-ca-bundle\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.659224 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.659189    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-trusted-ca-bundle\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.659224 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.659234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-oauth-config\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.659509 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.659250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-oauth-serving-cert\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.659509 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.659283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srsqv\" (UniqueName: \"kubernetes.io/projected/6e553c0c-e970-491c-a6a2-ed94682886c9-kube-api-access-srsqv\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.659509 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.659312    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-console-config\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.659509 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.659347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-serving-cert\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.659509 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.659414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-service-ca\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.660047 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.660019    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-oauth-serving-cert\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.660139 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.660089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-console-config\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.660182 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.660136    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-service-ca\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.660473 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.660455    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-trusted-ca-bundle\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.661777 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.661751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-oauth-config\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.661881 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.661865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-serving-cert\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.667292 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.667272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srsqv\" (UniqueName: \"kubernetes.io/projected/6e553c0c-e970-491c-a6a2-ed94682886c9-kube-api-access-srsqv\") pod \"console-797bccb74d-4t4ms\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") " pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.820589 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.820500    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:51:53.953949 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:53.953918    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-797bccb74d-4t4ms"]
Jul 15 20:51:53.956894 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:51:53.956869    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e553c0c_e970_491c_a6a2_ed94682886c9.slice/crio-76c4b4337e2c9649c9cffb95064f3e57b70564a18c5b367690da8292a511a835 WatchSource:0}: Error finding container 76c4b4337e2c9649c9cffb95064f3e57b70564a18c5b367690da8292a511a835: Status 404 returned error can't find the container with id 76c4b4337e2c9649c9cffb95064f3e57b70564a18c5b367690da8292a511a835
Jul 15 20:51:54.200861 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:54.200768    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797bccb74d-4t4ms" event={"ID":"6e553c0c-e970-491c-a6a2-ed94682886c9","Type":"ContainerStarted","Data":"89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f"}
Jul 15 20:51:54.200861 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:54.200820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797bccb74d-4t4ms" event={"ID":"6e553c0c-e970-491c-a6a2-ed94682886c9","Type":"ContainerStarted","Data":"76c4b4337e2c9649c9cffb95064f3e57b70564a18c5b367690da8292a511a835"}
Jul 15 20:51:54.219627 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:51:54.219358    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-797bccb74d-4t4ms" podStartSLOduration=1.219336229 podStartE2EDuration="1.219336229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:51:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:51:54.218220412 +0000 UTC m=+247.667572044" watchObservedRunningTime="2026-07-15 20:51:54.219336229 +0000 UTC m=+247.668687865"
Jul 15 20:52:03.821108 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:03.821066    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:52:03.821651 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:03.821130    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:52:03.825974 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:03.825949    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:52:04.244504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:04.244474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:52:04.291730 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:04.291698    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f585d759f-2qx67"]
Jul 15 20:52:29.313927 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.313862    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f585d759f-2qx67" podUID="8cf1265c-c7ec-40cb-894b-27a24b8ffe34" containerName="console" containerID="cri-o://86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a" gracePeriod=15
Jul 15 20:52:29.559965 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.559939    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:52:29.655735 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.655636    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvhk2\" (UniqueName: \"kubernetes.io/projected/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-kube-api-access-tvhk2\") pod \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") "
Jul 15 20:52:29.655735 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.655707    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-oauth-config\") pod \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") "
Jul 15 20:52:29.655959 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.655764    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-oauth-serving-cert\") pod \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") "
Jul 15 20:52:29.655959 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.655791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-trusted-ca-bundle\") pod \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") "
Jul 15 20:52:29.655959 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.655820    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-service-ca\") pod \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") "
Jul 15 20:52:29.655959 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.655844    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-config\") pod \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") "
Jul 15 20:52:29.655959 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.655880    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-serving-cert\") pod \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\" (UID: \"8cf1265c-c7ec-40cb-894b-27a24b8ffe34\") "
Jul 15 20:52:29.656297 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.656239    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-service-ca" (OuterVolumeSpecName: "service-ca") pod "8cf1265c-c7ec-40cb-894b-27a24b8ffe34" (UID: "8cf1265c-c7ec-40cb-894b-27a24b8ffe34"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:52:29.656297 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.656250    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8cf1265c-c7ec-40cb-894b-27a24b8ffe34" (UID: "8cf1265c-c7ec-40cb-894b-27a24b8ffe34"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:52:29.656297 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.656265    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8cf1265c-c7ec-40cb-894b-27a24b8ffe34" (UID: "8cf1265c-c7ec-40cb-894b-27a24b8ffe34"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:52:29.656297 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.656258    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-config" (OuterVolumeSpecName: "console-config") pod "8cf1265c-c7ec-40cb-894b-27a24b8ffe34" (UID: "8cf1265c-c7ec-40cb-894b-27a24b8ffe34"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:52:29.657903 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.657871    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-kube-api-access-tvhk2" (OuterVolumeSpecName: "kube-api-access-tvhk2") pod "8cf1265c-c7ec-40cb-894b-27a24b8ffe34" (UID: "8cf1265c-c7ec-40cb-894b-27a24b8ffe34"). InnerVolumeSpecName "kube-api-access-tvhk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:52:29.658002 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.657914    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8cf1265c-c7ec-40cb-894b-27a24b8ffe34" (UID: "8cf1265c-c7ec-40cb-894b-27a24b8ffe34"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:52:29.658002 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.657960    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8cf1265c-c7ec-40cb-894b-27a24b8ffe34" (UID: "8cf1265c-c7ec-40cb-894b-27a24b8ffe34"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:52:29.757480 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.757442    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-service-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:52:29.757480 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.757471    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:52:29.757480 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.757480    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-serving-cert\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:52:29.757480 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.757488    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvhk2\" (UniqueName: \"kubernetes.io/projected/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-kube-api-access-tvhk2\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:52:29.757740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.757498    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-console-oauth-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:52:29.757740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.757509    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-oauth-serving-cert\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:52:29.757740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:29.757518    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cf1265c-c7ec-40cb-894b-27a24b8ffe34-trusted-ca-bundle\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:52:30.335755 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.335719    2565 generic.go:356] "Generic (PLEG): container finished" podID="8cf1265c-c7ec-40cb-894b-27a24b8ffe34" containerID="86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a" exitCode=0
Jul 15 20:52:30.336236 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.335768    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f585d759f-2qx67"
Jul 15 20:52:30.336236 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.335801    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f585d759f-2qx67" event={"ID":"8cf1265c-c7ec-40cb-894b-27a24b8ffe34","Type":"ContainerDied","Data":"86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a"}
Jul 15 20:52:30.336236 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.335854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f585d759f-2qx67" event={"ID":"8cf1265c-c7ec-40cb-894b-27a24b8ffe34","Type":"ContainerDied","Data":"b2497a67578c2048697d16881a148b247914c44b6d1baf02df056a3dfa6fc3df"}
Jul 15 20:52:30.336236 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.335875    2565 scope.go:117] "RemoveContainer" containerID="86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a"
Jul 15 20:52:30.344141 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.344125    2565 scope.go:117] "RemoveContainer" containerID="86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a"
Jul 15 20:52:30.344400 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:52:30.344383    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a\": container with ID starting with 86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a not found: ID does not exist" containerID="86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a"
Jul 15 20:52:30.344504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.344407    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a"} err="failed to get container status \"86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a\": rpc error: code = NotFound desc = could not find container \"86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a\": container with ID starting with 86ffd17aadf46ff97a87bdb1ff5f3a3616cb0d0e08f337b8c9f90eed9872ce8a not found: ID does not exist"
Jul 15 20:52:30.357609 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.357583    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f585d759f-2qx67"]
Jul 15 20:52:30.361746 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:30.361720    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f585d759f-2qx67"]
Jul 15 20:52:31.141735 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:31.141706    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cf1265c-c7ec-40cb-894b-27a24b8ffe34" path="/var/lib/kubelet/pods/8cf1265c-c7ec-40cb-894b-27a24b8ffe34/volumes"
Jul 15 20:52:46.965253 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:46.965223    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:52:46.968113 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:46.968091    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:52:46.971875 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:52:46.971853    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 20:53:41.300168 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.300089    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-65wpq"]
Jul 15 20:53:41.300589 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.300398    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf1265c-c7ec-40cb-894b-27a24b8ffe34" containerName="console"
Jul 15 20:53:41.300589 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.300412    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf1265c-c7ec-40cb-894b-27a24b8ffe34" containerName="console"
Jul 15 20:53:41.300589 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.300515    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf1265c-c7ec-40cb-894b-27a24b8ffe34" containerName="console"
Jul 15 20:53:41.303354 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.303336    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:41.306614 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.306595    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h8wnk\""
Jul 15 20:53:41.306759 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.306733    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 20:53:41.307255 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.307243    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 20:53:41.316644 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.316621    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-65wpq"]
Jul 15 20:53:41.435657 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.435616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b222d84-56af-4ed1-b93e-1845da7ceb74-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-65wpq\" (UID: \"4b222d84-56af-4ed1-b93e-1845da7ceb74\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:41.435847 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.435663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p27zl\" (UniqueName: \"kubernetes.io/projected/4b222d84-56af-4ed1-b93e-1845da7ceb74-kube-api-access-p27zl\") pod \"cert-manager-webhook-6486ffd997-65wpq\" (UID: \"4b222d84-56af-4ed1-b93e-1845da7ceb74\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:41.536724 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.536680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b222d84-56af-4ed1-b93e-1845da7ceb74-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-65wpq\" (UID: \"4b222d84-56af-4ed1-b93e-1845da7ceb74\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:41.536724 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.536726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p27zl\" (UniqueName: \"kubernetes.io/projected/4b222d84-56af-4ed1-b93e-1845da7ceb74-kube-api-access-p27zl\") pod \"cert-manager-webhook-6486ffd997-65wpq\" (UID: \"4b222d84-56af-4ed1-b93e-1845da7ceb74\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:41.545479 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.545446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4b222d84-56af-4ed1-b93e-1845da7ceb74-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-65wpq\" (UID: \"4b222d84-56af-4ed1-b93e-1845da7ceb74\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:41.545611 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.545480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p27zl\" (UniqueName: \"kubernetes.io/projected/4b222d84-56af-4ed1-b93e-1845da7ceb74-kube-api-access-p27zl\") pod \"cert-manager-webhook-6486ffd997-65wpq\" (UID: \"4b222d84-56af-4ed1-b93e-1845da7ceb74\") " pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:41.612708 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.612613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:41.764586 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.764552    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-65wpq"]
Jul 15 20:53:41.768622 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:53:41.768594    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b222d84_56af_4ed1_b93e_1845da7ceb74.slice/crio-b015ac33ce6ab07f7b5890567869ec52a0af230745894f7772a8aae989c27c30 WatchSource:0}: Error finding container b015ac33ce6ab07f7b5890567869ec52a0af230745894f7772a8aae989c27c30: Status 404 returned error can't find the container with id b015ac33ce6ab07f7b5890567869ec52a0af230745894f7772a8aae989c27c30
Jul 15 20:53:41.772462 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:41.771114    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 20:53:42.602777 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:42.602723    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq" event={"ID":"4b222d84-56af-4ed1-b93e-1845da7ceb74","Type":"ContainerStarted","Data":"b015ac33ce6ab07f7b5890567869ec52a0af230745894f7772a8aae989c27c30"}
Jul 15 20:53:45.617341 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:45.617307    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq" event={"ID":"4b222d84-56af-4ed1-b93e-1845da7ceb74","Type":"ContainerStarted","Data":"8bd6c7629f294232649629b3631d2b55fa235433fca64c4169bb6ca00bd1c9ed"}
Jul 15 20:53:45.617830 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:45.617369    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:45.660770 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:45.660619    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq" podStartSLOduration=1.745862154 podStartE2EDuration="4.660599219s" totalImagesPullingTime="2.914737065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:53:45.660510942 +0000 UTC m=+359.109862574" watchObservedRunningTime="2026-07-15 20:53:45.660599219 +0000 UTC m=+359.109950852"
Jul 15 20:53:51.622846 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.622811    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-65wpq"
Jul 15 20:53:51.644967 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.644936    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-plknq"]
Jul 15 20:53:51.648127 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.648109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-plknq"
Jul 15 20:53:51.650994 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.650966    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v4255\""
Jul 15 20:53:51.666850 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.666823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-plknq"]
Jul 15 20:53:51.828830 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.828778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aff59b5f-cfa3-4876-bf92-0b2150e55594-bound-sa-token\") pod \"cert-manager-55b4d954d5-plknq\" (UID: \"aff59b5f-cfa3-4876-bf92-0b2150e55594\") " pod="cert-manager/cert-manager-55b4d954d5-plknq"
Jul 15 20:53:51.829009 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.828857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qftb\" (UniqueName: \"kubernetes.io/projected/aff59b5f-cfa3-4876-bf92-0b2150e55594-kube-api-access-4qftb\") pod \"cert-manager-55b4d954d5-plknq\" (UID: \"aff59b5f-cfa3-4876-bf92-0b2150e55594\") " pod="cert-manager/cert-manager-55b4d954d5-plknq"
Jul 15 20:53:51.929893 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.929801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qftb\" (UniqueName: \"kubernetes.io/projected/aff59b5f-cfa3-4876-bf92-0b2150e55594-kube-api-access-4qftb\") pod \"cert-manager-55b4d954d5-plknq\" (UID: \"aff59b5f-cfa3-4876-bf92-0b2150e55594\") " pod="cert-manager/cert-manager-55b4d954d5-plknq"
Jul 15 20:53:51.929893 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.929869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aff59b5f-cfa3-4876-bf92-0b2150e55594-bound-sa-token\") pod \"cert-manager-55b4d954d5-plknq\" (UID: \"aff59b5f-cfa3-4876-bf92-0b2150e55594\") " pod="cert-manager/cert-manager-55b4d954d5-plknq"
Jul 15 20:53:51.942070 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.942037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aff59b5f-cfa3-4876-bf92-0b2150e55594-bound-sa-token\") pod \"cert-manager-55b4d954d5-plknq\" (UID: \"aff59b5f-cfa3-4876-bf92-0b2150e55594\") " pod="cert-manager/cert-manager-55b4d954d5-plknq"
Jul 15 20:53:51.946797 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.946771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qftb\" (UniqueName: \"kubernetes.io/projected/aff59b5f-cfa3-4876-bf92-0b2150e55594-kube-api-access-4qftb\") pod \"cert-manager-55b4d954d5-plknq\" (UID: \"aff59b5f-cfa3-4876-bf92-0b2150e55594\") " pod="cert-manager/cert-manager-55b4d954d5-plknq"
Jul 15 20:53:51.956593 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:51.956564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-plknq"
Jul 15 20:53:52.095128 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:52.095097    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-plknq"]
Jul 15 20:53:52.098251 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:53:52.098223    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaff59b5f_cfa3_4876_bf92_0b2150e55594.slice/crio-cb05e97485fe8837bbeb86a1b376e5621e7e24e771ca45a95c7a7fd726fca90d WatchSource:0}: Error finding container cb05e97485fe8837bbeb86a1b376e5621e7e24e771ca45a95c7a7fd726fca90d: Status 404 returned error can't find the container with id cb05e97485fe8837bbeb86a1b376e5621e7e24e771ca45a95c7a7fd726fca90d
Jul 15 20:53:52.642031 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:52.641993    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-plknq" event={"ID":"aff59b5f-cfa3-4876-bf92-0b2150e55594","Type":"ContainerStarted","Data":"0e3328daeb11643fae7f448f935fdfe54d39e30db2aa6f8f9debd7b115dee10a"}
Jul 15 20:53:52.642400 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:52.642042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-plknq" event={"ID":"aff59b5f-cfa3-4876-bf92-0b2150e55594","Type":"ContainerStarted","Data":"cb05e97485fe8837bbeb86a1b376e5621e7e24e771ca45a95c7a7fd726fca90d"}
Jul 15 20:53:52.664928 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:53:52.664868    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-plknq" podStartSLOduration=1.6648507430000001 podStartE2EDuration="1.664850743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:53:52.662854194 +0000 UTC m=+366.112205828" watchObservedRunningTime="2026-07-15 20:53:52.664850743 +0000 UTC m=+366.114202374"
Jul 15 20:54:17.429938 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.429907    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"]
Jul 15 20:54:17.433277 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.433260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.437364 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.437343    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2vtb\""
Jul 15 20:54:17.438375 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.438355    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 20:54:17.449617 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.449589    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 20:54:17.449749 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.449629    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 20:54:17.457896 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.457874    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 20:54:17.518030 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.517996    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"]
Jul 15 20:54:17.528788 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.528757    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-tmp\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.528957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.528793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.528957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.528840    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-webhook-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.528957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.528876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9d4q\" (UniqueName: \"kubernetes.io/projected/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-kube-api-access-b9d4q\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.528957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.528909    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-manifests\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.630275 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.630235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-webhook-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.630275 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.630280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9d4q\" (UniqueName: \"kubernetes.io/projected/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-kube-api-access-b9d4q\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.630546 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.630313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-manifests\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.630546 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.630338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-tmp\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.630546 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.630362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.630782 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.630752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-manifests\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.632789 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.632764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-tmp\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.632902 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.632860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-webhook-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.633021 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.632955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.644455 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.644413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9d4q\" (UniqueName: \"kubernetes.io/projected/2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48-kube-api-access-b9d4q\") pod \"opendatahub-operator-controller-manager-b849856cb-sf5nk\" (UID: \"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48\") " pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.743083 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.743053    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:17.918256 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:17.918142    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"]
Jul 15 20:54:17.921286 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:54:17.921257    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1f864d_8060_4ee1_8ce5_cf6b4e63bb48.slice/crio-3593b937b7a82e45dba7deb6a0d44cf2f3bde7c0a62aca1b825841f9c3c9861a WatchSource:0}: Error finding container 3593b937b7a82e45dba7deb6a0d44cf2f3bde7c0a62aca1b825841f9c3c9861a: Status 404 returned error can't find the container with id 3593b937b7a82e45dba7deb6a0d44cf2f3bde7c0a62aca1b825841f9c3c9861a
Jul 15 20:54:18.741755 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:18.741694    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk" event={"ID":"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48","Type":"ContainerStarted","Data":"3593b937b7a82e45dba7deb6a0d44cf2f3bde7c0a62aca1b825841f9c3c9861a"}
Jul 15 20:54:21.757410 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:21.757377    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk" event={"ID":"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48","Type":"ContainerStarted","Data":"038258aa729c06391d1026b21340ac16a063747b2c6852d8309c8a009556b60a"}
Jul 15 20:54:22.764162 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:22.764120    2565 generic.go:356] "Generic (PLEG): container finished" podID="2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48" containerID="038258aa729c06391d1026b21340ac16a063747b2c6852d8309c8a009556b60a" exitCode=0
Jul 15 20:54:22.764793 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:22.764177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk" event={"ID":"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48","Type":"ContainerDied","Data":"038258aa729c06391d1026b21340ac16a063747b2c6852d8309c8a009556b60a"}
Jul 15 20:54:23.770471 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:23.770411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk" event={"ID":"2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48","Type":"ContainerStarted","Data":"a0f29806a607f0c0a2b2d4aab8ecf549c47c8502eaf251e7906d9880523f1726"}
Jul 15 20:54:23.770854 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:23.770568    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:23.797259 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:23.797204    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk" podStartSLOduration=2.303607146 podStartE2EDuration="6.79718698s" totalImagesPullingTime="3.426917191s" totalInitContainerRuntime="1.066662643s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:23.794915105 +0000 UTC m=+397.244266732" watchObservedRunningTime="2026-07-15 20:54:23.79718698 +0000 UTC m=+397.246538611"
Jul 15 20:54:34.777504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:34.777470    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b849856cb-sf5nk"
Jul 15 20:54:37.415758 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.415722    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-796df4448b-fswmf"]
Jul 15 20:54:37.423715 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.423684    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.426493 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.426470    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 20:54:37.426629 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.426493    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 20:54:37.427393 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.427372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9s6ks\""
Jul 15 20:54:37.427547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.427401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 20:54:37.427547 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.427406    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 20:54:37.434014 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.433991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-796df4448b-fswmf"]
Jul 15 20:54:37.508988 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.508947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-tls-certs\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.509182 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.509000    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnt2q\" (UniqueName: \"kubernetes.io/projected/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-kube-api-access-gnt2q\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.509182 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.509118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-tmp\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.610404 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.610368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnt2q\" (UniqueName: \"kubernetes.io/projected/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-kube-api-access-gnt2q\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.610590 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.610444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-tmp\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.610590 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.610516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-tls-certs\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.612854 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.612825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-tmp\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.613097 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.613080    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-tls-certs\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.624384 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.624355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnt2q\" (UniqueName: \"kubernetes.io/projected/b5837dd3-d3b3-4e10-a207-b7b33b41d79e-kube-api-access-gnt2q\") pod \"kube-auth-proxy-796df4448b-fswmf\" (UID: \"b5837dd3-d3b3-4e10-a207-b7b33b41d79e\") " pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.734784 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.734679    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf"
Jul 15 20:54:37.895741 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:37.895709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-796df4448b-fswmf"]
Jul 15 20:54:37.899027 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:54:37.898998    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5837dd3_d3b3_4e10_a207_b7b33b41d79e.slice/crio-bc84c8997ff70c39f99080115239caf44ac2337ed12b2832af975a252e1da47a WatchSource:0}: Error finding container bc84c8997ff70c39f99080115239caf44ac2337ed12b2832af975a252e1da47a: Status 404 returned error can't find the container with id bc84c8997ff70c39f99080115239caf44ac2337ed12b2832af975a252e1da47a
Jul 15 20:54:38.837113 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:38.837072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf" event={"ID":"b5837dd3-d3b3-4e10-a207-b7b33b41d79e","Type":"ContainerStarted","Data":"bc84c8997ff70c39f99080115239caf44ac2337ed12b2832af975a252e1da47a"}
Jul 15 20:54:39.204854 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.204771    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"]
Jul 15 20:54:39.207259 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.207237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.210016 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.209992    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 20:54:39.210244 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.210226    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 20:54:39.210244 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.210236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 20:54:39.210367 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.210232    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 20:54:39.210532 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.210514    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jd54v\""
Jul 15 20:54:39.219751 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.219728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"]
Jul 15 20:54:39.324513 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.324470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.324702 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.324533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2bkq\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-kube-api-access-z2bkq\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.324702 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.324628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.324702 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.324682    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f3aed1-313b-4eb0-8366-83107434c9c9-local-certs\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.324839 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.324713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-token\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.324839 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.324731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-cacerts\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.324986 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.324968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.425990 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.425953    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.426161 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.426013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f3aed1-313b-4eb0-8366-83107434c9c9-local-certs\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.426161 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.426042    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-token\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.426161 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.426067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-cacerts\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.426969 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.426931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.427082 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.427013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.427816 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.427243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.427816 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.427255    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2bkq\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-kube-api-access-z2bkq\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.432740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.429888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-cacerts\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.432740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.430141    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.432740 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.430251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.434792 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.434768    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f3aed1-313b-4eb0-8366-83107434c9c9-local-certs\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.436296 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.436270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-token\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.437248 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.437225    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2bkq\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-kube-api-access-z2bkq\") pod \"istiod-openshift-gateway-7574459656-mb8xq\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.516330 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.516295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:39.674586 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.674474    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"]
Jul 15 20:54:39.677003 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:54:39.676970    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f3aed1_313b_4eb0_8366_83107434c9c9.slice/crio-394c18ee48a0fd1f593fb341f9d7560dcb66b5ae431717aa4cbaa5091bad196b WatchSource:0}: Error finding container 394c18ee48a0fd1f593fb341f9d7560dcb66b5ae431717aa4cbaa5091bad196b: Status 404 returned error can't find the container with id 394c18ee48a0fd1f593fb341f9d7560dcb66b5ae431717aa4cbaa5091bad196b
Jul 15 20:54:39.842234 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:39.842147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq" event={"ID":"22f3aed1-313b-4eb0-8366-83107434c9c9","Type":"ContainerStarted","Data":"394c18ee48a0fd1f593fb341f9d7560dcb66b5ae431717aa4cbaa5091bad196b"}
Jul 15 20:54:40.850863 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:40.850819    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf" event={"ID":"b5837dd3-d3b3-4e10-a207-b7b33b41d79e","Type":"ContainerStarted","Data":"ad0afcc0dda83f03ef5f22acb1b07b5609a4cf76ade940a454f85aaf61510e6d"}
Jul 15 20:54:40.874974 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:40.874907    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-796df4448b-fswmf" podStartSLOduration=1.044024464 podStartE2EDuration="3.874883908s" totalImagesPullingTime="2.830859444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:40.873448404 +0000 UTC m=+414.322800055" watchObservedRunningTime="2026-07-15 20:54:40.874883908 +0000 UTC m=+414.324235540"
Jul 15 20:54:43.337444 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:43.337381    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 20:54:43.337708 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:43.337483    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 15 20:54:43.867667 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:43.867631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq" event={"ID":"22f3aed1-313b-4eb0-8366-83107434c9c9","Type":"ContainerStarted","Data":"a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2"}
Jul 15 20:54:43.867849 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:43.867759    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:43.892965 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:43.892905    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq" podStartSLOduration=1.235351997 podStartE2EDuration="4.892881596s" totalImagesPullingTime="3.657529599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:43.89130429 +0000 UTC m=+417.340655924" watchObservedRunningTime="2026-07-15 20:54:43.892881596 +0000 UTC m=+417.342233230"
Jul 15 20:54:44.873267 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:44.873236    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:45.645743 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.645698    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"]
Jul 15 20:54:45.648018 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.648000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.651475 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.651446    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 20:54:45.651697 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.651682    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 20:54:45.652306 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.652283    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 20:54:45.652306 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.652295    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 20:54:45.652457 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.652364    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v649g\""
Jul 15 20:54:45.652457 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.652383    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 20:54:45.675462 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.675409    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"]
Jul 15 20:54:45.682731 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.682702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7bd4116-4875-47ca-b11a-84173bb76c71-manager-config\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.682731 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.682735    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7bd4116-4875-47ca-b11a-84173bb76c71-metrics-cert\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.682952 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.682799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7bd4116-4875-47ca-b11a-84173bb76c71-cert\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.682952 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.682822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4x2\" (UniqueName: \"kubernetes.io/projected/c7bd4116-4875-47ca-b11a-84173bb76c71-kube-api-access-wm4x2\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.783707 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.783658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7bd4116-4875-47ca-b11a-84173bb76c71-manager-config\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.783707 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.783707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7bd4116-4875-47ca-b11a-84173bb76c71-metrics-cert\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.783976 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.783765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7bd4116-4875-47ca-b11a-84173bb76c71-cert\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.783976 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.783785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4x2\" (UniqueName: \"kubernetes.io/projected/c7bd4116-4875-47ca-b11a-84173bb76c71-kube-api-access-wm4x2\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.784367 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.784343    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c7bd4116-4875-47ca-b11a-84173bb76c71-manager-config\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.786282 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.786252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c7bd4116-4875-47ca-b11a-84173bb76c71-metrics-cert\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.786388 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.786314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c7bd4116-4875-47ca-b11a-84173bb76c71-cert\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.792961 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.792932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4x2\" (UniqueName: \"kubernetes.io/projected/c7bd4116-4875-47ca-b11a-84173bb76c71-kube-api-access-wm4x2\") pod \"lws-controller-manager-6bd6785cdc-kv829\" (UID: \"c7bd4116-4875-47ca-b11a-84173bb76c71\") " pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:45.958080 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:45.957979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:46.135255 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:46.135229    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"]
Jul 15 20:54:46.138075 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:54:46.138045    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7bd4116_4875_47ca_b11a_84173bb76c71.slice/crio-2ad186653fc29ab57464add7420fbaab8ce078e767d457d912d9c54cf44e5362 WatchSource:0}: Error finding container 2ad186653fc29ab57464add7420fbaab8ce078e767d457d912d9c54cf44e5362: Status 404 returned error can't find the container with id 2ad186653fc29ab57464add7420fbaab8ce078e767d457d912d9c54cf44e5362
Jul 15 20:54:46.882029 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:46.881992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829" event={"ID":"c7bd4116-4875-47ca-b11a-84173bb76c71","Type":"ContainerStarted","Data":"2ad186653fc29ab57464add7420fbaab8ce078e767d457d912d9c54cf44e5362"}
Jul 15 20:54:48.892434 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:48.892362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829" event={"ID":"c7bd4116-4875-47ca-b11a-84173bb76c71","Type":"ContainerStarted","Data":"099dbcfeb3bac2cf6de860e98a9c74b6b709cb2f70b3b3e2f7a2bd853ec8bf9a"}
Jul 15 20:54:48.893039 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:48.892462    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:54:48.922741 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:48.922690    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829" podStartSLOduration=1.3030585129999999 podStartE2EDuration="3.922673245s" totalImagesPullingTime="2.619614732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:54:48.921942619 +0000 UTC m=+422.371294269" watchObservedRunningTime="2026-07-15 20:54:48.922673245 +0000 UTC m=+422.372024876"
Jul 15 20:54:51.110031 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.109994    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"]
Jul 15 20:54:51.110517 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.110203    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq" podUID="22f3aed1-313b-4eb0-8366-83107434c9c9" containerName="discovery" containerID="cri-o://a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2" gracePeriod=30
Jul 15 20:54:51.354880 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.354856    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:51.435203 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435121    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-ca-configmap\") pod \"22f3aed1-313b-4eb0-8366-83107434c9c9\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") "
Jul 15 20:54:51.435203 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435157    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-dns-cert\") pod \"22f3aed1-313b-4eb0-8366-83107434c9c9\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") "
Jul 15 20:54:51.435203 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435181    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-token\") pod \"22f3aed1-313b-4eb0-8366-83107434c9c9\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") "
Jul 15 20:54:51.435476 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435254    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-cacerts\") pod \"22f3aed1-313b-4eb0-8366-83107434c9c9\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") "
Jul 15 20:54:51.435476 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f3aed1-313b-4eb0-8366-83107434c9c9-local-certs\") pod \"22f3aed1-313b-4eb0-8366-83107434c9c9\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") "
Jul 15 20:54:51.435476 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435333    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2bkq\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-kube-api-access-z2bkq\") pod \"22f3aed1-313b-4eb0-8366-83107434c9c9\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") "
Jul 15 20:54:51.435476 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-kubeconfig\") pod \"22f3aed1-313b-4eb0-8366-83107434c9c9\" (UID: \"22f3aed1-313b-4eb0-8366-83107434c9c9\") "
Jul 15 20:54:51.435681 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435565    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "22f3aed1-313b-4eb0-8366-83107434c9c9" (UID: "22f3aed1-313b-4eb0-8366-83107434c9c9"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:54:51.435681 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.435646    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-ca-configmap\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:54:51.437702 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.437662    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22f3aed1-313b-4eb0-8366-83107434c9c9-local-certs" (OuterVolumeSpecName: "local-certs") pod "22f3aed1-313b-4eb0-8366-83107434c9c9" (UID: "22f3aed1-313b-4eb0-8366-83107434c9c9"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 20:54:51.437702 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.437688    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "22f3aed1-313b-4eb0-8366-83107434c9c9" (UID: "22f3aed1-313b-4eb0-8366-83107434c9c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:54:51.437981 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.437952    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-cacerts" (OuterVolumeSpecName: "cacerts") pod "22f3aed1-313b-4eb0-8366-83107434c9c9" (UID: "22f3aed1-313b-4eb0-8366-83107434c9c9"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:54:51.438062 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.437978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "22f3aed1-313b-4eb0-8366-83107434c9c9" (UID: "22f3aed1-313b-4eb0-8366-83107434c9c9"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:54:51.438062 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.438036    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-kube-api-access-z2bkq" (OuterVolumeSpecName: "kube-api-access-z2bkq") pod "22f3aed1-313b-4eb0-8366-83107434c9c9" (UID: "22f3aed1-313b-4eb0-8366-83107434c9c9"). InnerVolumeSpecName "kube-api-access-z2bkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:54:51.438173 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.438151    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "22f3aed1-313b-4eb0-8366-83107434c9c9" (UID: "22f3aed1-313b-4eb0-8366-83107434c9c9"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:54:51.536362 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.536326    2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-cacerts\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:54:51.536362 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.536355    2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f3aed1-313b-4eb0-8366-83107434c9c9-local-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:54:51.536362 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.536366    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2bkq\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-kube-api-access-z2bkq\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:54:51.536600 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.536376    2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-kubeconfig\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:54:51.536600 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.536385    2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-csr-dns-cert\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:54:51.536600 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.536392    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f3aed1-313b-4eb0-8366-83107434c9c9-istio-token\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:54:51.908618 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.908584    2565 generic.go:356] "Generic (PLEG): container finished" podID="22f3aed1-313b-4eb0-8366-83107434c9c9" containerID="a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2" exitCode=0
Jul 15 20:54:51.908813 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.908632    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"
Jul 15 20:54:51.908813 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.908653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq" event={"ID":"22f3aed1-313b-4eb0-8366-83107434c9c9","Type":"ContainerDied","Data":"a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2"}
Jul 15 20:54:51.908813 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.908710    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq" event={"ID":"22f3aed1-313b-4eb0-8366-83107434c9c9","Type":"ContainerDied","Data":"394c18ee48a0fd1f593fb341f9d7560dcb66b5ae431717aa4cbaa5091bad196b"}
Jul 15 20:54:51.908813 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.908739    2565 scope.go:117] "RemoveContainer" containerID="a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2"
Jul 15 20:54:51.918354 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.918333    2565 scope.go:117] "RemoveContainer" containerID="a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2"
Jul 15 20:54:51.918739 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:54:51.918710    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2\": container with ID starting with a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2 not found: ID does not exist" containerID="a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2"
Jul 15 20:54:51.918822 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.918751    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2"} err="failed to get container status \"a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2\": rpc error: code = NotFound desc = could not find container \"a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2\": container with ID starting with a71551df99d33cf8fb2910b32f4afbd212877b967f6971adf8535c8d68695fe2 not found: ID does not exist"
Jul 15 20:54:51.933145 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.933118    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"]
Jul 15 20:54:51.940543 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:51.940515    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-mb8xq"]
Jul 15 20:54:53.142082 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:53.142051    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f3aed1-313b-4eb0-8366-83107434c9c9" path="/var/lib/kubelet/pods/22f3aed1-313b-4eb0-8366-83107434c9c9/volumes"
Jul 15 20:54:59.899722 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:54:59.899691    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6bd6785cdc-kv829"
Jul 15 20:56:10.546379 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:10.546346    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797bccb74d-4t4ms"]
Jul 15 20:56:19.785626 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.785590    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"]
Jul 15 20:56:19.786082 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.785903    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f3aed1-313b-4eb0-8366-83107434c9c9" containerName="discovery"
Jul 15 20:56:19.786082 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.785916    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f3aed1-313b-4eb0-8366-83107434c9c9" containerName="discovery"
Jul 15 20:56:19.786082 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.785998    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f3aed1-313b-4eb0-8366-83107434c9c9" containerName="discovery"
Jul 15 20:56:19.788937 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.788919    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.793649 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.793628    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 20:56:19.793915 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.793899    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 20:56:19.794289 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.794270    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 20:56:19.794919 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.794903    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vb2db\""
Jul 15 20:56:19.795539 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.795163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 20:56:19.805376 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.805343    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"]
Jul 15 20:56:19.805717 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.805694    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm6t2\" (UniqueName: \"kubernetes.io/projected/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-kube-api-access-tm6t2\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.805804 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.805776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.805864 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.805846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.906619 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.906583    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm6t2\" (UniqueName: \"kubernetes.io/projected/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-kube-api-access-tm6t2\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.906803 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.906645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.906803 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.906678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.907319 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.907301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.909045 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.909013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:19.916407 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:19.916379    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm6t2\" (UniqueName: \"kubernetes.io/projected/4d98ea0e-a97d-47c0-89df-9af0fcce7be6-kube-api-access-tm6t2\") pod \"kuadrant-console-plugin-66b5774985-ssr8j\" (UID: \"4d98ea0e-a97d-47c0-89df-9af0fcce7be6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:20.097645 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:20.097545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"
Jul 15 20:56:20.237401 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:20.237375    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j"]
Jul 15 20:56:20.239733 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:56:20.239706    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d98ea0e_a97d_47c0_89df_9af0fcce7be6.slice/crio-b65aa6cbd585c76c9653580aaed0813001acde5898c5d90de9c212794a44b6d9 WatchSource:0}: Error finding container b65aa6cbd585c76c9653580aaed0813001acde5898c5d90de9c212794a44b6d9: Status 404 returned error can't find the container with id b65aa6cbd585c76c9653580aaed0813001acde5898c5d90de9c212794a44b6d9
Jul 15 20:56:20.281591 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:20.281551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j" event={"ID":"4d98ea0e-a97d-47c0-89df-9af0fcce7be6","Type":"ContainerStarted","Data":"b65aa6cbd585c76c9653580aaed0813001acde5898c5d90de9c212794a44b6d9"}
Jul 15 20:56:35.566844 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:35.566799    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-797bccb74d-4t4ms" podUID="6e553c0c-e970-491c-a6a2-ed94682886c9" containerName="console" containerID="cri-o://89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f" gracePeriod=15
Jul 15 20:56:41.606584 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.606550    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:56:41.708165 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708087    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srsqv\" (UniqueName: \"kubernetes.io/projected/6e553c0c-e970-491c-a6a2-ed94682886c9-kube-api-access-srsqv\") pod \"6e553c0c-e970-491c-a6a2-ed94682886c9\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") "
Jul 15 20:56:41.708165 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708133    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-serving-cert\") pod \"6e553c0c-e970-491c-a6a2-ed94682886c9\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") "
Jul 15 20:56:41.708165 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708160    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-service-ca\") pod \"6e553c0c-e970-491c-a6a2-ed94682886c9\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") "
Jul 15 20:56:41.708452 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708184    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-trusted-ca-bundle\") pod \"6e553c0c-e970-491c-a6a2-ed94682886c9\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") "
Jul 15 20:56:41.708452 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708241    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-oauth-serving-cert\") pod \"6e553c0c-e970-491c-a6a2-ed94682886c9\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") "
Jul 15 20:56:41.708452 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-oauth-config\") pod \"6e553c0c-e970-491c-a6a2-ed94682886c9\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") "
Jul 15 20:56:41.708452 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708318    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-console-config\") pod \"6e553c0c-e970-491c-a6a2-ed94682886c9\" (UID: \"6e553c0c-e970-491c-a6a2-ed94682886c9\") "
Jul 15 20:56:41.708668 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708562    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-service-ca" (OuterVolumeSpecName: "service-ca") pod "6e553c0c-e970-491c-a6a2-ed94682886c9" (UID: "6e553c0c-e970-491c-a6a2-ed94682886c9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:56:41.708668 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708639    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6e553c0c-e970-491c-a6a2-ed94682886c9" (UID: "6e553c0c-e970-491c-a6a2-ed94682886c9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:56:41.708770 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708663    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6e553c0c-e970-491c-a6a2-ed94682886c9" (UID: "6e553c0c-e970-491c-a6a2-ed94682886c9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:56:41.708898 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.708879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-console-config" (OuterVolumeSpecName: "console-config") pod "6e553c0c-e970-491c-a6a2-ed94682886c9" (UID: "6e553c0c-e970-491c-a6a2-ed94682886c9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 20:56:41.710485 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.710405    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e553c0c-e970-491c-a6a2-ed94682886c9-kube-api-access-srsqv" (OuterVolumeSpecName: "kube-api-access-srsqv") pod "6e553c0c-e970-491c-a6a2-ed94682886c9" (UID: "6e553c0c-e970-491c-a6a2-ed94682886c9"). InnerVolumeSpecName "kube-api-access-srsqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:56:41.710637 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.710619    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6e553c0c-e970-491c-a6a2-ed94682886c9" (UID: "6e553c0c-e970-491c-a6a2-ed94682886c9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:56:41.710718 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.710703    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6e553c0c-e970-491c-a6a2-ed94682886c9" (UID: "6e553c0c-e970-491c-a6a2-ed94682886c9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 20:56:41.809731 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.809696    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srsqv\" (UniqueName: \"kubernetes.io/projected/6e553c0c-e970-491c-a6a2-ed94682886c9-kube-api-access-srsqv\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:56:41.809731 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.809724    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-serving-cert\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:56:41.809731 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.809734    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-service-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:56:41.809951 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.809743    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-trusted-ca-bundle\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:56:41.809951 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.809752    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-oauth-serving-cert\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:56:41.809951 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.809761    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6e553c0c-e970-491c-a6a2-ed94682886c9-console-oauth-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:56:41.809951 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:41.809769    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6e553c0c-e970-491c-a6a2-ed94682886c9-console-config\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:56:42.394766 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.394734    2565 generic.go:356] "Generic (PLEG): container finished" podID="6e553c0c-e970-491c-a6a2-ed94682886c9" containerID="89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f" exitCode=0
Jul 15 20:56:42.394949 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.394779    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-797bccb74d-4t4ms"
Jul 15 20:56:42.394949 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.394823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797bccb74d-4t4ms" event={"ID":"6e553c0c-e970-491c-a6a2-ed94682886c9","Type":"ContainerDied","Data":"89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f"}
Jul 15 20:56:42.394949 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.394869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-797bccb74d-4t4ms" event={"ID":"6e553c0c-e970-491c-a6a2-ed94682886c9","Type":"ContainerDied","Data":"76c4b4337e2c9649c9cffb95064f3e57b70564a18c5b367690da8292a511a835"}
Jul 15 20:56:42.394949 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.394895    2565 scope.go:117] "RemoveContainer" containerID="89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f"
Jul 15 20:56:42.396346 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.396321    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j" event={"ID":"4d98ea0e-a97d-47c0-89df-9af0fcce7be6","Type":"ContainerStarted","Data":"714c74c63feff87247ccf2e0d0351dd0fb9dec4dc60c127a670a861a97211b5f"}
Jul 15 20:56:42.403454 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.403432    2565 scope.go:117] "RemoveContainer" containerID="89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f"
Jul 15 20:56:42.403720 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:56:42.403700    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f\": container with ID starting with 89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f not found: ID does not exist" containerID="89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f"
Jul 15 20:56:42.403786 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.403729    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f"} err="failed to get container status \"89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f\": rpc error: code = NotFound desc = could not find container \"89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f\": container with ID starting with 89a4449747916e4e25045d3ea189cbcf2ca4af26efc48a9bd25095a89406263f not found: ID does not exist"
Jul 15 20:56:42.421119 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.421060    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ssr8j" podStartSLOduration=2.031205265 podStartE2EDuration="23.421038788s" totalImagesPullingTime="21.389833523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:56:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:56:42.420040671 +0000 UTC m=+535.869392306" watchObservedRunningTime="2026-07-15 20:56:42.421038788 +0000 UTC m=+535.870390421"
Jul 15 20:56:42.436853 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.436809    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-797bccb74d-4t4ms"]
Jul 15 20:56:42.444370 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:42.444339    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-797bccb74d-4t4ms"]
Jul 15 20:56:43.141807 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:56:43.141778    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e553c0c-e970-491c-a6a2-ed94682886c9" path="/var/lib/kubelet/pods/6e553c0c-e970-491c-a6a2-ed94682886c9/volumes"
Jul 15 20:57:04.207697 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.207655    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:57:04.208271 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.208139    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e553c0c-e970-491c-a6a2-ed94682886c9" containerName="console"
Jul 15 20:57:04.208271 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.208157    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e553c0c-e970-491c-a6a2-ed94682886c9" containerName="console"
Jul 15 20:57:04.208271 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.208258    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e553c0c-e970-491c-a6a2-ed94682886c9" containerName="console"
Jul 15 20:57:04.235190 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.235158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:57:04.235358 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.235299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:04.237755 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.237727    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 20:57:04.237957 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.237937    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:57:04.399987 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.399949    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e309234c-4a8c-4ec3-9378-55c56ef80c07-config-file\") pod \"limitador-limitador-54d6d988d5-td5md\" (UID: \"e309234c-4a8c-4ec3-9378-55c56ef80c07\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:04.400189 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.399996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdhlm\" (UniqueName: \"kubernetes.io/projected/e309234c-4a8c-4ec3-9378-55c56ef80c07-kube-api-access-tdhlm\") pod \"limitador-limitador-54d6d988d5-td5md\" (UID: \"e309234c-4a8c-4ec3-9378-55c56ef80c07\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:04.500841 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.500801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e309234c-4a8c-4ec3-9378-55c56ef80c07-config-file\") pod \"limitador-limitador-54d6d988d5-td5md\" (UID: \"e309234c-4a8c-4ec3-9378-55c56ef80c07\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:04.501058 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.500850    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdhlm\" (UniqueName: \"kubernetes.io/projected/e309234c-4a8c-4ec3-9378-55c56ef80c07-kube-api-access-tdhlm\") pod \"limitador-limitador-54d6d988d5-td5md\" (UID: \"e309234c-4a8c-4ec3-9378-55c56ef80c07\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:04.501413 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.501392    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e309234c-4a8c-4ec3-9378-55c56ef80c07-config-file\") pod \"limitador-limitador-54d6d988d5-td5md\" (UID: \"e309234c-4a8c-4ec3-9378-55c56ef80c07\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:04.508578 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.508556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdhlm\" (UniqueName: \"kubernetes.io/projected/e309234c-4a8c-4ec3-9378-55c56ef80c07-kube-api-access-tdhlm\") pod \"limitador-limitador-54d6d988d5-td5md\" (UID: \"e309234c-4a8c-4ec3-9378-55c56ef80c07\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:04.545090 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.545047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:04.595756 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.595721    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-t64x9"]
Jul 15 20:57:04.602854 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.602823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t64x9"
Jul 15 20:57:04.606333 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.606309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t77zk\""
Jul 15 20:57:04.609040 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.608525    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t64x9"]
Jul 15 20:57:04.693361 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.693327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:57:04.696704 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:57:04.696676    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode309234c_4a8c_4ec3_9378_55c56ef80c07.slice/crio-e60723c7da7d28cde9f2777a290f069d8f1ad94a5ecc81e10d0d9f56c6c27d3f WatchSource:0}: Error finding container e60723c7da7d28cde9f2777a290f069d8f1ad94a5ecc81e10d0d9f56c6c27d3f: Status 404 returned error can't find the container with id e60723c7da7d28cde9f2777a290f069d8f1ad94a5ecc81e10d0d9f56c6c27d3f
Jul 15 20:57:04.703731 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.703699    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76hm7\" (UniqueName: \"kubernetes.io/projected/a9929e48-8d31-4272-8772-91c2160b1df2-kube-api-access-76hm7\") pod \"authorino-58cd955675-t64x9\" (UID: \"a9929e48-8d31-4272-8772-91c2160b1df2\") " pod="kuadrant-system/authorino-58cd955675-t64x9"
Jul 15 20:57:04.786373 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.786297    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fw5wd"]
Jul 15 20:57:04.792945 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.792923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fw5wd"
Jul 15 20:57:04.798077 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.798038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fw5wd"]
Jul 15 20:57:04.804054 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.804028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76hm7\" (UniqueName: \"kubernetes.io/projected/a9929e48-8d31-4272-8772-91c2160b1df2-kube-api-access-76hm7\") pod \"authorino-58cd955675-t64x9\" (UID: \"a9929e48-8d31-4272-8772-91c2160b1df2\") " pod="kuadrant-system/authorino-58cd955675-t64x9"
Jul 15 20:57:04.814268 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.814243    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76hm7\" (UniqueName: \"kubernetes.io/projected/a9929e48-8d31-4272-8772-91c2160b1df2-kube-api-access-76hm7\") pod \"authorino-58cd955675-t64x9\" (UID: \"a9929e48-8d31-4272-8772-91c2160b1df2\") " pod="kuadrant-system/authorino-58cd955675-t64x9"
Jul 15 20:57:04.904491 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.904447    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7dtw\" (UniqueName: \"kubernetes.io/projected/c9198e09-f2c2-4d4f-aed4-05764cecc889-kube-api-access-t7dtw\") pod \"authorino-75d556bd77-fw5wd\" (UID: \"c9198e09-f2c2-4d4f-aed4-05764cecc889\") " pod="kuadrant-system/authorino-75d556bd77-fw5wd"
Jul 15 20:57:04.915531 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:04.915505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t64x9"
Jul 15 20:57:05.005741 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:05.005705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7dtw\" (UniqueName: \"kubernetes.io/projected/c9198e09-f2c2-4d4f-aed4-05764cecc889-kube-api-access-t7dtw\") pod \"authorino-75d556bd77-fw5wd\" (UID: \"c9198e09-f2c2-4d4f-aed4-05764cecc889\") " pod="kuadrant-system/authorino-75d556bd77-fw5wd"
Jul 15 20:57:05.015932 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:05.015901    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7dtw\" (UniqueName: \"kubernetes.io/projected/c9198e09-f2c2-4d4f-aed4-05764cecc889-kube-api-access-t7dtw\") pod \"authorino-75d556bd77-fw5wd\" (UID: \"c9198e09-f2c2-4d4f-aed4-05764cecc889\") " pod="kuadrant-system/authorino-75d556bd77-fw5wd"
Jul 15 20:57:05.064455 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:05.064402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-t64x9"]
Jul 15 20:57:05.065566 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:57:05.065539    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9929e48_8d31_4272_8772_91c2160b1df2.slice/crio-eb293ac6b05fc6ca210ec66592c0c75572efc4809c199939eb67debac3002369 WatchSource:0}: Error finding container eb293ac6b05fc6ca210ec66592c0c75572efc4809c199939eb67debac3002369: Status 404 returned error can't find the container with id eb293ac6b05fc6ca210ec66592c0c75572efc4809c199939eb67debac3002369
Jul 15 20:57:05.103928 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:05.103891    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fw5wd"
Jul 15 20:57:05.284856 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:05.284789    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fw5wd"]
Jul 15 20:57:05.289193 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:57:05.289160    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9198e09_f2c2_4d4f_aed4_05764cecc889.slice/crio-b2c565c3bb6aa3f90c753ad346eabeeeef7bc65f4b5a6a2829717edb7fd849d7 WatchSource:0}: Error finding container b2c565c3bb6aa3f90c753ad346eabeeeef7bc65f4b5a6a2829717edb7fd849d7: Status 404 returned error can't find the container with id b2c565c3bb6aa3f90c753ad346eabeeeef7bc65f4b5a6a2829717edb7fd849d7
Jul 15 20:57:05.498906 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:05.498866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fw5wd" event={"ID":"c9198e09-f2c2-4d4f-aed4-05764cecc889","Type":"ContainerStarted","Data":"b2c565c3bb6aa3f90c753ad346eabeeeef7bc65f4b5a6a2829717edb7fd849d7"}
Jul 15 20:57:05.500780 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:05.500751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t64x9" event={"ID":"a9929e48-8d31-4272-8772-91c2160b1df2","Type":"ContainerStarted","Data":"eb293ac6b05fc6ca210ec66592c0c75572efc4809c199939eb67debac3002369"}
Jul 15 20:57:05.503752 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:05.503714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md" event={"ID":"e309234c-4a8c-4ec3-9378-55c56ef80c07","Type":"ContainerStarted","Data":"e60723c7da7d28cde9f2777a290f069d8f1ad94a5ecc81e10d0d9f56c6c27d3f"}
Jul 15 20:57:10.532646 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:10.532605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md" event={"ID":"e309234c-4a8c-4ec3-9378-55c56ef80c07","Type":"ContainerStarted","Data":"f8a42f186dbdd378ea97864e8f2ab3cb94b6b7579970c06f9f9f9427c1850ad6"}
Jul 15 20:57:10.533140 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:10.532798    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:10.534096 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:10.534073    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fw5wd" event={"ID":"c9198e09-f2c2-4d4f-aed4-05764cecc889","Type":"ContainerStarted","Data":"7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392"}
Jul 15 20:57:10.535373 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:10.535354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t64x9" event={"ID":"a9929e48-8d31-4272-8772-91c2160b1df2","Type":"ContainerStarted","Data":"69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689"}
Jul 15 20:57:10.551754 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:10.551711    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md" podStartSLOduration=1.340237775 podStartE2EDuration="6.551696281s" totalImagesPullingTime="5.211458506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:57:10.549989282 +0000 UTC m=+563.999340945" watchObservedRunningTime="2026-07-15 20:57:10.551696281 +0000 UTC m=+564.001047914"
Jul 15 20:57:10.564534 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:10.564484    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fw5wd" podStartSLOduration=1.9998135989999999 podStartE2EDuration="6.564467737s" totalImagesPullingTime="4.564654138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:57:10.564092301 +0000 UTC m=+564.013443934" watchObservedRunningTime="2026-07-15 20:57:10.564467737 +0000 UTC m=+564.013819370"
Jul 15 20:57:10.579115 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:10.579069    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-t64x9" podStartSLOduration=1.746799129 podStartE2EDuration="6.579052174s" totalImagesPullingTime="4.832253045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:57:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:57:10.5772063 +0000 UTC m=+564.026557933" watchObservedRunningTime="2026-07-15 20:57:10.579052174 +0000 UTC m=+564.028403806"
Jul 15 20:57:10.604162 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:10.604129    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t64x9"]
Jul 15 20:57:12.544148 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:12.544109    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-t64x9" podUID="a9929e48-8d31-4272-8772-91c2160b1df2" containerName="authorino" containerID="cri-o://69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689" gracePeriod=30
Jul 15 20:57:12.820225 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:12.820136    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t64x9"
Jul 15 20:57:12.865249 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:12.865217    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76hm7\" (UniqueName: \"kubernetes.io/projected/a9929e48-8d31-4272-8772-91c2160b1df2-kube-api-access-76hm7\") pod \"a9929e48-8d31-4272-8772-91c2160b1df2\" (UID: \"a9929e48-8d31-4272-8772-91c2160b1df2\") "
Jul 15 20:57:12.867465 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:12.867405    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9929e48-8d31-4272-8772-91c2160b1df2-kube-api-access-76hm7" (OuterVolumeSpecName: "kube-api-access-76hm7") pod "a9929e48-8d31-4272-8772-91c2160b1df2" (UID: "a9929e48-8d31-4272-8772-91c2160b1df2"). InnerVolumeSpecName "kube-api-access-76hm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:57:12.965833 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:12.965799    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76hm7\" (UniqueName: \"kubernetes.io/projected/a9929e48-8d31-4272-8772-91c2160b1df2-kube-api-access-76hm7\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:57:13.554313 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.554275    2565 generic.go:356] "Generic (PLEG): container finished" podID="a9929e48-8d31-4272-8772-91c2160b1df2" containerID="69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689" exitCode=0
Jul 15 20:57:13.554789 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.554327    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-t64x9"
Jul 15 20:57:13.554789 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.554361    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t64x9" event={"ID":"a9929e48-8d31-4272-8772-91c2160b1df2","Type":"ContainerDied","Data":"69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689"}
Jul 15 20:57:13.554789 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.554403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-t64x9" event={"ID":"a9929e48-8d31-4272-8772-91c2160b1df2","Type":"ContainerDied","Data":"eb293ac6b05fc6ca210ec66592c0c75572efc4809c199939eb67debac3002369"}
Jul 15 20:57:13.554789 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.554432    2565 scope.go:117] "RemoveContainer" containerID="69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689"
Jul 15 20:57:13.563016 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.562998    2565 scope.go:117] "RemoveContainer" containerID="69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689"
Jul 15 20:57:13.563314 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:57:13.563293    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689\": container with ID starting with 69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689 not found: ID does not exist" containerID="69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689"
Jul 15 20:57:13.563383 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.563323    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689"} err="failed to get container status \"69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689\": rpc error: code = NotFound desc = could not find container \"69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689\": container with ID starting with 69930586d43038fcd4ec2ee4d03256dc6d3ee5eef0100001db052e37a9c53689 not found: ID does not exist"
Jul 15 20:57:13.569932 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.569874    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-t64x9"]
Jul 15 20:57:13.571859 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:13.571827    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-t64x9"]
Jul 15 20:57:15.142467 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:15.142434    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9929e48-8d31-4272-8772-91c2160b1df2" path="/var/lib/kubelet/pods/a9929e48-8d31-4272-8772-91c2160b1df2/volumes"
Jul 15 20:57:21.541179 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:21.541151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-td5md"
Jul 15 20:57:38.534331 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.534295    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4sznl"]
Jul 15 20:57:38.534716 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.534647    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9929e48-8d31-4272-8772-91c2160b1df2" containerName="authorino"
Jul 15 20:57:38.534716 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.534659    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9929e48-8d31-4272-8772-91c2160b1df2" containerName="authorino"
Jul 15 20:57:38.534716 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.534710    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9929e48-8d31-4272-8772-91c2160b1df2" containerName="authorino"
Jul 15 20:57:38.544631 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.544605    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4sznl"
Jul 15 20:57:38.576043 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.576003    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4sznl"]
Jul 15 20:57:38.689011 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.688968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggw6x\" (UniqueName: \"kubernetes.io/projected/d37a1116-90a2-407a-a1a5-c651af5c423b-kube-api-access-ggw6x\") pod \"authorino-5d4b67c446-4sznl\" (UID: \"d37a1116-90a2-407a-a1a5-c651af5c423b\") " pod="kuadrant-system/authorino-5d4b67c446-4sznl"
Jul 15 20:57:38.769515 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.769482    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4sznl"]
Jul 15 20:57:38.769750 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:57:38.769731    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ggw6x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-4sznl" podUID="d37a1116-90a2-407a-a1a5-c651af5c423b"
Jul 15 20:57:38.790300 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.790212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggw6x\" (UniqueName: \"kubernetes.io/projected/d37a1116-90a2-407a-a1a5-c651af5c423b-kube-api-access-ggw6x\") pod \"authorino-5d4b67c446-4sznl\" (UID: \"d37a1116-90a2-407a-a1a5-c651af5c423b\") " pod="kuadrant-system/authorino-5d4b67c446-4sznl"
Jul 15 20:57:38.798507 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.798476    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-959f789c9-dfvr9"]
Jul 15 20:57:38.801843 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.801818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-959f789c9-dfvr9"
Jul 15 20:57:38.803988 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.803965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggw6x\" (UniqueName: \"kubernetes.io/projected/d37a1116-90a2-407a-a1a5-c651af5c423b-kube-api-access-ggw6x\") pod \"authorino-5d4b67c446-4sznl\" (UID: \"d37a1116-90a2-407a-a1a5-c651af5c423b\") " pod="kuadrant-system/authorino-5d4b67c446-4sznl"
Jul 15 20:57:38.810188 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.810160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-959f789c9-dfvr9"]
Jul 15 20:57:38.891640 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.891592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfktm\" (UniqueName: \"kubernetes.io/projected/bc52c212-3865-4c56-bbf6-405e5652c9f6-kube-api-access-lfktm\") pod \"authorino-959f789c9-dfvr9\" (UID: \"bc52c212-3865-4c56-bbf6-405e5652c9f6\") " pod="kuadrant-system/authorino-959f789c9-dfvr9"
Jul 15 20:57:38.958021 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.957986    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-959f789c9-dfvr9"]
Jul 15 20:57:38.958266 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:57:38.958246    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lfktm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-959f789c9-dfvr9" podUID="bc52c212-3865-4c56-bbf6-405e5652c9f6"
Jul 15 20:57:38.986236 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.986201    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69f955c55-mccpf"]
Jul 15 20:57:38.989539 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.989519    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 20:57:38.991880 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.991858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 20:57:38.992031 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.992010    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfktm\" (UniqueName: \"kubernetes.io/projected/bc52c212-3865-4c56-bbf6-405e5652c9f6-kube-api-access-lfktm\") pod \"authorino-959f789c9-dfvr9\" (UID: \"bc52c212-3865-4c56-bbf6-405e5652c9f6\") " pod="kuadrant-system/authorino-959f789c9-dfvr9"
Jul 15 20:57:38.997928 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:38.997902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69f955c55-mccpf"]
Jul 15 20:57:39.001637 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.001606    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfktm\" (UniqueName: \"kubernetes.io/projected/bc52c212-3865-4c56-bbf6-405e5652c9f6-kube-api-access-lfktm\") pod \"authorino-959f789c9-dfvr9\" (UID: \"bc52c212-3865-4c56-bbf6-405e5652c9f6\") " pod="kuadrant-system/authorino-959f789c9-dfvr9"
Jul 15 20:57:39.093064 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.092971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e475f5a6-a6bf-4283-b76c-1a7a390a2343-tls-cert\") pod \"authorino-69f955c55-mccpf\" (UID: \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\") " pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 20:57:39.093064 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.093038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xndst\" (UniqueName: \"kubernetes.io/projected/e475f5a6-a6bf-4283-b76c-1a7a390a2343-kube-api-access-xndst\") pod \"authorino-69f955c55-mccpf\" (UID: \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\") " pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 20:57:39.194339 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.194300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e475f5a6-a6bf-4283-b76c-1a7a390a2343-tls-cert\") pod \"authorino-69f955c55-mccpf\" (UID: \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\") " pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 20:57:39.194530 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.194368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xndst\" (UniqueName: \"kubernetes.io/projected/e475f5a6-a6bf-4283-b76c-1a7a390a2343-kube-api-access-xndst\") pod \"authorino-69f955c55-mccpf\" (UID: \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\") " pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 20:57:39.196843 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.196825    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e475f5a6-a6bf-4283-b76c-1a7a390a2343-tls-cert\") pod \"authorino-69f955c55-mccpf\" (UID: \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\") " pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 20:57:39.202286 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.202262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xndst\" (UniqueName: \"kubernetes.io/projected/e475f5a6-a6bf-4283-b76c-1a7a390a2343-kube-api-access-xndst\") pod \"authorino-69f955c55-mccpf\" (UID: \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\") " pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 20:57:39.299085 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.299045    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 20:57:39.435779 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.435743    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69f955c55-mccpf"]
Jul 15 20:57:39.439225 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:57:39.439199    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode475f5a6_a6bf_4283_b76c_1a7a390a2343.slice/crio-a5f6478e9a1fbbc2402dcb3e94aabcccbed897fcc7d965378a3df2789ca42be5 WatchSource:0}: Error finding container a5f6478e9a1fbbc2402dcb3e94aabcccbed897fcc7d965378a3df2789ca42be5: Status 404 returned error can't find the container with id a5f6478e9a1fbbc2402dcb3e94aabcccbed897fcc7d965378a3df2789ca42be5
Jul 15 20:57:39.674328 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.674261    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-959f789c9-dfvr9"
Jul 15 20:57:39.674328 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.674279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69f955c55-mccpf" event={"ID":"e475f5a6-a6bf-4283-b76c-1a7a390a2343","Type":"ContainerStarted","Data":"a5f6478e9a1fbbc2402dcb3e94aabcccbed897fcc7d965378a3df2789ca42be5"}
Jul 15 20:57:39.674774 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.674456    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4sznl"
Jul 15 20:57:39.687043 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.687012    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-959f789c9-dfvr9"
Jul 15 20:57:39.690973 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.690947    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4sznl"
Jul 15 20:57:39.799479 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.799439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfktm\" (UniqueName: \"kubernetes.io/projected/bc52c212-3865-4c56-bbf6-405e5652c9f6-kube-api-access-lfktm\") pod \"bc52c212-3865-4c56-bbf6-405e5652c9f6\" (UID: \"bc52c212-3865-4c56-bbf6-405e5652c9f6\") "
Jul 15 20:57:39.799669 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.799520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggw6x\" (UniqueName: \"kubernetes.io/projected/d37a1116-90a2-407a-a1a5-c651af5c423b-kube-api-access-ggw6x\") pod \"d37a1116-90a2-407a-a1a5-c651af5c423b\" (UID: \"d37a1116-90a2-407a-a1a5-c651af5c423b\") "
Jul 15 20:57:39.801614 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.801586    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc52c212-3865-4c56-bbf6-405e5652c9f6-kube-api-access-lfktm" (OuterVolumeSpecName: "kube-api-access-lfktm") pod "bc52c212-3865-4c56-bbf6-405e5652c9f6" (UID: "bc52c212-3865-4c56-bbf6-405e5652c9f6"). InnerVolumeSpecName "kube-api-access-lfktm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:57:39.801614 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.801600    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37a1116-90a2-407a-a1a5-c651af5c423b-kube-api-access-ggw6x" (OuterVolumeSpecName: "kube-api-access-ggw6x") pod "d37a1116-90a2-407a-a1a5-c651af5c423b" (UID: "d37a1116-90a2-407a-a1a5-c651af5c423b"). InnerVolumeSpecName "kube-api-access-ggw6x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:57:39.900958 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.900924    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfktm\" (UniqueName: \"kubernetes.io/projected/bc52c212-3865-4c56-bbf6-405e5652c9f6-kube-api-access-lfktm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:57:39.900958 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:39.900953    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggw6x\" (UniqueName: \"kubernetes.io/projected/d37a1116-90a2-407a-a1a5-c651af5c423b-kube-api-access-ggw6x\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:57:40.679840 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.679798    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69f955c55-mccpf" event={"ID":"e475f5a6-a6bf-4283-b76c-1a7a390a2343","Type":"ContainerStarted","Data":"8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df"}
Jul 15 20:57:40.679840 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.679832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-959f789c9-dfvr9"
Jul 15 20:57:40.679840 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.679819    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4sznl"
Jul 15 20:57:40.699005 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.698961    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69f955c55-mccpf" podStartSLOduration=2.105103197 podStartE2EDuration="2.698941833s" totalImagesPullingTime="593.838636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 20:57:40.698909015 +0000 UTC m=+594.148260657" watchObservedRunningTime="2026-07-15 20:57:40.698941833 +0000 UTC m=+594.148293465"
Jul 15 20:57:40.732578 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.732544    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fw5wd"]
Jul 15 20:57:40.732761 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.732723    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fw5wd" podUID="c9198e09-f2c2-4d4f-aed4-05764cecc889" containerName="authorino" containerID="cri-o://7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392" gracePeriod=30
Jul 15 20:57:40.738978 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.738952    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-959f789c9-dfvr9"]
Jul 15 20:57:40.756629 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.756597    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-959f789c9-dfvr9"]
Jul 15 20:57:40.779155 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.779117    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4sznl"]
Jul 15 20:57:40.783491 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.783468    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4sznl"]
Jul 15 20:57:40.995504 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:40.995469    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fw5wd"
Jul 15 20:57:41.113347 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.113307    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7dtw\" (UniqueName: \"kubernetes.io/projected/c9198e09-f2c2-4d4f-aed4-05764cecc889-kube-api-access-t7dtw\") pod \"c9198e09-f2c2-4d4f-aed4-05764cecc889\" (UID: \"c9198e09-f2c2-4d4f-aed4-05764cecc889\") "
Jul 15 20:57:41.115371 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.115340    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9198e09-f2c2-4d4f-aed4-05764cecc889-kube-api-access-t7dtw" (OuterVolumeSpecName: "kube-api-access-t7dtw") pod "c9198e09-f2c2-4d4f-aed4-05764cecc889" (UID: "c9198e09-f2c2-4d4f-aed4-05764cecc889"). InnerVolumeSpecName "kube-api-access-t7dtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 20:57:41.142324 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.142299    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc52c212-3865-4c56-bbf6-405e5652c9f6" path="/var/lib/kubelet/pods/bc52c212-3865-4c56-bbf6-405e5652c9f6/volumes"
Jul 15 20:57:41.142542 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.142530    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37a1116-90a2-407a-a1a5-c651af5c423b" path="/var/lib/kubelet/pods/d37a1116-90a2-407a-a1a5-c651af5c423b/volumes"
Jul 15 20:57:41.214839 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.214797    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7dtw\" (UniqueName: \"kubernetes.io/projected/c9198e09-f2c2-4d4f-aed4-05764cecc889-kube-api-access-t7dtw\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 20:57:41.685067 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.685028    2565 generic.go:356] "Generic (PLEG): container finished" podID="c9198e09-f2c2-4d4f-aed4-05764cecc889" containerID="7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392" exitCode=0
Jul 15 20:57:41.685067 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.685072    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fw5wd"
Jul 15 20:57:41.685713 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.685108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fw5wd" event={"ID":"c9198e09-f2c2-4d4f-aed4-05764cecc889","Type":"ContainerDied","Data":"7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392"}
Jul 15 20:57:41.685713 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.685151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fw5wd" event={"ID":"c9198e09-f2c2-4d4f-aed4-05764cecc889","Type":"ContainerDied","Data":"b2c565c3bb6aa3f90c753ad346eabeeeef7bc65f4b5a6a2829717edb7fd849d7"}
Jul 15 20:57:41.685713 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.685169    2565 scope.go:117] "RemoveContainer" containerID="7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392"
Jul 15 20:57:41.693065 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.693036    2565 scope.go:117] "RemoveContainer" containerID="7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392"
Jul 15 20:57:41.693341 ip-10-0-140-96 kubenswrapper[2565]: E0715 20:57:41.693319    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392\": container with ID starting with 7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392 not found: ID does not exist" containerID="7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392"
Jul 15 20:57:41.693434 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.693347    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392"} err="failed to get container status \"7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392\": rpc error: code = NotFound desc = could not find container \"7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392\": container with ID starting with 7c95bba2e2dda849a7c1bb634466045fd36adabaf123dec263803e7375c7c392 not found: ID does not exist"
Jul 15 20:57:41.708979 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.708948    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fw5wd"]
Jul 15 20:57:41.713473 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:41.713451    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fw5wd"]
Jul 15 20:57:43.142267 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:43.142238    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9198e09-f2c2-4d4f-aed4-05764cecc889" path="/var/lib/kubelet/pods/c9198e09-f2c2-4d4f-aed4-05764cecc889/volumes"
Jul 15 20:57:46.993312 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:46.993288    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:57:46.994589 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:57:46.994570    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 20:58:23.163565 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:58:23.163531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:58:46.851060 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:58:46.851020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:59:03.251171 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:03.251132    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:59:25.149094 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:25.149057    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:59:35.043277 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:35.043242    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:59:53.842925 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:53.842843    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 20:59:59.337945 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.337905    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"]
Jul 15 20:59:59.338329 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.338273    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9198e09-f2c2-4d4f-aed4-05764cecc889" containerName="authorino"
Jul 15 20:59:59.338329 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.338288    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9198e09-f2c2-4d4f-aed4-05764cecc889" containerName="authorino"
Jul 15 20:59:59.338407 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.338371    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9198e09-f2c2-4d4f-aed4-05764cecc889" containerName="authorino"
Jul 15 20:59:59.341137 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.341120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.343761 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.343741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4f6jp\""
Jul 15 20:59:59.344581 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.344558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 20:59:59.344703 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.344689    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 20:59:59.344796 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.344777    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 20:59:59.355301 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.355272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"]
Jul 15 20:59:59.415892 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.415844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.415892 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.415906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79cac8ab-f692-4383-a0e6-4c1c44a14695-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.416110 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.415994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.416110 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.416045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.416110 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.416101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.416381 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.416154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4552k\" (UniqueName: \"kubernetes.io/projected/79cac8ab-f692-4383-a0e6-4c1c44a14695-kube-api-access-4552k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517261 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517474 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517279    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517474 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517474 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4552k\" (UniqueName: \"kubernetes.io/projected/79cac8ab-f692-4383-a0e6-4c1c44a14695-kube-api-access-4552k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517474 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517474 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79cac8ab-f692-4383-a0e6-4c1c44a14695-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517730 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517779 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517736    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.517865 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.517842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.519589 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.519567    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79cac8ab-f692-4383-a0e6-4c1c44a14695-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.519715 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.519699    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79cac8ab-f692-4383-a0e6-4c1c44a14695-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.533160 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.533134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4552k\" (UniqueName: \"kubernetes.io/projected/79cac8ab-f692-4383-a0e6-4c1c44a14695-kube-api-access-4552k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs\" (UID: \"79cac8ab-f692-4383-a0e6-4c1c44a14695\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.656613 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.656527    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 20:59:59.796008 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.795846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"]
Jul 15 20:59:59.798636 ip-10-0-140-96 kubenswrapper[2565]: W0715 20:59:59.798609    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79cac8ab_f692_4383_a0e6_4c1c44a14695.slice/crio-d37ac1ccc9dea7b2b5ab68f124fe47b10cced8a85fc9a81fedb6f2c31e04a9ee WatchSource:0}: Error finding container d37ac1ccc9dea7b2b5ab68f124fe47b10cced8a85fc9a81fedb6f2c31e04a9ee: Status 404 returned error can't find the container with id d37ac1ccc9dea7b2b5ab68f124fe47b10cced8a85fc9a81fedb6f2c31e04a9ee
Jul 15 20:59:59.799932 ip-10-0-140-96 kubenswrapper[2565]: I0715 20:59:59.799914    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:00:00.304927 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:00:00.304878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs" event={"ID":"79cac8ab-f692-4383-a0e6-4c1c44a14695","Type":"ContainerStarted","Data":"d37ac1ccc9dea7b2b5ab68f124fe47b10cced8a85fc9a81fedb6f2c31e04a9ee"}
Jul 15 21:00:01.312794 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:00:01.312755    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs" event={"ID":"79cac8ab-f692-4383-a0e6-4c1c44a14695","Type":"ContainerStarted","Data":"d55382d2c7dcc40d441a8e2445faf195d1ee03f6cd1ae4b621b906cbc2215f57"}
Jul 15 21:00:01.337316 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:00:01.337262    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs" podStartSLOduration=1.341467921 podStartE2EDuration="2.33724365s" totalImagesPullingTime="995.775729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 20:59:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:00:01.335705027 +0000 UTC m=+734.785056660" watchObservedRunningTime="2026-07-15 21:00:01.33724365 +0000 UTC m=+734.786595281"
Jul 15 21:00:08.050714 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:00:08.050676    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:00:09.657540 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:00:09.657504    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 21:00:09.657931 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:00:09.657552    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 21:00:09.670130 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:00:09.670100    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 21:00:10.363911 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:00:10.363882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs"
Jul 15 21:01:07.738094 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:07.738057    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f94f94478-56s24"]
Jul 15 21:01:07.740298 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:07.740281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f94f94478-56s24"
Jul 15 21:01:07.749664 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:07.749639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f94f94478-56s24"]
Jul 15 21:01:07.910628 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:07.910592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a792295e-8d6d-4648-9871-61493181ff4f-tls-cert\") pod \"authorino-7f94f94478-56s24\" (UID: \"a792295e-8d6d-4648-9871-61493181ff4f\") " pod="kuadrant-system/authorino-7f94f94478-56s24"
Jul 15 21:01:07.910811 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:07.910652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwzjg\" (UniqueName: \"kubernetes.io/projected/a792295e-8d6d-4648-9871-61493181ff4f-kube-api-access-vwzjg\") pod \"authorino-7f94f94478-56s24\" (UID: \"a792295e-8d6d-4648-9871-61493181ff4f\") " pod="kuadrant-system/authorino-7f94f94478-56s24"
Jul 15 21:01:08.011704 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:08.011625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a792295e-8d6d-4648-9871-61493181ff4f-tls-cert\") pod \"authorino-7f94f94478-56s24\" (UID: \"a792295e-8d6d-4648-9871-61493181ff4f\") " pod="kuadrant-system/authorino-7f94f94478-56s24"
Jul 15 21:01:08.011704 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:08.011687    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwzjg\" (UniqueName: \"kubernetes.io/projected/a792295e-8d6d-4648-9871-61493181ff4f-kube-api-access-vwzjg\") pod \"authorino-7f94f94478-56s24\" (UID: \"a792295e-8d6d-4648-9871-61493181ff4f\") " pod="kuadrant-system/authorino-7f94f94478-56s24"
Jul 15 21:01:08.014046 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:08.014015    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a792295e-8d6d-4648-9871-61493181ff4f-tls-cert\") pod \"authorino-7f94f94478-56s24\" (UID: \"a792295e-8d6d-4648-9871-61493181ff4f\") " pod="kuadrant-system/authorino-7f94f94478-56s24"
Jul 15 21:01:08.020463 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:08.020400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwzjg\" (UniqueName: \"kubernetes.io/projected/a792295e-8d6d-4648-9871-61493181ff4f-kube-api-access-vwzjg\") pod \"authorino-7f94f94478-56s24\" (UID: \"a792295e-8d6d-4648-9871-61493181ff4f\") " pod="kuadrant-system/authorino-7f94f94478-56s24"
Jul 15 21:01:08.050372 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:08.050337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f94f94478-56s24"
Jul 15 21:01:08.190997 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:08.190962    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f94f94478-56s24"]
Jul 15 21:01:08.194385 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:01:08.194355    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda792295e_8d6d_4648_9871_61493181ff4f.slice/crio-19daaf46143d1fcc0ee9340979e90d188a392f98598109aabef734af2bdc1ffe WatchSource:0}: Error finding container 19daaf46143d1fcc0ee9340979e90d188a392f98598109aabef734af2bdc1ffe: Status 404 returned error can't find the container with id 19daaf46143d1fcc0ee9340979e90d188a392f98598109aabef734af2bdc1ffe
Jul 15 21:01:08.608608 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:08.608571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f94f94478-56s24" event={"ID":"a792295e-8d6d-4648-9871-61493181ff4f","Type":"ContainerStarted","Data":"19daaf46143d1fcc0ee9340979e90d188a392f98598109aabef734af2bdc1ffe"}
Jul 15 21:01:09.615073 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:09.615027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f94f94478-56s24" event={"ID":"a792295e-8d6d-4648-9871-61493181ff4f","Type":"ContainerStarted","Data":"7bc9c8945ecbd94eab3a50966c547586ee275f5ce2c0a5fddd20ea20a3cb8a4c"}
Jul 15 21:01:09.642435 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:09.642361    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f94f94478-56s24" podStartSLOduration=1.673285764 podStartE2EDuration="2.642338978s" totalImagesPullingTime="969.053214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:01:09.639894196 +0000 UTC m=+803.089245829" watchObservedRunningTime="2026-07-15 21:01:09.642338978 +0000 UTC m=+803.091690611"
Jul 15 21:01:09.679923 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:09.679724    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69f955c55-mccpf"]
Jul 15 21:01:09.680123 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:09.679983    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-69f955c55-mccpf" podUID="e475f5a6-a6bf-4283-b76c-1a7a390a2343" containerName="authorino" containerID="cri-o://8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df" gracePeriod=30
Jul 15 21:01:09.931887 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:09.931860    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 21:01:10.028257 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.028221    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xndst\" (UniqueName: \"kubernetes.io/projected/e475f5a6-a6bf-4283-b76c-1a7a390a2343-kube-api-access-xndst\") pod \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\" (UID: \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\") "
Jul 15 21:01:10.028500 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.028316    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e475f5a6-a6bf-4283-b76c-1a7a390a2343-tls-cert\") pod \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\" (UID: \"e475f5a6-a6bf-4283-b76c-1a7a390a2343\") "
Jul 15 21:01:10.030446 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.030389    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e475f5a6-a6bf-4283-b76c-1a7a390a2343-kube-api-access-xndst" (OuterVolumeSpecName: "kube-api-access-xndst") pod "e475f5a6-a6bf-4283-b76c-1a7a390a2343" (UID: "e475f5a6-a6bf-4283-b76c-1a7a390a2343"). InnerVolumeSpecName "kube-api-access-xndst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:01:10.038401 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.038362    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e475f5a6-a6bf-4283-b76c-1a7a390a2343-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e475f5a6-a6bf-4283-b76c-1a7a390a2343" (UID: "e475f5a6-a6bf-4283-b76c-1a7a390a2343"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:01:10.129349 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.129310    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e475f5a6-a6bf-4283-b76c-1a7a390a2343-tls-cert\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:01:10.129349 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.129342    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xndst\" (UniqueName: \"kubernetes.io/projected/e475f5a6-a6bf-4283-b76c-1a7a390a2343-kube-api-access-xndst\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:01:10.621883 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.621848    2565 generic.go:356] "Generic (PLEG): container finished" podID="e475f5a6-a6bf-4283-b76c-1a7a390a2343" containerID="8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df" exitCode=0
Jul 15 21:01:10.622353 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.621899    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69f955c55-mccpf"
Jul 15 21:01:10.622353 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.621934    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69f955c55-mccpf" event={"ID":"e475f5a6-a6bf-4283-b76c-1a7a390a2343","Type":"ContainerDied","Data":"8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df"}
Jul 15 21:01:10.622353 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.621973    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69f955c55-mccpf" event={"ID":"e475f5a6-a6bf-4283-b76c-1a7a390a2343","Type":"ContainerDied","Data":"a5f6478e9a1fbbc2402dcb3e94aabcccbed897fcc7d965378a3df2789ca42be5"}
Jul 15 21:01:10.622353 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.621990    2565 scope.go:117] "RemoveContainer" containerID="8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df"
Jul 15 21:01:10.631267 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.631241    2565 scope.go:117] "RemoveContainer" containerID="8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df"
Jul 15 21:01:10.632026 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:01:10.632006    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df\": container with ID starting with 8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df not found: ID does not exist" containerID="8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df"
Jul 15 21:01:10.632117 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.632041    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df"} err="failed to get container status \"8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df\": rpc error: code = NotFound desc = could not find container \"8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df\": container with ID starting with 8acf801f182f187ba55197db8a7dad8687b53507516bfbb5a72fd8b1f32301df not found: ID does not exist"
Jul 15 21:01:10.647785 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.647750    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69f955c55-mccpf"]
Jul 15 21:01:10.653584 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:10.653556    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69f955c55-mccpf"]
Jul 15 21:01:11.143252 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:11.143210    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e475f5a6-a6bf-4283-b76c-1a7a390a2343" path="/var/lib/kubelet/pods/e475f5a6-a6bf-4283-b76c-1a7a390a2343/volumes"
Jul 15 21:01:49.211485 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:49.211452    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:01:58.434020 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:01:58.433985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:02:09.040851 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:02:09.040812    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:02:18.545727 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:02:18.545688    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:02:28.139393 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:02:28.139354    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:02:47.020882 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:02:47.020850    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:02:47.021298 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:02:47.021286    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:02:57.442613 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:02:57.442570    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:03:09.536701 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:03:09.536656    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:03:48.435477 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:03:48.435437    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:03:57.738949 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:03:57.738915    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:04:06.551407 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:04:06.551367    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:04:17.742435 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:04:17.742342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:04:28.947704 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:04:28.947668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:04:38.254536 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:04:38.254501    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:04:50.242840 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:04:50.242810    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:05:00.646100 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:05:00.646060    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:05:25.809324 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:05:25.809291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:05:34.738648 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:05:34.738606    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:05:59.707267 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:05:59.707180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:06:10.046565 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:06:10.046526    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:06:25.308864 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:06:25.308824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:06:36.045361 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:06:36.045320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:06:45.144991 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:06:45.144956    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:06:55.941600 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:06:55.941561    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:07:05.955888 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:07:05.955850    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:07:47.052368 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:07:47.052336    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:07:47.053833 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:07:47.053807    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:08:52.844316 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:08:52.844283    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:09:03.054946 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:09:03.054913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:09:13.641214 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:09:13.641176    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:09:25.147031 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:09:25.146998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:09:37.542489 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:09:37.542450    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:09:46.753225 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:09:46.753185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:09:55.444450 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:09:55.444402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:10:06.646454 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:10:06.646398    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:10:16.843504 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:10:16.843410    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:10:26.975524 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:10:26.975488    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:10:37.974948 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:10:37.974904    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:11:02.566124 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:11:02.566092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:11:09.967699 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:11:09.967666    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:11:20.583758 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:11:20.583716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:11:29.940960 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:11:29.940924    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:11:36.845874 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:11:36.845835    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:11:54.161589 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:11:54.161483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:12:02.946791 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:12:02.946754    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:12:12.339377 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:12:12.339340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:12:22.741261 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:12:22.741217    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:12:31.643754 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:12:31.643720    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:12:41.338493 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:12:41.338459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:12:47.078059 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:12:47.078027    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:12:47.081064 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:12:47.081044    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:12:55.740920 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:12:55.740878    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:13:05.082041 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:13:05.082004    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:13:14.339172 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:13:14.339079    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:13:26.939936 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:13:26.939899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:13:36.239302 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:13:36.239258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:13:47.642203 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:13:47.642164    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:13:59.551505 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:13:59.551463    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:14:09.837967 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:14:09.837931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:14:19.142120 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:14:19.142089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:14:27.942232 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:14:27.942196    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:14:36.940732 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:14:36.940687    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:14:58.044071 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:14:58.043991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:15:09.237802 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:15:09.237769    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:16:23.949208 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:16:23.949169    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:16:45.239654 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:16:45.239614    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:17:45.466755 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:17:45.466715    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:17:47.103992 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:17:47.103959    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:17:47.109778 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:17:47.109760    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:17:58.543132 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:17:58.543090    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:19:08.337005 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:19:08.336929    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:19:28.752937 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:19:28.752902    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:20:40.653270 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:20:40.653182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:22:18.136988 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:22:18.136906    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:22:25.851020 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:22:25.850983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:22:34.549082 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:22:34.549050    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:22:46.051009 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:22:46.050973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:22:47.132686 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:22:47.132658    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:22:47.139719 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:22:47.139696    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:23:02.355457 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:23:02.355407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:23:44.243861 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:23:44.243825    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:24:08.634158 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.634118    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"]
Jul 15 21:24:08.636337 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.634482    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e475f5a6-a6bf-4283-b76c-1a7a390a2343" containerName="authorino"
Jul 15 21:24:08.636337 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.634494    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e475f5a6-a6bf-4283-b76c-1a7a390a2343" containerName="authorino"
Jul 15 21:24:08.636337 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.634559    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e475f5a6-a6bf-4283-b76c-1a7a390a2343" containerName="authorino"
Jul 15 21:24:08.637247 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.637232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.640704 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.640684    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-61280292\"/\"openshift-service-ca.crt\""
Jul 15 21:24:08.640856 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.640727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-61280292\"/\"e2e-lifecycle-model-61280292-kserve-self-signed-certs\""
Jul 15 21:24:08.640856 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.640727    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-61280292\"/\"default-dockercfg-fzcn5\""
Jul 15 21:24:08.640856 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.640810    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-61280292\"/\"kube-root-ca.crt\""
Jul 15 21:24:08.649399 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.649376    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"]
Jul 15 21:24:08.713851 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.713813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1597777-b98d-4389-b682-e06cf629e778-tls-certs\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.713851 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.713855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-model-cache\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.714066 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.713877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-home\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.714066 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.713932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-dshm\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.714066 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.713958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd9cr\" (UniqueName: \"kubernetes.io/projected/d1597777-b98d-4389-b682-e06cf629e778-kube-api-access-jd9cr\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.714066 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.714003    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-tmp-dir\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.814753 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.814714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-tmp-dir\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.814938 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.814783    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1597777-b98d-4389-b682-e06cf629e778-tls-certs\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.814938 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.814814    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-model-cache\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.814938 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.814841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-home\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.814938 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.814871    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-dshm\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.814938 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.814895    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd9cr\" (UniqueName: \"kubernetes.io/projected/d1597777-b98d-4389-b682-e06cf629e778-kube-api-access-jd9cr\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.815211 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.815155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-tmp-dir\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.815264 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.815218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-model-cache\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.815304 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.815257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-home\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.817060 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.817036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-dshm\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.817343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.817326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1597777-b98d-4389-b682-e06cf629e778-tls-certs\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.824152 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.824122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd9cr\" (UniqueName: \"kubernetes.io/projected/d1597777-b98d-4389-b682-e06cf629e778-kube-api-access-jd9cr\") pod \"e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") " pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:08.946534 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:08.946411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:09.083949 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:09.083922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"]
Jul 15 21:24:09.086599 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:24:09.086573    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1597777_b98d_4389_b682_e06cf629e778.slice/crio-d659a4853e383987321098ba772e311ce40cf5a29797d31b3e1068877028a1a6 WatchSource:0}: Error finding container d659a4853e383987321098ba772e311ce40cf5a29797d31b3e1068877028a1a6: Status 404 returned error can't find the container with id d659a4853e383987321098ba772e311ce40cf5a29797d31b3e1068877028a1a6
Jul 15 21:24:09.691265 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:09.691227    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5" event={"ID":"d1597777-b98d-4389-b682-e06cf629e778","Type":"ContainerStarted","Data":"bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979"}
Jul 15 21:24:09.691750 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:09.691273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5" event={"ID":"d1597777-b98d-4389-b682-e06cf629e778","Type":"ContainerStarted","Data":"d659a4853e383987321098ba772e311ce40cf5a29797d31b3e1068877028a1a6"}
Jul 15 21:24:09.713083 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:09.713025    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5" podStartSLOduration=1.713006718 podStartE2EDuration="1.713006718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:24:09.711233246 +0000 UTC m=+2183.160584878" watchObservedRunningTime="2026-07-15 21:24:09.713006718 +0000 UTC m=+2183.162358397"
Jul 15 21:24:11.851124 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:11.851089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:24:18.947091 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:18.947054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:18.947650 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:18.947335    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:18.959762 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:18.959735    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:19.747505 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:19.747478    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:24:30.440597 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:30.440564    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:24:51.555396 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:51.555357    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:24:56.975549 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:24:56.975517    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"]
Jul 15 21:25:11.995918 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:11.995826    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5" podUID="d1597777-b98d-4389-b682-e06cf629e778" containerName="main" containerID="cri-o://bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979" gracePeriod=45
Jul 15 21:25:12.251573 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.251512    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:25:12.282542 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.282490    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-dshm\") pod \"d1597777-b98d-4389-b682-e06cf629e778\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") "
Jul 15 21:25:12.282730 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.282556    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-home\") pod \"d1597777-b98d-4389-b682-e06cf629e778\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") "
Jul 15 21:25:12.282730 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.282588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd9cr\" (UniqueName: \"kubernetes.io/projected/d1597777-b98d-4389-b682-e06cf629e778-kube-api-access-jd9cr\") pod \"d1597777-b98d-4389-b682-e06cf629e778\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") "
Jul 15 21:25:12.282730 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.282609    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-tmp-dir\") pod \"d1597777-b98d-4389-b682-e06cf629e778\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") "
Jul 15 21:25:12.282730 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.282666    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-model-cache\") pod \"d1597777-b98d-4389-b682-e06cf629e778\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") "
Jul 15 21:25:12.282730 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.282694    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1597777-b98d-4389-b682-e06cf629e778-tls-certs\") pod \"d1597777-b98d-4389-b682-e06cf629e778\" (UID: \"d1597777-b98d-4389-b682-e06cf629e778\") "
Jul 15 21:25:12.282979 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.282944    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d1597777-b98d-4389-b682-e06cf629e778" (UID: "d1597777-b98d-4389-b682-e06cf629e778"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:25:12.283092 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.283072    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:25:12.283174 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.283111    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-model-cache" (OuterVolumeSpecName: "model-cache") pod "d1597777-b98d-4389-b682-e06cf629e778" (UID: "d1597777-b98d-4389-b682-e06cf629e778"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:25:12.283174 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.283131    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-home" (OuterVolumeSpecName: "home") pod "d1597777-b98d-4389-b682-e06cf629e778" (UID: "d1597777-b98d-4389-b682-e06cf629e778"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:25:12.284943 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.284917    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-dshm" (OuterVolumeSpecName: "dshm") pod "d1597777-b98d-4389-b682-e06cf629e778" (UID: "d1597777-b98d-4389-b682-e06cf629e778"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:25:12.285231 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.285214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1597777-b98d-4389-b682-e06cf629e778-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d1597777-b98d-4389-b682-e06cf629e778" (UID: "d1597777-b98d-4389-b682-e06cf629e778"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:25:12.285632 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.285609    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1597777-b98d-4389-b682-e06cf629e778-kube-api-access-jd9cr" (OuterVolumeSpecName: "kube-api-access-jd9cr") pod "d1597777-b98d-4389-b682-e06cf629e778" (UID: "d1597777-b98d-4389-b682-e06cf629e778"). InnerVolumeSpecName "kube-api-access-jd9cr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:25:12.384371 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.384325    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:25:12.384371 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.384360    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:25:12.384371 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.384370    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd9cr\" (UniqueName: \"kubernetes.io/projected/d1597777-b98d-4389-b682-e06cf629e778-kube-api-access-jd9cr\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:25:12.384371 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.384381    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1597777-b98d-4389-b682-e06cf629e778-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:25:12.384657 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.384390    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1597777-b98d-4389-b682-e06cf629e778-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:25:12.969484 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.969445    2565 generic.go:356] "Generic (PLEG): container finished" podID="d1597777-b98d-4389-b682-e06cf629e778" containerID="bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979" exitCode=0
Jul 15 21:25:12.969484 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.969488    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"
Jul 15 21:25:12.969731 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.969531    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5" event={"ID":"d1597777-b98d-4389-b682-e06cf629e778","Type":"ContainerDied","Data":"bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979"}
Jul 15 21:25:12.969731 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.969571    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5" event={"ID":"d1597777-b98d-4389-b682-e06cf629e778","Type":"ContainerDied","Data":"d659a4853e383987321098ba772e311ce40cf5a29797d31b3e1068877028a1a6"}
Jul 15 21:25:12.969731 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.969588    2565 scope.go:117] "RemoveContainer" containerID="bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979"
Jul 15 21:25:12.978489 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.978472    2565 scope.go:117] "RemoveContainer" containerID="bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979"
Jul 15 21:25:12.978760 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:25:12.978743    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979\": container with ID starting with bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979 not found: ID does not exist" containerID="bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979"
Jul 15 21:25:12.978807 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.978768    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979"} err="failed to get container status \"bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979\": rpc error: code = NotFound desc = could not find container \"bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979\": container with ID starting with bb304d699ab7efd1b3cd1904ce44b2c361f58d630d0f3b12bf16035f2b8bf979 not found: ID does not exist"
Jul 15 21:25:12.991645 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.991624    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"]
Jul 15 21:25:12.994103 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:12.994084    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-61280292/e2e-lifecycle-model-61280292-kserve-5794d7d879-4r4r5"]
Jul 15 21:25:13.141683 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:13.141648    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1597777-b98d-4389-b682-e06cf629e778" path="/var/lib/kubelet/pods/d1597777-b98d-4389-b682-e06cf629e778/volumes"
Jul 15 21:25:55.990324 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:25:55.990286    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:26:04.048267 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:26:04.048231    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:26:53.372879 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:26:53.372846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:27:08.352149 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:08.352118    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:27:21.740306 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.740271    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"]
Jul 15 21:27:21.741115 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.740700    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1597777-b98d-4389-b682-e06cf629e778" containerName="main"
Jul 15 21:27:21.741115 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.740718    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1597777-b98d-4389-b682-e06cf629e778" containerName="main"
Jul 15 21:27:21.741115 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.740804    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1597777-b98d-4389-b682-e06cf629e778" containerName="main"
Jul 15 21:27:21.743899 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.743882    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.747354 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.747327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d87a1e\"/\"default-dockercfg-p89w7\""
Jul 15 21:27:21.747512 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.747356    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d87a1e\"/\"test-model-d87a1e-kserve-self-signed-certs\""
Jul 15 21:27:21.747512 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.747328    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d87a1e\"/\"kube-root-ca.crt\""
Jul 15 21:27:21.747512 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.747327    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d87a1e\"/\"openshift-service-ca.crt\""
Jul 15 21:27:21.754047 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.754021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"]
Jul 15 21:27:21.881516 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.881473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-dshm\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.881736 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.881546    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-tmp-dir\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.881736 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.881580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wszc\" (UniqueName: \"kubernetes.io/projected/42b97ed2-a148-4516-ab04-42b307c333dc-kube-api-access-6wszc\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.881736 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.881620    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-model-cache\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.881736 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.881658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-home\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.881736 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.881679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42b97ed2-a148-4516-ab04-42b307c333dc-tls-certs\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.982755 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.982722    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wszc\" (UniqueName: \"kubernetes.io/projected/42b97ed2-a148-4516-ab04-42b307c333dc-kube-api-access-6wszc\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.982944 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.982771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-model-cache\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.982944 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.982802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-home\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.982944 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.982818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42b97ed2-a148-4516-ab04-42b307c333dc-tls-certs\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.982944 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.982843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-dshm\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.982944 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.982885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-tmp-dir\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.983296 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.983269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-model-cache\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.983356 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.983304    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-tmp-dir\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.983356 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.983330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-home\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.985122 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.985098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-dshm\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.985373 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.985356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42b97ed2-a148-4516-ab04-42b307c333dc-tls-certs\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:21.992015 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:21.991940    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wszc\" (UniqueName: \"kubernetes.io/projected/42b97ed2-a148-4516-ab04-42b307c333dc-kube-api-access-6wszc\") pod \"test-model-d87a1e-kserve-5f49845bf7-774nz\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") " pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:22.053474 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:22.053410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:22.191162 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:22.191125    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"]
Jul 15 21:27:22.194406 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:27:22.194380    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42b97ed2_a148_4516_ab04_42b307c333dc.slice/crio-fb5a41b6ab47cef0511123e956bfecb69184df37bd4f82f7e1091b91acf3e44e WatchSource:0}: Error finding container fb5a41b6ab47cef0511123e956bfecb69184df37bd4f82f7e1091b91acf3e44e: Status 404 returned error can't find the container with id fb5a41b6ab47cef0511123e956bfecb69184df37bd4f82f7e1091b91acf3e44e
Jul 15 21:27:22.532911 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:22.532822    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz" event={"ID":"42b97ed2-a148-4516-ab04-42b307c333dc","Type":"ContainerStarted","Data":"5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0"}
Jul 15 21:27:22.532911 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:22.532866    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz" event={"ID":"42b97ed2-a148-4516-ab04-42b307c333dc","Type":"ContainerStarted","Data":"fb5a41b6ab47cef0511123e956bfecb69184df37bd4f82f7e1091b91acf3e44e"}
Jul 15 21:27:22.552978 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:22.552931    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz" podStartSLOduration=1.552914773 podStartE2EDuration="1.552914773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:27:22.552670177 +0000 UTC m=+2376.002021800" watchObservedRunningTime="2026-07-15 21:27:22.552914773 +0000 UTC m=+2376.002266405"
Jul 15 21:27:25.450160 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:25.450126    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:27:32.054341 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:32.054276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:32.054870 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:32.054360    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:32.066864 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:32.066839    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:32.589350 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:32.589318    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:27:36.944769 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:36.944728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:27:40.323804 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.323756    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"]
Jul 15 21:27:40.329257 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.329229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.333136 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.333102    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-659e77\"/\"default-dockercfg-9c2mx\""
Jul 15 21:27:40.333781 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.333766    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-659e77\"/\"openshift-service-ca.crt\""
Jul 15 21:27:40.333854 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.333779    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-659e77\"/\"test-model-659e77-kserve-self-signed-certs\""
Jul 15 21:27:40.333854 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.333798    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-659e77\"/\"kube-root-ca.crt\""
Jul 15 21:27:40.382839 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.382810    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"]
Jul 15 21:27:40.440446 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.440379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-model-cache\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.440446 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.440454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-tmp-dir\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.440671 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.440476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc5b281-c00c-499f-ad73-c9a6a7757536-tls-certs\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.440671 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.440495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmc95\" (UniqueName: \"kubernetes.io/projected/4fc5b281-c00c-499f-ad73-c9a6a7757536-kube-api-access-wmc95\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.440671 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.440530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-home\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.440671 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.440577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-dshm\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542000 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.541962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-tmp-dir\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542000 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.542000    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc5b281-c00c-499f-ad73-c9a6a7757536-tls-certs\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542260 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.542021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmc95\" (UniqueName: \"kubernetes.io/projected/4fc5b281-c00c-499f-ad73-c9a6a7757536-kube-api-access-wmc95\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542260 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.542053    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-home\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542260 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.542081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-dshm\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542260 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.542124    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-model-cache\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542529 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.542498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-tmp-dir\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542529 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.542515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-model-cache\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.542674 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.542547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-home\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.544432 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.544399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-dshm\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.544683 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.544666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc5b281-c00c-499f-ad73-c9a6a7757536-tls-certs\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.555006 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.554966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmc95\" (UniqueName: \"kubernetes.io/projected/4fc5b281-c00c-499f-ad73-c9a6a7757536-kube-api-access-wmc95\") pod \"test-model-659e77-kserve-786cc84b99-45tq7\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") " pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.639646 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.639545    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:40.787651 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:40.787625    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"]
Jul 15 21:27:40.789282 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:27:40.789257    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fc5b281_c00c_499f_ad73_c9a6a7757536.slice/crio-0923ee71def7adad5cfed2d1604d61e04c9192360d3c544e71ee8d842cd76c0a WatchSource:0}: Error finding container 0923ee71def7adad5cfed2d1604d61e04c9192360d3c544e71ee8d842cd76c0a: Status 404 returned error can't find the container with id 0923ee71def7adad5cfed2d1604d61e04c9192360d3c544e71ee8d842cd76c0a
Jul 15 21:27:41.620092 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:41.620056    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7" event={"ID":"4fc5b281-c00c-499f-ad73-c9a6a7757536","Type":"ContainerStarted","Data":"52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626"}
Jul 15 21:27:41.620092 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:41.620097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7" event={"ID":"4fc5b281-c00c-499f-ad73-c9a6a7757536","Type":"ContainerStarted","Data":"0923ee71def7adad5cfed2d1604d61e04c9192360d3c544e71ee8d842cd76c0a"}
Jul 15 21:27:41.643301 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:41.643225    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7" podStartSLOduration=1.643209602 podStartE2EDuration="1.643209602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:27:41.64178689 +0000 UTC m=+2395.091138522" watchObservedRunningTime="2026-07-15 21:27:41.643209602 +0000 UTC m=+2395.092561230"
Jul 15 21:27:47.159884 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:47.159849    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:27:47.167202 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:47.167180    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:27:47.759474 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:47.759438    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:27:50.640000 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:50.639951    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:50.640380 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:50.640024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:50.652383 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:50.652350    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:27:50.676138 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:27:50.676106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:28:02.505381 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:02.505344    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:28:12.718963 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:12.718876    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"]
Jul 15 21:28:13.745535 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:13.745496    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"]
Jul 15 21:28:18.757486 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:18.757447    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:28:27.739087 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:27.739033    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz" podUID="42b97ed2-a148-4516-ab04-42b307c333dc" containerName="main" containerID="cri-o://5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0" gracePeriod=45
Jul 15 21:28:27.983314 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:27.983286    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:28:28.067966 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.067877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-model-cache\") pod \"42b97ed2-a148-4516-ab04-42b307c333dc\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") "
Jul 15 21:28:28.067966 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.067923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wszc\" (UniqueName: \"kubernetes.io/projected/42b97ed2-a148-4516-ab04-42b307c333dc-kube-api-access-6wszc\") pod \"42b97ed2-a148-4516-ab04-42b307c333dc\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") "
Jul 15 21:28:28.067966 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.067954    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-tmp-dir\") pod \"42b97ed2-a148-4516-ab04-42b307c333dc\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") "
Jul 15 21:28:28.067966 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.067968    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-home\") pod \"42b97ed2-a148-4516-ab04-42b307c333dc\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") "
Jul 15 21:28:28.068283 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.067991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42b97ed2-a148-4516-ab04-42b307c333dc-tls-certs\") pod \"42b97ed2-a148-4516-ab04-42b307c333dc\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") "
Jul 15 21:28:28.068283 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.068032    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-dshm\") pod \"42b97ed2-a148-4516-ab04-42b307c333dc\" (UID: \"42b97ed2-a148-4516-ab04-42b307c333dc\") "
Jul 15 21:28:28.068283 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.068238    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "42b97ed2-a148-4516-ab04-42b307c333dc" (UID: "42b97ed2-a148-4516-ab04-42b307c333dc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:28:28.068283 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.068245    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-model-cache" (OuterVolumeSpecName: "model-cache") pod "42b97ed2-a148-4516-ab04-42b307c333dc" (UID: "42b97ed2-a148-4516-ab04-42b307c333dc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:28:28.068283 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.068268    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-home" (OuterVolumeSpecName: "home") pod "42b97ed2-a148-4516-ab04-42b307c333dc" (UID: "42b97ed2-a148-4516-ab04-42b307c333dc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:28:28.070313 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.070279    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b97ed2-a148-4516-ab04-42b307c333dc-kube-api-access-6wszc" (OuterVolumeSpecName: "kube-api-access-6wszc") pod "42b97ed2-a148-4516-ab04-42b307c333dc" (UID: "42b97ed2-a148-4516-ab04-42b307c333dc"). InnerVolumeSpecName "kube-api-access-6wszc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:28:28.070429 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.070279    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-dshm" (OuterVolumeSpecName: "dshm") pod "42b97ed2-a148-4516-ab04-42b307c333dc" (UID: "42b97ed2-a148-4516-ab04-42b307c333dc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:28:28.070429 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.070354    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42b97ed2-a148-4516-ab04-42b307c333dc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "42b97ed2-a148-4516-ab04-42b307c333dc" (UID: "42b97ed2-a148-4516-ab04-42b307c333dc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:28:28.169147 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.169111    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:28.169147 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.169142    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wszc\" (UniqueName: \"kubernetes.io/projected/42b97ed2-a148-4516-ab04-42b307c333dc-kube-api-access-6wszc\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:28.169361 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.169173    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:28.169361 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.169183    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:28.169361 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.169191    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42b97ed2-a148-4516-ab04-42b307c333dc-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:28.169361 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.169199    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42b97ed2-a148-4516-ab04-42b307c333dc-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:28.765711 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.765647    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7" podUID="4fc5b281-c00c-499f-ad73-c9a6a7757536" containerName="main" containerID="cri-o://52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626" gracePeriod=45
Jul 15 21:28:28.840511 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.840472    2565 generic.go:356] "Generic (PLEG): container finished" podID="42b97ed2-a148-4516-ab04-42b307c333dc" containerID="5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0" exitCode=0
Jul 15 21:28:28.840669 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.840518    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"
Jul 15 21:28:28.840669 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.840536    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz" event={"ID":"42b97ed2-a148-4516-ab04-42b307c333dc","Type":"ContainerDied","Data":"5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0"}
Jul 15 21:28:28.840669 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.840576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz" event={"ID":"42b97ed2-a148-4516-ab04-42b307c333dc","Type":"ContainerDied","Data":"fb5a41b6ab47cef0511123e956bfecb69184df37bd4f82f7e1091b91acf3e44e"}
Jul 15 21:28:28.840669 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.840598    2565 scope.go:117] "RemoveContainer" containerID="5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0"
Jul 15 21:28:28.861725 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.861695    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"]
Jul 15 21:28:28.865871 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.865847    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d87a1e/test-model-d87a1e-kserve-5f49845bf7-774nz"]
Jul 15 21:28:28.876842 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.876810    2565 scope.go:117] "RemoveContainer" containerID="5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0"
Jul 15 21:28:28.877169 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:28:28.877150    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0\": container with ID starting with 5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0 not found: ID does not exist" containerID="5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0"
Jul 15 21:28:28.877241 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:28.877179    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0"} err="failed to get container status \"5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0\": rpc error: code = NotFound desc = could not find container \"5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0\": container with ID starting with 5d835542be34302fcac478a365eb687ef020181d2a24b23fb49a5377a16c9ea0 not found: ID does not exist"
Jul 15 21:28:29.020461 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.020377    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:28:29.079501 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmc95\" (UniqueName: \"kubernetes.io/projected/4fc5b281-c00c-499f-ad73-c9a6a7757536-kube-api-access-wmc95\") pod \"4fc5b281-c00c-499f-ad73-c9a6a7757536\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") "
Jul 15 21:28:29.079501 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079504    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-home\") pod \"4fc5b281-c00c-499f-ad73-c9a6a7757536\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") "
Jul 15 21:28:29.079722 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079538    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc5b281-c00c-499f-ad73-c9a6a7757536-tls-certs\") pod \"4fc5b281-c00c-499f-ad73-c9a6a7757536\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") "
Jul 15 21:28:29.079722 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079559    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-tmp-dir\") pod \"4fc5b281-c00c-499f-ad73-c9a6a7757536\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") "
Jul 15 21:28:29.079722 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-dshm\") pod \"4fc5b281-c00c-499f-ad73-c9a6a7757536\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") "
Jul 15 21:28:29.079722 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079599    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-model-cache\") pod \"4fc5b281-c00c-499f-ad73-c9a6a7757536\" (UID: \"4fc5b281-c00c-499f-ad73-c9a6a7757536\") "
Jul 15 21:28:29.079940 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079881    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4fc5b281-c00c-499f-ad73-c9a6a7757536" (UID: "4fc5b281-c00c-499f-ad73-c9a6a7757536"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:28:29.079940 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079901    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-home" (OuterVolumeSpecName: "home") pod "4fc5b281-c00c-499f-ad73-c9a6a7757536" (UID: "4fc5b281-c00c-499f-ad73-c9a6a7757536"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:28:29.080038 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.079970    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-model-cache" (OuterVolumeSpecName: "model-cache") pod "4fc5b281-c00c-499f-ad73-c9a6a7757536" (UID: "4fc5b281-c00c-499f-ad73-c9a6a7757536"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:28:29.081785 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.081763    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc5b281-c00c-499f-ad73-c9a6a7757536-kube-api-access-wmc95" (OuterVolumeSpecName: "kube-api-access-wmc95") pod "4fc5b281-c00c-499f-ad73-c9a6a7757536" (UID: "4fc5b281-c00c-499f-ad73-c9a6a7757536"). InnerVolumeSpecName "kube-api-access-wmc95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:28:29.082105 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.082085    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fc5b281-c00c-499f-ad73-c9a6a7757536-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4fc5b281-c00c-499f-ad73-c9a6a7757536" (UID: "4fc5b281-c00c-499f-ad73-c9a6a7757536"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:28:29.082105 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.082096    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-dshm" (OuterVolumeSpecName: "dshm") pod "4fc5b281-c00c-499f-ad73-c9a6a7757536" (UID: "4fc5b281-c00c-499f-ad73-c9a6a7757536"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:28:29.143258 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.143226    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b97ed2-a148-4516-ab04-42b307c333dc" path="/var/lib/kubelet/pods/42b97ed2-a148-4516-ab04-42b307c333dc/volumes"
Jul 15 21:28:29.180898 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.180856    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:29.180898 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.180888    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:29.180898 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.180897    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:29.180898 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.180907    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmc95\" (UniqueName: \"kubernetes.io/projected/4fc5b281-c00c-499f-ad73-c9a6a7757536-kube-api-access-wmc95\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:29.181178 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.180917    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4fc5b281-c00c-499f-ad73-c9a6a7757536-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:29.181178 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.180925    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4fc5b281-c00c-499f-ad73-c9a6a7757536-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:28:29.846882 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.846848    2565 generic.go:356] "Generic (PLEG): container finished" podID="4fc5b281-c00c-499f-ad73-c9a6a7757536" containerID="52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626" exitCode=0
Jul 15 21:28:29.847313 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.846897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7" event={"ID":"4fc5b281-c00c-499f-ad73-c9a6a7757536","Type":"ContainerDied","Data":"52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626"}
Jul 15 21:28:29.847313 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.846906    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"
Jul 15 21:28:29.847313 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.846926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7" event={"ID":"4fc5b281-c00c-499f-ad73-c9a6a7757536","Type":"ContainerDied","Data":"0923ee71def7adad5cfed2d1604d61e04c9192360d3c544e71ee8d842cd76c0a"}
Jul 15 21:28:29.847313 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.846943    2565 scope.go:117] "RemoveContainer" containerID="52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626"
Jul 15 21:28:29.855201 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.855181    2565 scope.go:117] "RemoveContainer" containerID="52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626"
Jul 15 21:28:29.855493 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:28:29.855470    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626\": container with ID starting with 52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626 not found: ID does not exist" containerID="52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626"
Jul 15 21:28:29.855580 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.855505    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626"} err="failed to get container status \"52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626\": rpc error: code = NotFound desc = could not find container \"52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626\": container with ID starting with 52950ef1c7347a800cc02f93a44fdcc402660333fbcea4d5895a824bcd61f626 not found: ID does not exist"
Jul 15 21:28:29.863142 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.863112    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"]
Jul 15 21:28:29.869381 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:29.869356    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-659e77/test-model-659e77-kserve-786cc84b99-45tq7"]
Jul 15 21:28:31.142448 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:31.142406    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fc5b281-c00c-499f-ad73-c9a6a7757536" path="/var/lib/kubelet/pods/4fc5b281-c00c-499f-ad73-c9a6a7757536/volumes"
Jul 15 21:28:34.645983 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:34.645947    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:28:54.252015 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:28:54.251972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:29:15.708713 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:29:15.708680    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:29:32.654138 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:29:32.654100    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:29:44.861075 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:29:44.861037    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:30:00.146692 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.146652    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh"]
Jul 15 21:30:00.147097 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.146992    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc5b281-c00c-499f-ad73-c9a6a7757536" containerName="main"
Jul 15 21:30:00.147097 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.147004    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc5b281-c00c-499f-ad73-c9a6a7757536" containerName="main"
Jul 15 21:30:00.147097 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.147015    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b97ed2-a148-4516-ab04-42b307c333dc" containerName="main"
Jul 15 21:30:00.147097 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.147020    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b97ed2-a148-4516-ab04-42b307c333dc" containerName="main"
Jul 15 21:30:00.147097 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.147070    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b97ed2-a148-4516-ab04-42b307c333dc" containerName="main"
Jul 15 21:30:00.147097 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.147080    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc5b281-c00c-499f-ad73-c9a6a7757536" containerName="main"
Jul 15 21:30:00.149962 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.149944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh"
Jul 15 21:30:00.153083 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.153060    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zsrf5\""
Jul 15 21:30:00.159315 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.159293    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh"
Jul 15 21:30:00.161671 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.161646    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh"]
Jul 15 21:30:00.302265 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.302235    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh"]
Jul 15 21:30:00.305505 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:30:00.305478    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b2623d_c6c5_4ed0_a23a_cec82d32c8cb.slice/crio-ec77ae32247bd2144d5de1cb594a2becf5ae822904fdc29ad35bbf4ff4afcb21 WatchSource:0}: Error finding container ec77ae32247bd2144d5de1cb594a2becf5ae822904fdc29ad35bbf4ff4afcb21: Status 404 returned error can't find the container with id ec77ae32247bd2144d5de1cb594a2becf5ae822904fdc29ad35bbf4ff4afcb21
Jul 15 21:30:00.307364 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:00.307348    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:30:01.248129 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:01.248089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh" event={"ID":"e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb","Type":"ContainerStarted","Data":"ec77ae32247bd2144d5de1cb594a2becf5ae822904fdc29ad35bbf4ff4afcb21"}
Jul 15 21:30:03.260251 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:03.260212    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh" event={"ID":"e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb","Type":"ContainerStarted","Data":"87daa5d9ba94e0478aaceae9e00f189ca740868ed51eea5bb5c008cb3cbef849"}
Jul 15 21:30:03.277960 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:03.277907    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh" podStartSLOduration=0.975093687 podStartE2EDuration="3.277890465s" totalImagesPullingTime="2.302796778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:03.276247883 +0000 UTC m=+2536.725599516" watchObservedRunningTime="2026-07-15 21:30:03.277890465 +0000 UTC m=+2536.727242098"
Jul 15 21:30:04.267068 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:04.267033    2565 generic.go:356] "Generic (PLEG): container finished" podID="e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb" containerID="87daa5d9ba94e0478aaceae9e00f189ca740868ed51eea5bb5c008cb3cbef849" exitCode=0
Jul 15 21:30:04.267501 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:04.267122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh" event={"ID":"e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb","Type":"ContainerDied","Data":"87daa5d9ba94e0478aaceae9e00f189ca740868ed51eea5bb5c008cb3cbef849"}
Jul 15 21:30:05.402244 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:05.402221    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh"
Jul 15 21:30:06.276906 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:06.276869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh" event={"ID":"e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb","Type":"ContainerDied","Data":"ec77ae32247bd2144d5de1cb594a2becf5ae822904fdc29ad35bbf4ff4afcb21"}
Jul 15 21:30:06.277061 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:06.276923    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec77ae32247bd2144d5de1cb594a2becf5ae822904fdc29ad35bbf4ff4afcb21"
Jul 15 21:30:06.277061 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:06.276881    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-rw6xh"
Jul 15 21:30:11.050207 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:11.050176    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:30:32.251779 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:32.251742    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:30:48.445016 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:30:48.444979    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:31:02.155507 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.155464    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"]
Jul 15 21:31:02.155981 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.155943    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb" containerName="cleanup"
Jul 15 21:31:02.155981 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.155960    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb" containerName="cleanup"
Jul 15 21:31:02.156097 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.156059    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb" containerName="cleanup"
Jul 15 21:31:02.158174 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.158154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.161572 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.161548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-677131\"/\"auth-test-model-677131-kserve-self-signed-certs\""
Jul 15 21:31:02.161572 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.161564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-677131\"/\"kube-root-ca.crt\""
Jul 15 21:31:02.161750 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.161609    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-677131\"/\"openshift-service-ca.crt\""
Jul 15 21:31:02.161750 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.161556    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-677131\"/\"default-dockercfg-mhzjm\""
Jul 15 21:31:02.180697 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.180673    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"]
Jul 15 21:31:02.228582 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.228550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-home\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.228767 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.228597    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/968f7efd-8660-475b-8743-61b0dd058042-tls-certs\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.228767 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.228635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-dshm\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.228767 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.228663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-model-cache\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.228873 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.228799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcfrn\" (UniqueName: \"kubernetes.io/projected/968f7efd-8660-475b-8743-61b0dd058042-kube-api-access-wcfrn\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.228873 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.228839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-tmp-dir\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.329693 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.329647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcfrn\" (UniqueName: \"kubernetes.io/projected/968f7efd-8660-475b-8743-61b0dd058042-kube-api-access-wcfrn\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.329693 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.329688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-tmp-dir\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.329968 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.329714    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-home\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.329968 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.329750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/968f7efd-8660-475b-8743-61b0dd058042-tls-certs\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.329968 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.329796    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-dshm\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.329968 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.329838    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-model-cache\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.330204 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.330134    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-tmp-dir\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.330204 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.330152    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-home\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.330310 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.330208    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-model-cache\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.332017 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.331997    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-dshm\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.332538 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.332521    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/968f7efd-8660-475b-8743-61b0dd058042-tls-certs\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.339026 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.338998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcfrn\" (UniqueName: \"kubernetes.io/projected/968f7efd-8660-475b-8743-61b0dd058042-kube-api-access-wcfrn\") pod \"auth-test-model-677131-kserve-797dd79bd7-s8cg6\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") " pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.467310 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.467210    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:02.601893 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:02.601808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"]
Jul 15 21:31:02.604382 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:31:02.604354    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod968f7efd_8660_475b_8743_61b0dd058042.slice/crio-3e3a6c7f8a4c6589f62d7ed62a6833bf98d12fa37b985597e7ba27efa0db339f WatchSource:0}: Error finding container 3e3a6c7f8a4c6589f62d7ed62a6833bf98d12fa37b985597e7ba27efa0db339f: Status 404 returned error can't find the container with id 3e3a6c7f8a4c6589f62d7ed62a6833bf98d12fa37b985597e7ba27efa0db339f
Jul 15 21:31:03.530611 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:03.530578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6" event={"ID":"968f7efd-8660-475b-8743-61b0dd058042","Type":"ContainerStarted","Data":"a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83"}
Jul 15 21:31:03.530611 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:03.530618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6" event={"ID":"968f7efd-8660-475b-8743-61b0dd058042","Type":"ContainerStarted","Data":"3e3a6c7f8a4c6589f62d7ed62a6833bf98d12fa37b985597e7ba27efa0db339f"}
Jul 15 21:31:03.549787 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:03.549617    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6" podStartSLOduration=1.549592015 podStartE2EDuration="1.549592015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:31:03.549339827 +0000 UTC m=+2596.998691470" watchObservedRunningTime="2026-07-15 21:31:03.549592015 +0000 UTC m=+2596.998943647"
Jul 15 21:31:05.741769 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:05.741736    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:31:12.468410 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:12.468304    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:12.468410 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:12.468361    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:12.480816 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:12.480787    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:12.581129 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:12.581094    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:31:26.144796 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.144761    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"]
Jul 15 21:31:26.147051 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.147033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.150469 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.150440    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"openshift-service-ca.crt\""
Jul 15 21:31:26.150611 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.150439    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"auth-test-model-266bf8-kserve-self-signed-certs\""
Jul 15 21:31:26.150611 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.150453    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"default-dockercfg-mgwpw\""
Jul 15 21:31:26.150611 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.150490    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"kube-root-ca.crt\""
Jul 15 21:31:26.159296 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.159272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"]
Jul 15 21:31:26.236969 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.236933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-tmp-dir\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.236969 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.236965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37361d5a-8802-4a55-9350-b26b1098ea08-tls-certs\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.237168 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.236988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9skhk\" (UniqueName: \"kubernetes.io/projected/37361d5a-8802-4a55-9350-b26b1098ea08-kube-api-access-9skhk\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.237168 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.237058    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-dshm\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.237168 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.237080    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-home\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.237168 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.237096    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-model-cache\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.338310 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-tmp-dir\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.338310 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37361d5a-8802-4a55-9350-b26b1098ea08-tls-certs\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.338574 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338329    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9skhk\" (UniqueName: \"kubernetes.io/projected/37361d5a-8802-4a55-9350-b26b1098ea08-kube-api-access-9skhk\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.338574 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-dshm\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.338574 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-home\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.338574 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-model-cache\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.338954 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338929    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-home\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.338954 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-tmp-dir\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.339081 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.338980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-model-cache\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.340690 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.340672    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-dshm\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.341098 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.341076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37361d5a-8802-4a55-9350-b26b1098ea08-tls-certs\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.348120 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.348090    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9skhk\" (UniqueName: \"kubernetes.io/projected/37361d5a-8802-4a55-9350-b26b1098ea08-kube-api-access-9skhk\") pod \"auth-test-model-266bf8-kserve-bfccb8f55-kd7p7\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") " pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.458331 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.458232    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:26.592878 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.592852    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"]
Jul 15 21:31:26.595188 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:31:26.595158    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37361d5a_8802_4a55_9350_b26b1098ea08.slice/crio-f79cbc97d02fc7f92f5cb2aa745efae3c6be660ec6852819a31eb529c1c8bb80 WatchSource:0}: Error finding container f79cbc97d02fc7f92f5cb2aa745efae3c6be660ec6852819a31eb529c1c8bb80: Status 404 returned error can't find the container with id f79cbc97d02fc7f92f5cb2aa745efae3c6be660ec6852819a31eb529c1c8bb80
Jul 15 21:31:26.631276 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:26.631239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7" event={"ID":"37361d5a-8802-4a55-9350-b26b1098ea08","Type":"ContainerStarted","Data":"f79cbc97d02fc7f92f5cb2aa745efae3c6be660ec6852819a31eb529c1c8bb80"}
Jul 15 21:31:27.637450 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:27.637401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7" event={"ID":"37361d5a-8802-4a55-9350-b26b1098ea08","Type":"ContainerStarted","Data":"ac6ba03602a7c014bc86130b2ff1aa05e9be4f3086af43666c76022a42d921b6"}
Jul 15 21:31:27.659139 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:27.659092    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7" podStartSLOduration=1.659074132 podStartE2EDuration="1.659074132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:31:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:31:27.656766433 +0000 UTC m=+2621.106118086" watchObservedRunningTime="2026-07-15 21:31:27.659074132 +0000 UTC m=+2621.108425764"
Jul 15 21:31:29.953578 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:29.953538    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:31:36.458752 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:36.458705    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:36.459297 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:36.458771    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:36.471237 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:36.471210    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:31:36.689092 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:31:36.689064    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:32:00.047272 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:32:00.047236    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:32:18.344228 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:32:18.344191    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:32:32.543909 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:32:32.543872    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:32:47.192551 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:32:47.192470    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:32:47.200471 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:32:47.200448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:32:50.088965 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:32:50.088922    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:33:08.239338 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:08.239305    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:33:27.639319 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:27.639283    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:33:41.017009 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:41.016967    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"]
Jul 15 21:33:42.122310 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:42.122268    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"]
Jul 15 21:33:43.838388 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:43.838353    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:33:53.374194 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.374159    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"]
Jul 15 21:33:53.376608 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.376590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.379807 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.379786    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-677131\"/\"sub-test-model-677131-kserve-self-signed-certs\""
Jul 15 21:33:53.387670 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.387647    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"]
Jul 15 21:33:53.566988 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.566950    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksx4x\" (UniqueName: \"kubernetes.io/projected/b3aae597-b731-4748-b859-8caa2268025c-kube-api-access-ksx4x\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.566988 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.566990    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-home\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.567243 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.567008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-dshm\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.567243 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.567031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-tmp-dir\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.567243 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.567097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3aae597-b731-4748-b859-8caa2268025c-tls-certs\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.567243 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.567178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-model-cache\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.668644 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.668555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-tmp-dir\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.668644 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.668601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3aae597-b731-4748-b859-8caa2268025c-tls-certs\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.668644 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.668643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-model-cache\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.668914 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.668690    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksx4x\" (UniqueName: \"kubernetes.io/projected/b3aae597-b731-4748-b859-8caa2268025c-kube-api-access-ksx4x\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.668914 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.668713    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-home\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.668914 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.668734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-dshm\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.669084 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.669025    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-tmp-dir\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.669084 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.669035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-model-cache\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.669183 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.669112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-home\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.670889 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.670870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-dshm\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.671219 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.671204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3aae597-b731-4748-b859-8caa2268025c-tls-certs\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.677131 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.677112    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksx4x\" (UniqueName: \"kubernetes.io/projected/b3aae597-b731-4748-b859-8caa2268025c-kube-api-access-ksx4x\") pod \"sub-test-model-677131-kserve-6957856d9-stx6f\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") " pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.686075 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.686051    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:33:53.817862 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:53.817827    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"]
Jul 15 21:33:53.820783 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:33:53.820755    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3aae597_b731_4748_b859_8caa2268025c.slice/crio-2ec224dff5900d66cf453df425fdb04212fe8120771aff3a94b282cc2ad34c89 WatchSource:0}: Error finding container 2ec224dff5900d66cf453df425fdb04212fe8120771aff3a94b282cc2ad34c89: Status 404 returned error can't find the container with id 2ec224dff5900d66cf453df425fdb04212fe8120771aff3a94b282cc2ad34c89
Jul 15 21:33:54.310120 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:54.310083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f" event={"ID":"b3aae597-b731-4748-b859-8caa2268025c","Type":"ContainerStarted","Data":"78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423"}
Jul 15 21:33:54.310120 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:54.310128    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f" event={"ID":"b3aae597-b731-4748-b859-8caa2268025c","Type":"ContainerStarted","Data":"2ec224dff5900d66cf453df425fdb04212fe8120771aff3a94b282cc2ad34c89"}
Jul 15 21:33:54.330363 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:54.330312    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f" podStartSLOduration=1.330296572 podStartE2EDuration="1.330296572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:33:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:33:54.32788886 +0000 UTC m=+2767.777240492" watchObservedRunningTime="2026-07-15 21:33:54.330296572 +0000 UTC m=+2767.779648203"
Jul 15 21:33:55.853609 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:55.853576    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:33:56.036889 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.036838    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6" podUID="968f7efd-8660-475b-8743-61b0dd058042" containerName="main" containerID="cri-o://a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83" gracePeriod=45
Jul 15 21:33:56.295252 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.295228    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:33:56.320408 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.320371    2565 generic.go:356] "Generic (PLEG): container finished" podID="968f7efd-8660-475b-8743-61b0dd058042" containerID="a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83" exitCode=0
Jul 15 21:33:56.320663 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.320443    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"
Jul 15 21:33:56.320663 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.320466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6" event={"ID":"968f7efd-8660-475b-8743-61b0dd058042","Type":"ContainerDied","Data":"a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83"}
Jul 15 21:33:56.320663 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.320514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6" event={"ID":"968f7efd-8660-475b-8743-61b0dd058042","Type":"ContainerDied","Data":"3e3a6c7f8a4c6589f62d7ed62a6833bf98d12fa37b985597e7ba27efa0db339f"}
Jul 15 21:33:56.320663 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.320541    2565 scope.go:117] "RemoveContainer" containerID="a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83"
Jul 15 21:33:56.330490 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.330470    2565 scope.go:117] "RemoveContainer" containerID="a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83"
Jul 15 21:33:56.330831 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:33:56.330811    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83\": container with ID starting with a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83 not found: ID does not exist" containerID="a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83"
Jul 15 21:33:56.330902 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.330841    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83"} err="failed to get container status \"a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83\": rpc error: code = NotFound desc = could not find container \"a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83\": container with ID starting with a455419f3968b78769a5763b13ab1662e1941dbe3c76625ccd3325ace213ac83 not found: ID does not exist"
Jul 15 21:33:56.393914 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.393872    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-tmp-dir\") pod \"968f7efd-8660-475b-8743-61b0dd058042\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") "
Jul 15 21:33:56.394101 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.393949    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-model-cache\") pod \"968f7efd-8660-475b-8743-61b0dd058042\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") "
Jul 15 21:33:56.394101 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.393977    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcfrn\" (UniqueName: \"kubernetes.io/projected/968f7efd-8660-475b-8743-61b0dd058042-kube-api-access-wcfrn\") pod \"968f7efd-8660-475b-8743-61b0dd058042\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") "
Jul 15 21:33:56.394101 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.394025    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/968f7efd-8660-475b-8743-61b0dd058042-tls-certs\") pod \"968f7efd-8660-475b-8743-61b0dd058042\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") "
Jul 15 21:33:56.394101 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.394062    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-dshm\") pod \"968f7efd-8660-475b-8743-61b0dd058042\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") "
Jul 15 21:33:56.394101 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.394094    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-home\") pod \"968f7efd-8660-475b-8743-61b0dd058042\" (UID: \"968f7efd-8660-475b-8743-61b0dd058042\") "
Jul 15 21:33:56.394405 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.394157    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "968f7efd-8660-475b-8743-61b0dd058042" (UID: "968f7efd-8660-475b-8743-61b0dd058042"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:56.394405 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.394236    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-model-cache" (OuterVolumeSpecName: "model-cache") pod "968f7efd-8660-475b-8743-61b0dd058042" (UID: "968f7efd-8660-475b-8743-61b0dd058042"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:56.394405 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.394378    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-home" (OuterVolumeSpecName: "home") pod "968f7efd-8660-475b-8743-61b0dd058042" (UID: "968f7efd-8660-475b-8743-61b0dd058042"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:56.395113 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.395009    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:56.395113 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.395058    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:56.402683 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.402597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-dshm" (OuterVolumeSpecName: "dshm") pod "968f7efd-8660-475b-8743-61b0dd058042" (UID: "968f7efd-8660-475b-8743-61b0dd058042"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:56.402683 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.402624    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968f7efd-8660-475b-8743-61b0dd058042-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "968f7efd-8660-475b-8743-61b0dd058042" (UID: "968f7efd-8660-475b-8743-61b0dd058042"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:33:56.402683 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.402622    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968f7efd-8660-475b-8743-61b0dd058042-kube-api-access-wcfrn" (OuterVolumeSpecName: "kube-api-access-wcfrn") pod "968f7efd-8660-475b-8743-61b0dd058042" (UID: "968f7efd-8660-475b-8743-61b0dd058042"). InnerVolumeSpecName "kube-api-access-wcfrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:33:56.495777 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.495730    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcfrn\" (UniqueName: \"kubernetes.io/projected/968f7efd-8660-475b-8743-61b0dd058042-kube-api-access-wcfrn\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:56.495777 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.495777    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/968f7efd-8660-475b-8743-61b0dd058042-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:56.496029 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.495793    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:56.496029 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.495805    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/968f7efd-8660-475b-8743-61b0dd058042-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:56.680530 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.680440    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"]
Jul 15 21:33:56.691507 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:56.691479    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-677131/auth-test-model-677131-kserve-797dd79bd7-s8cg6"]
Jul 15 21:33:57.142551 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.142515    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7" podUID="37361d5a-8802-4a55-9350-b26b1098ea08" containerName="main" containerID="cri-o://ac6ba03602a7c014bc86130b2ff1aa05e9be4f3086af43666c76022a42d921b6" gracePeriod=45
Jul 15 21:33:57.143023 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.142835    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968f7efd-8660-475b-8743-61b0dd058042" path="/var/lib/kubelet/pods/968f7efd-8660-475b-8743-61b0dd058042/volumes"
Jul 15 21:33:57.327493 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.327460    2565 generic.go:356] "Generic (PLEG): container finished" podID="37361d5a-8802-4a55-9350-b26b1098ea08" containerID="ac6ba03602a7c014bc86130b2ff1aa05e9be4f3086af43666c76022a42d921b6" exitCode=0
Jul 15 21:33:57.327652 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.327534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7" event={"ID":"37361d5a-8802-4a55-9350-b26b1098ea08","Type":"ContainerDied","Data":"ac6ba03602a7c014bc86130b2ff1aa05e9be4f3086af43666c76022a42d921b6"}
Jul 15 21:33:57.396953 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.396896    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:33:57.403401 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403380    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-model-cache\") pod \"37361d5a-8802-4a55-9350-b26b1098ea08\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") "
Jul 15 21:33:57.403550 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403405    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-home\") pod \"37361d5a-8802-4a55-9350-b26b1098ea08\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") "
Jul 15 21:33:57.403550 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403437    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9skhk\" (UniqueName: \"kubernetes.io/projected/37361d5a-8802-4a55-9350-b26b1098ea08-kube-api-access-9skhk\") pod \"37361d5a-8802-4a55-9350-b26b1098ea08\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") "
Jul 15 21:33:57.403550 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403463    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37361d5a-8802-4a55-9350-b26b1098ea08-tls-certs\") pod \"37361d5a-8802-4a55-9350-b26b1098ea08\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") "
Jul 15 21:33:57.403550 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403500    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-dshm\") pod \"37361d5a-8802-4a55-9350-b26b1098ea08\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") "
Jul 15 21:33:57.403761 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403705    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-home" (OuterVolumeSpecName: "home") pod "37361d5a-8802-4a55-9350-b26b1098ea08" (UID: "37361d5a-8802-4a55-9350-b26b1098ea08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:57.403761 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403717    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-model-cache" (OuterVolumeSpecName: "model-cache") pod "37361d5a-8802-4a55-9350-b26b1098ea08" (UID: "37361d5a-8802-4a55-9350-b26b1098ea08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:57.403850 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403793    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:57.403850 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.403808    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:57.405716 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.405682    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-dshm" (OuterVolumeSpecName: "dshm") pod "37361d5a-8802-4a55-9350-b26b1098ea08" (UID: "37361d5a-8802-4a55-9350-b26b1098ea08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:57.405716 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.405696    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37361d5a-8802-4a55-9350-b26b1098ea08-kube-api-access-9skhk" (OuterVolumeSpecName: "kube-api-access-9skhk") pod "37361d5a-8802-4a55-9350-b26b1098ea08" (UID: "37361d5a-8802-4a55-9350-b26b1098ea08"). InnerVolumeSpecName "kube-api-access-9skhk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:33:57.405857 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.405717    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37361d5a-8802-4a55-9350-b26b1098ea08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "37361d5a-8802-4a55-9350-b26b1098ea08" (UID: "37361d5a-8802-4a55-9350-b26b1098ea08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:33:57.504129 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.504091    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-tmp-dir\") pod \"37361d5a-8802-4a55-9350-b26b1098ea08\" (UID: \"37361d5a-8802-4a55-9350-b26b1098ea08\") "
Jul 15 21:33:57.504308 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.504255    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9skhk\" (UniqueName: \"kubernetes.io/projected/37361d5a-8802-4a55-9350-b26b1098ea08-kube-api-access-9skhk\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:57.504308 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.504267    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37361d5a-8802-4a55-9350-b26b1098ea08-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:57.504308 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.504277    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:57.504466 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.504354    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "37361d5a-8802-4a55-9350-b26b1098ea08" (UID: "37361d5a-8802-4a55-9350-b26b1098ea08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:33:57.605189 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:57.605155    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37361d5a-8802-4a55-9350-b26b1098ea08-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:33:58.333804 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:58.333778    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"
Jul 15 21:33:58.333804 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:58.333793    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7" event={"ID":"37361d5a-8802-4a55-9350-b26b1098ea08","Type":"ContainerDied","Data":"f79cbc97d02fc7f92f5cb2aa745efae3c6be660ec6852819a31eb529c1c8bb80"}
Jul 15 21:33:58.334280 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:58.333835    2565 scope.go:117] "RemoveContainer" containerID="ac6ba03602a7c014bc86130b2ff1aa05e9be4f3086af43666c76022a42d921b6"
Jul 15 21:33:58.355144 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:58.355117    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"]
Jul 15 21:33:58.358295 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:58.358272    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/auth-test-model-266bf8-kserve-bfccb8f55-kd7p7"]
Jul 15 21:33:59.142389 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:33:59.142358    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37361d5a-8802-4a55-9350-b26b1098ea08" path="/var/lib/kubelet/pods/37361d5a-8802-4a55-9350-b26b1098ea08/volumes"
Jul 15 21:34:03.686813 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:03.686765    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:34:03.687218 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:03.686826    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:34:03.699700 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:03.699675    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:34:04.377166 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:04.377130    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:34:21.847064 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.847028    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"]
Jul 15 21:34:21.848477 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.847502    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37361d5a-8802-4a55-9350-b26b1098ea08" containerName="main"
Jul 15 21:34:21.848477 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.847520    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="37361d5a-8802-4a55-9350-b26b1098ea08" containerName="main"
Jul 15 21:34:21.848477 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.847558    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968f7efd-8660-475b-8743-61b0dd058042" containerName="main"
Jul 15 21:34:21.848477 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.847566    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="968f7efd-8660-475b-8743-61b0dd058042" containerName="main"
Jul 15 21:34:21.848477 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.847649    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="968f7efd-8660-475b-8743-61b0dd058042" containerName="main"
Jul 15 21:34:21.848477 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.847663    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="37361d5a-8802-4a55-9350-b26b1098ea08" containerName="main"
Jul 15 21:34:21.849369 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.849354    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:21.856260 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.856236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"openshift-service-ca.crt\""
Jul 15 21:34:21.857072 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.857052    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"sub-test-model-266bf8-kserve-self-signed-certs\""
Jul 15 21:34:21.857188 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.857125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"default-dockercfg-mgwpw\""
Jul 15 21:34:21.857244 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.857180    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"kube-root-ca.crt\""
Jul 15 21:34:21.861727 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.861705    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"]
Jul 15 21:34:21.906821 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.906781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-dshm\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:21.906821 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.906821    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-model-cache\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:21.907040 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.906839    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tmp-dir\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:21.907040 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.906896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lptmh\" (UniqueName: \"kubernetes.io/projected/b8d81641-2867-4e15-ac5d-21dc3b6f9336-kube-api-access-lptmh\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:21.907040 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.906978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tls-certs\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:21.907040 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:21.907022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-home\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.007834 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.007795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tls-certs\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.007834 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.007842    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-home\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.008074 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.008035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-dshm\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.008140 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.008080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-model-cache\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.008140 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.008107    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tmp-dir\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.008236 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.008141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lptmh\" (UniqueName: \"kubernetes.io/projected/b8d81641-2867-4e15-ac5d-21dc3b6f9336-kube-api-access-lptmh\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.008291 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.008235    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-home\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.008394 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.008367    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-model-cache\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.008492 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.008470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tmp-dir\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.010167 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.010148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-dshm\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.010332 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.010315    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tls-certs\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.019742 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.019714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lptmh\" (UniqueName: \"kubernetes.io/projected/b8d81641-2867-4e15-ac5d-21dc3b6f9336-kube-api-access-lptmh\") pod \"sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") " pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.165406 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.165301    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:22.371700 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:34:22.371669    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8d81641_2867_4e15_ac5d_21dc3b6f9336.slice/crio-285e4e028c8f27c6d2f3d4b21b59ac9bde5139e37f5e45af3ee775a835003a5a WatchSource:0}: Error finding container 285e4e028c8f27c6d2f3d4b21b59ac9bde5139e37f5e45af3ee775a835003a5a: Status 404 returned error can't find the container with id 285e4e028c8f27c6d2f3d4b21b59ac9bde5139e37f5e45af3ee775a835003a5a
Jul 15 21:34:22.381579 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.381552    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"]
Jul 15 21:34:22.449487 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.449436    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx" event={"ID":"b8d81641-2867-4e15-ac5d-21dc3b6f9336","Type":"ContainerStarted","Data":"ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c"}
Jul 15 21:34:22.449667 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.449499    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx" event={"ID":"b8d81641-2867-4e15-ac5d-21dc3b6f9336","Type":"ContainerStarted","Data":"285e4e028c8f27c6d2f3d4b21b59ac9bde5139e37f5e45af3ee775a835003a5a"}
Jul 15 21:34:22.480095 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:22.480041    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx" podStartSLOduration=1.480023232 podStartE2EDuration="1.480023232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:34:22.478624037 +0000 UTC m=+2795.927975670" watchObservedRunningTime="2026-07-15 21:34:22.480023232 +0000 UTC m=+2795.929374904"
Jul 15 21:34:26.757487 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:26.757455    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:34:32.166288 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:32.166249    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:32.166771 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:32.166309    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:32.178652 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:32.178625    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:34:32.508731 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:34:32.508702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:35:04.340618 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:04.340584    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:35:23.970501 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:23.970454    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:35:29.890407 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:29.890370    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"]
Jul 15 21:35:30.904192 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:30.904157    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"]
Jul 15 21:35:43.046367 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:43.046281    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:35:44.910226 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:44.910162    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f" podUID="b3aae597-b731-4748-b859-8caa2268025c" containerName="main" containerID="cri-o://78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423" gracePeriod=45
Jul 15 21:35:45.160129 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.160104    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:35:45.251704 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.251671    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-tmp-dir\") pod \"b3aae597-b731-4748-b859-8caa2268025c\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") "
Jul 15 21:35:45.251905 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.251727    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-home\") pod \"b3aae597-b731-4748-b859-8caa2268025c\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") "
Jul 15 21:35:45.251905 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.251754    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-model-cache\") pod \"b3aae597-b731-4748-b859-8caa2268025c\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") "
Jul 15 21:35:45.251905 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.251798    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksx4x\" (UniqueName: \"kubernetes.io/projected/b3aae597-b731-4748-b859-8caa2268025c-kube-api-access-ksx4x\") pod \"b3aae597-b731-4748-b859-8caa2268025c\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") "
Jul 15 21:35:45.251905 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.251829    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-dshm\") pod \"b3aae597-b731-4748-b859-8caa2268025c\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") "
Jul 15 21:35:45.251905 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.251864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3aae597-b731-4748-b859-8caa2268025c-tls-certs\") pod \"b3aae597-b731-4748-b859-8caa2268025c\" (UID: \"b3aae597-b731-4748-b859-8caa2268025c\") "
Jul 15 21:35:45.252155 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.252036    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-home" (OuterVolumeSpecName: "home") pod "b3aae597-b731-4748-b859-8caa2268025c" (UID: "b3aae597-b731-4748-b859-8caa2268025c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:35:45.252155 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.252043    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b3aae597-b731-4748-b859-8caa2268025c" (UID: "b3aae597-b731-4748-b859-8caa2268025c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:35:45.252155 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.252069    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-model-cache" (OuterVolumeSpecName: "model-cache") pod "b3aae597-b731-4748-b859-8caa2268025c" (UID: "b3aae597-b731-4748-b859-8caa2268025c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:35:45.252254 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.252186    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:45.252254 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.252205    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:45.252254 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.252219    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:45.254122 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.254089    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-dshm" (OuterVolumeSpecName: "dshm") pod "b3aae597-b731-4748-b859-8caa2268025c" (UID: "b3aae597-b731-4748-b859-8caa2268025c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:35:45.254247 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.254186    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3aae597-b731-4748-b859-8caa2268025c-kube-api-access-ksx4x" (OuterVolumeSpecName: "kube-api-access-ksx4x") pod "b3aae597-b731-4748-b859-8caa2268025c" (UID: "b3aae597-b731-4748-b859-8caa2268025c"). InnerVolumeSpecName "kube-api-access-ksx4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:35:45.254303 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.254283    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3aae597-b731-4748-b859-8caa2268025c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b3aae597-b731-4748-b859-8caa2268025c" (UID: "b3aae597-b731-4748-b859-8caa2268025c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:35:45.358343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.353506    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksx4x\" (UniqueName: \"kubernetes.io/projected/b3aae597-b731-4748-b859-8caa2268025c-kube-api-access-ksx4x\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:45.358343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.353547    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3aae597-b731-4748-b859-8caa2268025c-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:45.358343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.353562    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3aae597-b731-4748-b859-8caa2268025c-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:45.548241 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.548159    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"]
Jul 15 21:35:45.548554 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.548540    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3aae597-b731-4748-b859-8caa2268025c" containerName="main"
Jul 15 21:35:45.548595 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.548555    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3aae597-b731-4748-b859-8caa2268025c" containerName="main"
Jul 15 21:35:45.548636 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.548608    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3aae597-b731-4748-b859-8caa2268025c" containerName="main"
Jul 15 21:35:45.551669 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.551645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.554340 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.554309    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-677131\"/\"rate-test-model-677131-kserve-self-signed-certs\""
Jul 15 21:35:45.554520 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.554499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-model-cache\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.554579 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.554567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p6xx\" (UniqueName: \"kubernetes.io/projected/deba8993-05de-44c3-a746-674b6c417392-kube-api-access-9p6xx\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.554625 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.554612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-tmp-dir\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.554666 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.554649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-dshm\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.554666 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.554663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deba8993-05de-44c3-a746-674b6c417392-tls-certs\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.554756 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.554736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-home\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.562360 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.562336    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"]
Jul 15 21:35:45.655561 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.655521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p6xx\" (UniqueName: \"kubernetes.io/projected/deba8993-05de-44c3-a746-674b6c417392-kube-api-access-9p6xx\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.655561 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.655568    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-tmp-dir\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.655817 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.655599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-dshm\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.655817 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.655616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deba8993-05de-44c3-a746-674b6c417392-tls-certs\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.655817 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.655760    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-home\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.655817 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.655802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-model-cache\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.656072 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.656050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-tmp-dir\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.656131 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.656085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-home\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.656198 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.656179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-model-cache\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.657892 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.657876    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-dshm\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.658170 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.658153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deba8993-05de-44c3-a746-674b6c417392-tls-certs\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.663988 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.663963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p6xx\" (UniqueName: \"kubernetes.io/projected/deba8993-05de-44c3-a746-674b6c417392-kube-api-access-9p6xx\") pod \"rate-test-model-677131-kserve-f88f7b659-p6t6t\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") " pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.826127 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.826037    2565 generic.go:356] "Generic (PLEG): container finished" podID="b3aae597-b731-4748-b859-8caa2268025c" containerID="78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423" exitCode=0
Jul 15 21:35:45.826127 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.826116    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"
Jul 15 21:35:45.826367 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.826131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f" event={"ID":"b3aae597-b731-4748-b859-8caa2268025c","Type":"ContainerDied","Data":"78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423"}
Jul 15 21:35:45.826367 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.826190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f" event={"ID":"b3aae597-b731-4748-b859-8caa2268025c","Type":"ContainerDied","Data":"2ec224dff5900d66cf453df425fdb04212fe8120771aff3a94b282cc2ad34c89"}
Jul 15 21:35:45.826367 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.826214    2565 scope.go:117] "RemoveContainer" containerID="78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423"
Jul 15 21:35:45.836007 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.835991    2565 scope.go:117] "RemoveContainer" containerID="78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423"
Jul 15 21:35:45.836270 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:35:45.836248    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423\": container with ID starting with 78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423 not found: ID does not exist" containerID="78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423"
Jul 15 21:35:45.836313 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.836280    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423"} err="failed to get container status \"78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423\": rpc error: code = NotFound desc = could not find container \"78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423\": container with ID starting with 78ff72fafc62145daa5cfce539618cb57523d11107f62a34b1e255debbd88423 not found: ID does not exist"
Jul 15 21:35:45.850009 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.849980    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"]
Jul 15 21:35:45.857444 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.857405    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-677131/sub-test-model-677131-kserve-6957856d9-stx6f"]
Jul 15 21:35:45.861679 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.861660    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:45.924017 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:45.923814    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx" podUID="b8d81641-2867-4e15-ac5d-21dc3b6f9336" containerName="main" containerID="cri-o://ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c" gracePeriod=45
Jul 15 21:35:46.002342 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.002316    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"]
Jul 15 21:35:46.004680 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:35:46.004649    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddeba8993_05de_44c3_a746_674b6c417392.slice/crio-b308aec61b057c01ffec5868dba54641f9512c9455a28240a40c1302999b5d60 WatchSource:0}: Error finding container b308aec61b057c01ffec5868dba54641f9512c9455a28240a40c1302999b5d60: Status 404 returned error can't find the container with id b308aec61b057c01ffec5868dba54641f9512c9455a28240a40c1302999b5d60
Jul 15 21:35:46.173067 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.173041    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:35:46.258521 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258485    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-home\") pod \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") "
Jul 15 21:35:46.258521 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lptmh\" (UniqueName: \"kubernetes.io/projected/b8d81641-2867-4e15-ac5d-21dc3b6f9336-kube-api-access-lptmh\") pod \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") "
Jul 15 21:35:46.258753 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-model-cache\") pod \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") "
Jul 15 21:35:46.258753 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258642    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-dshm\") pod \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") "
Jul 15 21:35:46.258753 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258692    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tmp-dir\") pod \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") "
Jul 15 21:35:46.258922 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258786    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8d81641-2867-4e15-ac5d-21dc3b6f9336" (UID: "b8d81641-2867-4e15-ac5d-21dc3b6f9336"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:35:46.258922 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258798    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-home" (OuterVolumeSpecName: "home") pod "b8d81641-2867-4e15-ac5d-21dc3b6f9336" (UID: "b8d81641-2867-4e15-ac5d-21dc3b6f9336"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:35:46.259082 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258987    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:46.259082 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258999    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:46.259082 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.258995    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8d81641-2867-4e15-ac5d-21dc3b6f9336" (UID: "b8d81641-2867-4e15-ac5d-21dc3b6f9336"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:35:46.260699 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.260678    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-dshm" (OuterVolumeSpecName: "dshm") pod "b8d81641-2867-4e15-ac5d-21dc3b6f9336" (UID: "b8d81641-2867-4e15-ac5d-21dc3b6f9336"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:35:46.260789 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.260763    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8d81641-2867-4e15-ac5d-21dc3b6f9336-kube-api-access-lptmh" (OuterVolumeSpecName: "kube-api-access-lptmh") pod "b8d81641-2867-4e15-ac5d-21dc3b6f9336" (UID: "b8d81641-2867-4e15-ac5d-21dc3b6f9336"). InnerVolumeSpecName "kube-api-access-lptmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:35:46.360117 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.360020    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tls-certs\") pod \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\" (UID: \"b8d81641-2867-4e15-ac5d-21dc3b6f9336\") "
Jul 15 21:35:46.360297 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.360266    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:46.360297 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.360285    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:46.360392 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.360302    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lptmh\" (UniqueName: \"kubernetes.io/projected/b8d81641-2867-4e15-ac5d-21dc3b6f9336-kube-api-access-lptmh\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:46.362055 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.362033    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8d81641-2867-4e15-ac5d-21dc3b6f9336" (UID: "b8d81641-2867-4e15-ac5d-21dc3b6f9336"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:35:46.461496 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.461454    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8d81641-2867-4e15-ac5d-21dc3b6f9336-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:35:46.832895 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.832857    2565 generic.go:356] "Generic (PLEG): container finished" podID="b8d81641-2867-4e15-ac5d-21dc3b6f9336" containerID="ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c" exitCode=0
Jul 15 21:35:46.833055 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.832908    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"
Jul 15 21:35:46.833055 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.832948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx" event={"ID":"b8d81641-2867-4e15-ac5d-21dc3b6f9336","Type":"ContainerDied","Data":"ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c"}
Jul 15 21:35:46.833055 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.832996    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx" event={"ID":"b8d81641-2867-4e15-ac5d-21dc3b6f9336","Type":"ContainerDied","Data":"285e4e028c8f27c6d2f3d4b21b59ac9bde5139e37f5e45af3ee775a835003a5a"}
Jul 15 21:35:46.833055 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.833019    2565 scope.go:117] "RemoveContainer" containerID="ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c"
Jul 15 21:35:46.834598 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.834563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t" event={"ID":"deba8993-05de-44c3-a746-674b6c417392","Type":"ContainerStarted","Data":"041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a"}
Jul 15 21:35:46.834724 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.834614    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t" event={"ID":"deba8993-05de-44c3-a746-674b6c417392","Type":"ContainerStarted","Data":"b308aec61b057c01ffec5868dba54641f9512c9455a28240a40c1302999b5d60"}
Jul 15 21:35:46.842134 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.842110    2565 scope.go:117] "RemoveContainer" containerID="ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c"
Jul 15 21:35:46.842435 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:35:46.842392    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c\": container with ID starting with ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c not found: ID does not exist" containerID="ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c"
Jul 15 21:35:46.842489 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.842444    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c"} err="failed to get container status \"ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c\": rpc error: code = NotFound desc = could not find container \"ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c\": container with ID starting with ecd42d0d6e8cd23b091b38cde6bc9c1e16d2f46c8db1b92aa6c22690842af73c not found: ID does not exist"
Jul 15 21:35:46.855182 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.855133    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t" podStartSLOduration=1.8551186130000001 podStartE2EDuration="1.855118613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:46.854142998 +0000 UTC m=+2880.303494632" watchObservedRunningTime="2026-07-15 21:35:46.855118613 +0000 UTC m=+2880.304470244"
Jul 15 21:35:46.869155 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.869121    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"]
Jul 15 21:35:46.872795 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:46.872771    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/sub-test-model-266bf8-kserve-6b6f6f4c5-2gfjx"]
Jul 15 21:35:47.143690 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:47.143614    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3aae597-b731-4748-b859-8caa2268025c" path="/var/lib/kubelet/pods/b3aae597-b731-4748-b859-8caa2268025c/volumes"
Jul 15 21:35:47.144016 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:47.144002    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8d81641-2867-4e15-ac5d-21dc3b6f9336" path="/var/lib/kubelet/pods/b8d81641-2867-4e15-ac5d-21dc3b6f9336/volumes"
Jul 15 21:35:55.862185 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:55.862144    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:55.862739 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:55.862207    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:55.875203 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:55.875176    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:55.892614 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:55.892591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:35:58.246823 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:35:58.246784    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:36:06.547204 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.547163    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"]
Jul 15 21:36:06.547814 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.547517    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8d81641-2867-4e15-ac5d-21dc3b6f9336" containerName="main"
Jul 15 21:36:06.547814 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.547530    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8d81641-2867-4e15-ac5d-21dc3b6f9336" containerName="main"
Jul 15 21:36:06.547814 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.547607    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8d81641-2867-4e15-ac5d-21dc3b6f9336" containerName="main"
Jul 15 21:36:06.550714 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.550692    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.554344 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.554318    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"openshift-service-ca.crt\""
Jul 15 21:36:06.554518 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.554318    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"rate-test-model-266bf8-kserve-self-signed-certs\""
Jul 15 21:36:06.554518 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.554320    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"default-dockercfg-mgwpw\""
Jul 15 21:36:06.554518 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.554326    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-266bf8\"/\"kube-root-ca.crt\""
Jul 15 21:36:06.560501 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.560476    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"]
Jul 15 21:36:06.629163 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.629130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cnf4\" (UniqueName: \"kubernetes.io/projected/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-kube-api-access-8cnf4\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.629163 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.629167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-home\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.629388 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.629231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tmp-dir\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.629388 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.629293    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-model-cache\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.629388 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.629362    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-dshm\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.629388 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.629387    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tls-certs\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.729943 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.729899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tls-certs\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.729943 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.729947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cnf4\" (UniqueName: \"kubernetes.io/projected/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-kube-api-access-8cnf4\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.730203 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.729967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-home\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.730203 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.730011    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tmp-dir\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.730203 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.730045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-model-cache\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.730203 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.730132    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-dshm\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.730536 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.730507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tmp-dir\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.730646 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.730507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-model-cache\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.730646 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.730591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-home\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.732331 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.732312    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-dshm\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.732471 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.732454    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tls-certs\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.739859 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.739823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cnf4\" (UniqueName: \"kubernetes.io/projected/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-kube-api-access-8cnf4\") pod \"rate-test-model-266bf8-kserve-79c46b475f-4vmv8\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") " pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:06.861460 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:06.861342    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:07.004443 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:07.004398    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"]
Jul 15 21:36:07.006959 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:36:07.006932    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dc90596_5ccd_44b2_b9b3_a85c5ca59e4d.slice/crio-3d5aa8499455c9c08f77a3eb9dc8a0b8e81610c4a23ba78344344ee9fc6c0864 WatchSource:0}: Error finding container 3d5aa8499455c9c08f77a3eb9dc8a0b8e81610c4a23ba78344344ee9fc6c0864: Status 404 returned error can't find the container with id 3d5aa8499455c9c08f77a3eb9dc8a0b8e81610c4a23ba78344344ee9fc6c0864
Jul 15 21:36:07.938020 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:07.937979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8" event={"ID":"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d","Type":"ContainerStarted","Data":"3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42"}
Jul 15 21:36:07.938020 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:07.938023    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8" event={"ID":"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d","Type":"ContainerStarted","Data":"3d5aa8499455c9c08f77a3eb9dc8a0b8e81610c4a23ba78344344ee9fc6c0864"}
Jul 15 21:36:07.959793 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:07.959739    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8" podStartSLOduration=1.9597227510000002 podStartE2EDuration="1.959722751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:36:07.958235581 +0000 UTC m=+2901.407587213" watchObservedRunningTime="2026-07-15 21:36:07.959722751 +0000 UTC m=+2901.409074383"
Jul 15 21:36:10.442853 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:10.442813    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:36:16.862079 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:16.862033    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:16.862682 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:16.862093    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:16.874802 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:16.874775    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:16.989322 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:16.989293    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:36:35.441759 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:35.441726    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:36:52.444698 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:52.444662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:36:58.513375 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:58.513340    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"]
Jul 15 21:36:59.379285 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:36:59.379251    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"]
Jul 15 21:37:00.382964 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.382929    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7597-140449629408688"]
Jul 15 21:37:00.386165 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.386142    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449629408688"
Jul 15 21:37:00.389948 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.389928    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-prbmz\""
Jul 15 21:37:00.398285 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.398263    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449629408688"]
Jul 15 21:37:00.514781 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.514747    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv6kd\" (UniqueName: \"kubernetes.io/projected/7fbaaaa4-11ce-4721-bf29-1c9102ffac44-kube-api-access-jv6kd\") pod \"test-curl-7597-140449629408688\" (UID: \"7fbaaaa4-11ce-4721-bf29-1c9102ffac44\") " pod="opendatahub/test-curl-7597-140449629408688"
Jul 15 21:37:00.615608 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.615571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv6kd\" (UniqueName: \"kubernetes.io/projected/7fbaaaa4-11ce-4721-bf29-1c9102ffac44-kube-api-access-jv6kd\") pod \"test-curl-7597-140449629408688\" (UID: \"7fbaaaa4-11ce-4721-bf29-1c9102ffac44\") " pod="opendatahub/test-curl-7597-140449629408688"
Jul 15 21:37:00.624321 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.624291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv6kd\" (UniqueName: \"kubernetes.io/projected/7fbaaaa4-11ce-4721-bf29-1c9102ffac44-kube-api-access-jv6kd\") pod \"test-curl-7597-140449629408688\" (UID: \"7fbaaaa4-11ce-4721-bf29-1c9102ffac44\") " pod="opendatahub/test-curl-7597-140449629408688"
Jul 15 21:37:00.695364 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.695273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449629408688"
Jul 15 21:37:00.829443 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.829401    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449629408688"]
Jul 15 21:37:00.832197 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:37:00.832168    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fbaaaa4_11ce_4721_bf29_1c9102ffac44.slice/crio-0abc978acc404478a4d72a5d496536fc064a82f17ae1f236595aac16a1668f9e WatchSource:0}: Error finding container 0abc978acc404478a4d72a5d496536fc064a82f17ae1f236595aac16a1668f9e: Status 404 returned error can't find the container with id 0abc978acc404478a4d72a5d496536fc064a82f17ae1f236595aac16a1668f9e
Jul 15 21:37:00.833511 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:00.833494    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:37:01.187267 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:01.187208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449629408688" event={"ID":"7fbaaaa4-11ce-4721-bf29-1c9102ffac44","Type":"ContainerStarted","Data":"0abc978acc404478a4d72a5d496536fc064a82f17ae1f236595aac16a1668f9e"}
Jul 15 21:37:02.193579 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:02.193542    2565 generic.go:356] "Generic (PLEG): container finished" podID="7fbaaaa4-11ce-4721-bf29-1c9102ffac44" containerID="f1f2d884543f49145cf65cba637a9880a07eb8ca165a2051a45ae5c6ae71a1fe" exitCode=0
Jul 15 21:37:02.194017 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:02.193625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449629408688" event={"ID":"7fbaaaa4-11ce-4721-bf29-1c9102ffac44","Type":"ContainerDied","Data":"f1f2d884543f49145cf65cba637a9880a07eb8ca165a2051a45ae5c6ae71a1fe"}
Jul 15 21:37:03.333571 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.333544    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449629408688"
Jul 15 21:37:03.371035 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.371007    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7597-140449629408688_7fbaaaa4-11ce-4721-bf29-1c9102ffac44/test-curl-7597-140449629408688/0.log"
Jul 15 21:37:03.398616 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.398580    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7597-140449629408688"]
Jul 15 21:37:03.402593 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.402563    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7597-140449629408688"]
Jul 15 21:37:03.439370 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.439345    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv6kd\" (UniqueName: \"kubernetes.io/projected/7fbaaaa4-11ce-4721-bf29-1c9102ffac44-kube-api-access-jv6kd\") pod \"7fbaaaa4-11ce-4721-bf29-1c9102ffac44\" (UID: \"7fbaaaa4-11ce-4721-bf29-1c9102ffac44\") "
Jul 15 21:37:03.441666 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.441641    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fbaaaa4-11ce-4721-bf29-1c9102ffac44-kube-api-access-jv6kd" (OuterVolumeSpecName: "kube-api-access-jv6kd") pod "7fbaaaa4-11ce-4721-bf29-1c9102ffac44" (UID: "7fbaaaa4-11ce-4721-bf29-1c9102ffac44"). InnerVolumeSpecName "kube-api-access-jv6kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:03.535745 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.535712    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7597-140449629407024"]
Jul 15 21:37:03.536046 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.536033    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbaaaa4-11ce-4721-bf29-1c9102ffac44" containerName="test-curl-7597-140449629408688"
Jul 15 21:37:03.536093 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.536047    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbaaaa4-11ce-4721-bf29-1c9102ffac44" containerName="test-curl-7597-140449629408688"
Jul 15 21:37:03.536132 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.536120    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fbaaaa4-11ce-4721-bf29-1c9102ffac44" containerName="test-curl-7597-140449629408688"
Jul 15 21:37:03.539065 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.539049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449629407024"
Jul 15 21:37:03.540842 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.540819    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv6kd\" (UniqueName: \"kubernetes.io/projected/7fbaaaa4-11ce-4721-bf29-1c9102ffac44-kube-api-access-jv6kd\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:03.544577 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.544552    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449629407024"]
Jul 15 21:37:03.641845 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.641803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx7cn\" (UniqueName: \"kubernetes.io/projected/88ef70d2-8110-4587-83af-88dea1c3c6ab-kube-api-access-hx7cn\") pod \"test-curl-7597-140449629407024\" (UID: \"88ef70d2-8110-4587-83af-88dea1c3c6ab\") " pod="opendatahub/test-curl-7597-140449629407024"
Jul 15 21:37:03.743056 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.743016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx7cn\" (UniqueName: \"kubernetes.io/projected/88ef70d2-8110-4587-83af-88dea1c3c6ab-kube-api-access-hx7cn\") pod \"test-curl-7597-140449629407024\" (UID: \"88ef70d2-8110-4587-83af-88dea1c3c6ab\") " pod="opendatahub/test-curl-7597-140449629407024"
Jul 15 21:37:03.754100 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.754066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx7cn\" (UniqueName: \"kubernetes.io/projected/88ef70d2-8110-4587-83af-88dea1c3c6ab-kube-api-access-hx7cn\") pod \"test-curl-7597-140449629407024\" (UID: \"88ef70d2-8110-4587-83af-88dea1c3c6ab\") " pod="opendatahub/test-curl-7597-140449629407024"
Jul 15 21:37:03.849184 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.849086    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449629407024"
Jul 15 21:37:03.981662 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:03.981631    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449629407024"]
Jul 15 21:37:03.984937 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:37:03.984909    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88ef70d2_8110_4587_83af_88dea1c3c6ab.slice/crio-28f821a8d212dcb1214dfaaa73f7c0323da0edfeb1ec9c7c0f58ba240f06cf52 WatchSource:0}: Error finding container 28f821a8d212dcb1214dfaaa73f7c0323da0edfeb1ec9c7c0f58ba240f06cf52: Status 404 returned error can't find the container with id 28f821a8d212dcb1214dfaaa73f7c0323da0edfeb1ec9c7c0f58ba240f06cf52
Jul 15 21:37:04.206672 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:04.206587    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449629408688"
Jul 15 21:37:04.206843 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:04.206587    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0abc978acc404478a4d72a5d496536fc064a82f17ae1f236595aac16a1668f9e"
Jul 15 21:37:04.207935 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:04.207898    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449629407024" event={"ID":"88ef70d2-8110-4587-83af-88dea1c3c6ab","Type":"ContainerStarted","Data":"28f821a8d212dcb1214dfaaa73f7c0323da0edfeb1ec9c7c0f58ba240f06cf52"}
Jul 15 21:37:04.217843 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:37:04.217816    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7597-140449629408688\" is forbidden: User \"system:node:ip-10-0-140-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-96.ec2.internal' and this object" podUID="7fbaaaa4-11ce-4721-bf29-1c9102ffac44" pod="opendatahub/test-curl-7597-140449629408688"
Jul 15 21:37:05.143089 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:05.143057    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fbaaaa4-11ce-4721-bf29-1c9102ffac44" path="/var/lib/kubelet/pods/7fbaaaa4-11ce-4721-bf29-1c9102ffac44/volumes"
Jul 15 21:37:05.213500 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:05.213466    2565 generic.go:356] "Generic (PLEG): container finished" podID="88ef70d2-8110-4587-83af-88dea1c3c6ab" containerID="db7d3409a15029ae8396291a5dfe1842289bd468e89ac787ac98b89831c6d22d" exitCode=0
Jul 15 21:37:05.213714 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:05.213555    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449629407024" event={"ID":"88ef70d2-8110-4587-83af-88dea1c3c6ab","Type":"ContainerDied","Data":"db7d3409a15029ae8396291a5dfe1842289bd468e89ac787ac98b89831c6d22d"}
Jul 15 21:37:06.353072 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.353043    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449629407024"
Jul 15 21:37:06.376158 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.376131    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7597-140449629407024_88ef70d2-8110-4587-83af-88dea1c3c6ab/test-curl-7597-140449629407024/0.log"
Jul 15 21:37:06.402825 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.402794    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7597-140449629407024"]
Jul 15 21:37:06.406602 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.406577    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7597-140449629407024"]
Jul 15 21:37:06.468088 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.468051    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx7cn\" (UniqueName: \"kubernetes.io/projected/88ef70d2-8110-4587-83af-88dea1c3c6ab-kube-api-access-hx7cn\") pod \"88ef70d2-8110-4587-83af-88dea1c3c6ab\" (UID: \"88ef70d2-8110-4587-83af-88dea1c3c6ab\") "
Jul 15 21:37:06.470188 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.470127    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88ef70d2-8110-4587-83af-88dea1c3c6ab-kube-api-access-hx7cn" (OuterVolumeSpecName: "kube-api-access-hx7cn") pod "88ef70d2-8110-4587-83af-88dea1c3c6ab" (UID: "88ef70d2-8110-4587-83af-88dea1c3c6ab"). InnerVolumeSpecName "kube-api-access-hx7cn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:06.569608 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.569574    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx7cn\" (UniqueName: \"kubernetes.io/projected/88ef70d2-8110-4587-83af-88dea1c3c6ab-kube-api-access-hx7cn\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:06.574866 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.574838    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:06.575159 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.575146    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88ef70d2-8110-4587-83af-88dea1c3c6ab" containerName="test-curl-7597-140449629407024"
Jul 15 21:37:06.575202 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.575160    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="88ef70d2-8110-4587-83af-88dea1c3c6ab" containerName="test-curl-7597-140449629407024"
Jul 15 21:37:06.575236 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.575218    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="88ef70d2-8110-4587-83af-88dea1c3c6ab" containerName="test-curl-7597-140449629407024"
Jul 15 21:37:06.578123 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.578100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:06.587168 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.587147    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:06.670383 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.670349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8hnl\" (UniqueName: \"kubernetes.io/projected/424c2642-f17f-4ad0-bae1-3ef4c6dd562a-kube-api-access-l8hnl\") pod \"test-curl-7597-140449630069072\" (UID: \"424c2642-f17f-4ad0-bae1-3ef4c6dd562a\") " pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:06.771848 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.771811    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8hnl\" (UniqueName: \"kubernetes.io/projected/424c2642-f17f-4ad0-bae1-3ef4c6dd562a-kube-api-access-l8hnl\") pod \"test-curl-7597-140449630069072\" (UID: \"424c2642-f17f-4ad0-bae1-3ef4c6dd562a\") " pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:06.781114 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.781089    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8hnl\" (UniqueName: \"kubernetes.io/projected/424c2642-f17f-4ad0-bae1-3ef4c6dd562a-kube-api-access-l8hnl\") pod \"test-curl-7597-140449630069072\" (UID: \"424c2642-f17f-4ad0-bae1-3ef4c6dd562a\") " pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:06.887327 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:06.887283    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:07.017355 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:07.017327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:07.019861 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:37:07.019832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod424c2642_f17f_4ad0_bae1_3ef4c6dd562a.slice/crio-cd80bcdb1d02578e827c85ff063467cef68762960f21c1bcfa4c43ac9bed4d9a WatchSource:0}: Error finding container cd80bcdb1d02578e827c85ff063467cef68762960f21c1bcfa4c43ac9bed4d9a: Status 404 returned error can't find the container with id cd80bcdb1d02578e827c85ff063467cef68762960f21c1bcfa4c43ac9bed4d9a
Jul 15 21:37:07.142809 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:07.142774    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88ef70d2-8110-4587-83af-88dea1c3c6ab" path="/var/lib/kubelet/pods/88ef70d2-8110-4587-83af-88dea1c3c6ab/volumes"
Jul 15 21:37:07.224566 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:07.224535    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449629407024"
Jul 15 21:37:07.224566 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:07.224558    2565 scope.go:117] "RemoveContainer" containerID="db7d3409a15029ae8396291a5dfe1842289bd468e89ac787ac98b89831c6d22d"
Jul 15 21:37:07.225969 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:07.225735    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449630069072" event={"ID":"424c2642-f17f-4ad0-bae1-3ef4c6dd562a","Type":"ContainerStarted","Data":"cd80bcdb1d02578e827c85ff063467cef68762960f21c1bcfa4c43ac9bed4d9a"}
Jul 15 21:37:08.231403 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:08.231325    2565 generic.go:356] "Generic (PLEG): container finished" podID="424c2642-f17f-4ad0-bae1-3ef4c6dd562a" containerID="be38f03c245bd8e44a66e7a08ece1b9cbecd54bdd4bfd05603c5934eddc46834" exitCode=0
Jul 15 21:37:08.231842 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:08.231434    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449630069072" event={"ID":"424c2642-f17f-4ad0-bae1-3ef4c6dd562a","Type":"ContainerDied","Data":"be38f03c245bd8e44a66e7a08ece1b9cbecd54bdd4bfd05603c5934eddc46834"}
Jul 15 21:37:09.368323 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.368299    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:09.391555 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.391521    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7597-140449630069072_424c2642-f17f-4ad0-bae1-3ef4c6dd562a/test-curl-7597-140449630069072/0.log"
Jul 15 21:37:09.418711 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.418671    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:09.420528 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.420502    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:09.495987 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.495887    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8hnl\" (UniqueName: \"kubernetes.io/projected/424c2642-f17f-4ad0-bae1-3ef4c6dd562a-kube-api-access-l8hnl\") pod \"424c2642-f17f-4ad0-bae1-3ef4c6dd562a\" (UID: \"424c2642-f17f-4ad0-bae1-3ef4c6dd562a\") "
Jul 15 21:37:09.497989 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.497963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/424c2642-f17f-4ad0-bae1-3ef4c6dd562a-kube-api-access-l8hnl" (OuterVolumeSpecName: "kube-api-access-l8hnl") pod "424c2642-f17f-4ad0-bae1-3ef4c6dd562a" (UID: "424c2642-f17f-4ad0-bae1-3ef4c6dd562a"). InnerVolumeSpecName "kube-api-access-l8hnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:09.547091 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.547052    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:09.547393 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.547380    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="424c2642-f17f-4ad0-bae1-3ef4c6dd562a" containerName="test-curl-7597-140449630069072"
Jul 15 21:37:09.547478 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.547394    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="424c2642-f17f-4ad0-bae1-3ef4c6dd562a" containerName="test-curl-7597-140449630069072"
Jul 15 21:37:09.547478 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.547469    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="424c2642-f17f-4ad0-bae1-3ef4c6dd562a" containerName="test-curl-7597-140449630069072"
Jul 15 21:37:09.550273 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.550255    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:09.556276 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.556245    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:09.596778 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.596744    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8hnl\" (UniqueName: \"kubernetes.io/projected/424c2642-f17f-4ad0-bae1-3ef4c6dd562a-kube-api-access-l8hnl\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:09.697774 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.697731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2krdz\" (UniqueName: \"kubernetes.io/projected/2be7da11-a649-4cf8-ac5c-55800b677bf0-kube-api-access-2krdz\") pod \"test-curl-7597-140449630069072\" (UID: \"2be7da11-a649-4cf8-ac5c-55800b677bf0\") " pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:09.798263 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.798167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2krdz\" (UniqueName: \"kubernetes.io/projected/2be7da11-a649-4cf8-ac5c-55800b677bf0-kube-api-access-2krdz\") pod \"test-curl-7597-140449630069072\" (UID: \"2be7da11-a649-4cf8-ac5c-55800b677bf0\") " pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:09.807085 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.807059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2krdz\" (UniqueName: \"kubernetes.io/projected/2be7da11-a649-4cf8-ac5c-55800b677bf0-kube-api-access-2krdz\") pod \"test-curl-7597-140449630069072\" (UID: \"2be7da11-a649-4cf8-ac5c-55800b677bf0\") " pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:09.860143 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.860109    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:09.993238 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:09.993215    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:09.995690 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:37:09.995665    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2be7da11_a649_4cf8_ac5c_55800b677bf0.slice/crio-4b0c295591205886bc43a79b06e4a7b7f9c65ccd3263ce35c45e8f74911cc585 WatchSource:0}: Error finding container 4b0c295591205886bc43a79b06e4a7b7f9c65ccd3263ce35c45e8f74911cc585: Status 404 returned error can't find the container with id 4b0c295591205886bc43a79b06e4a7b7f9c65ccd3263ce35c45e8f74911cc585
Jul 15 21:37:10.243822 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:10.243792    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449630069072" event={"ID":"2be7da11-a649-4cf8-ac5c-55800b677bf0","Type":"ContainerStarted","Data":"4b0c295591205886bc43a79b06e4a7b7f9c65ccd3263ce35c45e8f74911cc585"}
Jul 15 21:37:10.245014 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:10.244991    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:10.245014 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:10.245007    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd80bcdb1d02578e827c85ff063467cef68762960f21c1bcfa4c43ac9bed4d9a"
Jul 15 21:37:10.255815 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:10.255771    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7597-140449630069072" oldPodUID="424c2642-f17f-4ad0-bae1-3ef4c6dd562a" podUID="2be7da11-a649-4cf8-ac5c-55800b677bf0"
Jul 15 21:37:11.142317 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:11.142288    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="424c2642-f17f-4ad0-bae1-3ef4c6dd562a" path="/var/lib/kubelet/pods/424c2642-f17f-4ad0-bae1-3ef4c6dd562a/volumes"
Jul 15 21:37:11.250574 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:11.250544    2565 generic.go:356] "Generic (PLEG): container finished" podID="2be7da11-a649-4cf8-ac5c-55800b677bf0" containerID="cbbd53cfbaaa9d0e795c5da00c6b2aa094ff1931c782f5fa124a4da231b083b4" exitCode=0
Jul 15 21:37:11.250757 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:11.250591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449630069072" event={"ID":"2be7da11-a649-4cf8-ac5c-55800b677bf0","Type":"ContainerDied","Data":"cbbd53cfbaaa9d0e795c5da00c6b2aa094ff1931c782f5fa124a4da231b083b4"}
Jul 15 21:37:12.403195 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.403166    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:12.426238 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.426206    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7597-140449630069072_2be7da11-a649-4cf8-ac5c-55800b677bf0/test-curl-7597-140449630069072/0.log"
Jul 15 21:37:12.450923 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.450894    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:12.457058 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.457030    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7597-140449630069072"]
Jul 15 21:37:12.521708 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.521612    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2krdz\" (UniqueName: \"kubernetes.io/projected/2be7da11-a649-4cf8-ac5c-55800b677bf0-kube-api-access-2krdz\") pod \"2be7da11-a649-4cf8-ac5c-55800b677bf0\" (UID: \"2be7da11-a649-4cf8-ac5c-55800b677bf0\") "
Jul 15 21:37:12.523681 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.523657    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2be7da11-a649-4cf8-ac5c-55800b677bf0-kube-api-access-2krdz" (OuterVolumeSpecName: "kube-api-access-2krdz") pod "2be7da11-a649-4cf8-ac5c-55800b677bf0" (UID: "2be7da11-a649-4cf8-ac5c-55800b677bf0"). InnerVolumeSpecName "kube-api-access-2krdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:12.586542 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.586508    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:12.586886 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.586873    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2be7da11-a649-4cf8-ac5c-55800b677bf0" containerName="test-curl-7597-140449630069072"
Jul 15 21:37:12.586930 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.586888    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2be7da11-a649-4cf8-ac5c-55800b677bf0" containerName="test-curl-7597-140449630069072"
Jul 15 21:37:12.586962 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.586941    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2be7da11-a649-4cf8-ac5c-55800b677bf0" containerName="test-curl-7597-140449630069072"
Jul 15 21:37:12.589768 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.589752    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:12.595066 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.595039    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:12.622819 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.622792    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2krdz\" (UniqueName: \"kubernetes.io/projected/2be7da11-a649-4cf8-ac5c-55800b677bf0-kube-api-access-2krdz\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:12.724005 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.723965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfll\" (UniqueName: \"kubernetes.io/projected/db13366b-24e3-414c-a0cb-fca6f8c6da1b-kube-api-access-ggfll\") pod \"test-curl-7597-140449630070080\" (UID: \"db13366b-24e3-414c-a0cb-fca6f8c6da1b\") " pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:12.824963 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.824870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfll\" (UniqueName: \"kubernetes.io/projected/db13366b-24e3-414c-a0cb-fca6f8c6da1b-kube-api-access-ggfll\") pod \"test-curl-7597-140449630070080\" (UID: \"db13366b-24e3-414c-a0cb-fca6f8c6da1b\") " pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:12.833107 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.833011    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfll\" (UniqueName: \"kubernetes.io/projected/db13366b-24e3-414c-a0cb-fca6f8c6da1b-kube-api-access-ggfll\") pod \"test-curl-7597-140449630070080\" (UID: \"db13366b-24e3-414c-a0cb-fca6f8c6da1b\") " pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:12.835157 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.835136    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:37:12.899904 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:12.899866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:13.028230 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.028202    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:13.030639 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:37:13.030611    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb13366b_24e3_414c_a0cb_fca6f8c6da1b.slice/crio-6b14c7badd444f077a9a96d5da4fc31d40786c5384eb4cfe07d99d52fdf60826 WatchSource:0}: Error finding container 6b14c7badd444f077a9a96d5da4fc31d40786c5384eb4cfe07d99d52fdf60826: Status 404 returned error can't find the container with id 6b14c7badd444f077a9a96d5da4fc31d40786c5384eb4cfe07d99d52fdf60826
Jul 15 21:37:13.142392 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.142304    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2be7da11-a649-4cf8-ac5c-55800b677bf0" path="/var/lib/kubelet/pods/2be7da11-a649-4cf8-ac5c-55800b677bf0/volumes"
Jul 15 21:37:13.260637 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.260606    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630069072"
Jul 15 21:37:13.260805 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.260646    2565 scope.go:117] "RemoveContainer" containerID="cbbd53cfbaaa9d0e795c5da00c6b2aa094ff1931c782f5fa124a4da231b083b4"
Jul 15 21:37:13.262067 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.261799    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449630070080" event={"ID":"db13366b-24e3-414c-a0cb-fca6f8c6da1b","Type":"ContainerStarted","Data":"6b14c7badd444f077a9a96d5da4fc31d40786c5384eb4cfe07d99d52fdf60826"}
Jul 15 21:37:13.533043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.533001    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t" podUID="deba8993-05de-44c3-a746-674b6c417392" containerName="main" containerID="cri-o://041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a" gracePeriod=45
Jul 15 21:37:13.784973 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.784944    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:37:13.933082 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933044    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-model-cache\") pod \"deba8993-05de-44c3-a746-674b6c417392\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") "
Jul 15 21:37:13.933249 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933119    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-tmp-dir\") pod \"deba8993-05de-44c3-a746-674b6c417392\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") "
Jul 15 21:37:13.933249 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933145    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p6xx\" (UniqueName: \"kubernetes.io/projected/deba8993-05de-44c3-a746-674b6c417392-kube-api-access-9p6xx\") pod \"deba8993-05de-44c3-a746-674b6c417392\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") "
Jul 15 21:37:13.933249 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-home\") pod \"deba8993-05de-44c3-a746-674b6c417392\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") "
Jul 15 21:37:13.933249 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933232    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-dshm\") pod \"deba8993-05de-44c3-a746-674b6c417392\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") "
Jul 15 21:37:13.933249 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933247    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deba8993-05de-44c3-a746-674b6c417392-tls-certs\") pod \"deba8993-05de-44c3-a746-674b6c417392\" (UID: \"deba8993-05de-44c3-a746-674b6c417392\") "
Jul 15 21:37:13.933566 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933397    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-model-cache" (OuterVolumeSpecName: "model-cache") pod "deba8993-05de-44c3-a746-674b6c417392" (UID: "deba8993-05de-44c3-a746-674b6c417392"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:13.933566 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933404    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "deba8993-05de-44c3-a746-674b6c417392" (UID: "deba8993-05de-44c3-a746-674b6c417392"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:13.933566 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.933554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-home" (OuterVolumeSpecName: "home") pod "deba8993-05de-44c3-a746-674b6c417392" (UID: "deba8993-05de-44c3-a746-674b6c417392"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:13.935393 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.935361    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-dshm" (OuterVolumeSpecName: "dshm") pod "deba8993-05de-44c3-a746-674b6c417392" (UID: "deba8993-05de-44c3-a746-674b6c417392"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:13.935515 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.935399    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deba8993-05de-44c3-a746-674b6c417392-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "deba8993-05de-44c3-a746-674b6c417392" (UID: "deba8993-05de-44c3-a746-674b6c417392"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:37:13.935515 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:13.935446    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deba8993-05de-44c3-a746-674b6c417392-kube-api-access-9p6xx" (OuterVolumeSpecName: "kube-api-access-9p6xx") pod "deba8993-05de-44c3-a746-674b6c417392" (UID: "deba8993-05de-44c3-a746-674b6c417392"). InnerVolumeSpecName "kube-api-access-9p6xx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:14.034085 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.034047    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.034085 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.034076    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.034085 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.034085    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p6xx\" (UniqueName: \"kubernetes.io/projected/deba8993-05de-44c3-a746-674b6c417392-kube-api-access-9p6xx\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.034085 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.034096    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.034361 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.034105    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deba8993-05de-44c3-a746-674b6c417392-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.034361 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.034113    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deba8993-05de-44c3-a746-674b6c417392-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.268925 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.268888    2565 generic.go:356] "Generic (PLEG): container finished" podID="db13366b-24e3-414c-a0cb-fca6f8c6da1b" containerID="f96bb9ca80edb202fb225c38942b2ef061a0543b86052c038dd2badbbb01ecd5" exitCode=0
Jul 15 21:37:14.269101 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.268976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449630070080" event={"ID":"db13366b-24e3-414c-a0cb-fca6f8c6da1b","Type":"ContainerDied","Data":"f96bb9ca80edb202fb225c38942b2ef061a0543b86052c038dd2badbbb01ecd5"}
Jul 15 21:37:14.270163 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.270139    2565 generic.go:356] "Generic (PLEG): container finished" podID="deba8993-05de-44c3-a746-674b6c417392" containerID="041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a" exitCode=0
Jul 15 21:37:14.270212 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.270178    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"
Jul 15 21:37:14.270251 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.270225    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t" event={"ID":"deba8993-05de-44c3-a746-674b6c417392","Type":"ContainerDied","Data":"041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a"}
Jul 15 21:37:14.270303 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.270266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t" event={"ID":"deba8993-05de-44c3-a746-674b6c417392","Type":"ContainerDied","Data":"b308aec61b057c01ffec5868dba54641f9512c9455a28240a40c1302999b5d60"}
Jul 15 21:37:14.270303 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.270287    2565 scope.go:117] "RemoveContainer" containerID="041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a"
Jul 15 21:37:14.278681 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.278656    2565 scope.go:117] "RemoveContainer" containerID="041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a"
Jul 15 21:37:14.278945 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:37:14.278925    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a\": container with ID starting with 041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a not found: ID does not exist" containerID="041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a"
Jul 15 21:37:14.278994 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.278953    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a"} err="failed to get container status \"041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a\": rpc error: code = NotFound desc = could not find container \"041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a\": container with ID starting with 041037e1ecb113648cc7a946ae9dc235fb213f133bca94c0150b2d6ac933187a not found: ID does not exist"
Jul 15 21:37:14.296943 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.296860    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"]
Jul 15 21:37:14.303185 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.303160    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-677131/rate-test-model-677131-kserve-f88f7b659-p6t6t"]
Jul 15 21:37:14.399440 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.399385    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8" podUID="9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" containerName="main" containerID="cri-o://3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42" gracePeriod=45
Jul 15 21:37:14.653921 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.653894    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:37:14.739230 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739192    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-model-cache\") pod \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") "
Jul 15 21:37:14.739382 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739243    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cnf4\" (UniqueName: \"kubernetes.io/projected/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-kube-api-access-8cnf4\") pod \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") "
Jul 15 21:37:14.739382 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-home\") pod \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") "
Jul 15 21:37:14.739382 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tls-certs\") pod \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") "
Jul 15 21:37:14.739382 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739356    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-dshm\") pod \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") "
Jul 15 21:37:14.739613 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tmp-dir\") pod \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\" (UID: \"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d\") "
Jul 15 21:37:14.739613 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739576    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-home" (OuterVolumeSpecName: "home") pod "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" (UID: "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:14.739613 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739589    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-model-cache" (OuterVolumeSpecName: "model-cache") pod "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" (UID: "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:14.739770 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739737    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" (UID: "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:14.739770 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739757    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-model-cache\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.739840 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.739772    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-home\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.741451 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.741406    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-dshm" (OuterVolumeSpecName: "dshm") pod "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" (UID: "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:37:14.741558 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.741493    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-kube-api-access-8cnf4" (OuterVolumeSpecName: "kube-api-access-8cnf4") pod "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" (UID: "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d"). InnerVolumeSpecName "kube-api-access-8cnf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:14.741558 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.741497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" (UID: "9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:37:14.840218 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.840121    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cnf4\" (UniqueName: \"kubernetes.io/projected/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-kube-api-access-8cnf4\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.840218 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.840151    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tls-certs\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.840218 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.840166    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-dshm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:14.840218 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:14.840178    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d-tmp-dir\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:15.143244 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.143157    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deba8993-05de-44c3-a746-674b6c417392" path="/var/lib/kubelet/pods/deba8993-05de-44c3-a746-674b6c417392/volumes"
Jul 15 21:37:15.278879 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.278845    2565 generic.go:356] "Generic (PLEG): container finished" podID="9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" containerID="3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42" exitCode=0
Jul 15 21:37:15.279028 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.278894    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"
Jul 15 21:37:15.279028 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.278929    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8" event={"ID":"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d","Type":"ContainerDied","Data":"3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42"}
Jul 15 21:37:15.279028 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.278971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8" event={"ID":"9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d","Type":"ContainerDied","Data":"3d5aa8499455c9c08f77a3eb9dc8a0b8e81610c4a23ba78344344ee9fc6c0864"}
Jul 15 21:37:15.279028 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.278989    2565 scope.go:117] "RemoveContainer" containerID="3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42"
Jul 15 21:37:15.288596 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.288577    2565 scope.go:117] "RemoveContainer" containerID="3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42"
Jul 15 21:37:15.288941 ip-10-0-140-96 kubenswrapper[2565]: E0715 21:37:15.288921    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42\": container with ID starting with 3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42 not found: ID does not exist" containerID="3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42"
Jul 15 21:37:15.288997 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.288949    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42"} err="failed to get container status \"3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42\": rpc error: code = NotFound desc = could not find container \"3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42\": container with ID starting with 3b410639463a69ce071a147c1fe01125c0dc425e023041af0f987f4ca98e1d42 not found: ID does not exist"
Jul 15 21:37:15.296996 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.296959    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"]
Jul 15 21:37:15.302146 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.302110    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-266bf8/rate-test-model-266bf8-kserve-79c46b475f-4vmv8"]
Jul 15 21:37:15.423265 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.423235    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:15.447090 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.447057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7597-140449630070080_db13366b-24e3-414c-a0cb-fca6f8c6da1b/test-curl-7597-140449630070080/0.log"
Jul 15 21:37:15.474456 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.474408    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:15.478396 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.478370    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:15.547509 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.547474    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggfll\" (UniqueName: \"kubernetes.io/projected/db13366b-24e3-414c-a0cb-fca6f8c6da1b-kube-api-access-ggfll\") pod \"db13366b-24e3-414c-a0cb-fca6f8c6da1b\" (UID: \"db13366b-24e3-414c-a0cb-fca6f8c6da1b\") "
Jul 15 21:37:15.549577 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.549549    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db13366b-24e3-414c-a0cb-fca6f8c6da1b-kube-api-access-ggfll" (OuterVolumeSpecName: "kube-api-access-ggfll") pod "db13366b-24e3-414c-a0cb-fca6f8c6da1b" (UID: "db13366b-24e3-414c-a0cb-fca6f8c6da1b"). InnerVolumeSpecName "kube-api-access-ggfll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:15.606205 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606171    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:15.606529 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606516    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deba8993-05de-44c3-a746-674b6c417392" containerName="main"
Jul 15 21:37:15.606568 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606531    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="deba8993-05de-44c3-a746-674b6c417392" containerName="main"
Jul 15 21:37:15.606568 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606547    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db13366b-24e3-414c-a0cb-fca6f8c6da1b" containerName="test-curl-7597-140449630070080"
Jul 15 21:37:15.606568 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606554    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="db13366b-24e3-414c-a0cb-fca6f8c6da1b" containerName="test-curl-7597-140449630070080"
Jul 15 21:37:15.606568 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606569    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" containerName="main"
Jul 15 21:37:15.606703 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606574    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" containerName="main"
Jul 15 21:37:15.606703 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606621    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="deba8993-05de-44c3-a746-674b6c417392" containerName="main"
Jul 15 21:37:15.606703 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606630    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" containerName="main"
Jul 15 21:37:15.606703 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.606637    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="db13366b-24e3-414c-a0cb-fca6f8c6da1b" containerName="test-curl-7597-140449630070080"
Jul 15 21:37:15.609461 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.609443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:15.617203 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.617180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:15.648850 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.648806    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggfll\" (UniqueName: \"kubernetes.io/projected/db13366b-24e3-414c-a0cb-fca6f8c6da1b-kube-api-access-ggfll\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:15.749262 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.749224    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4xrm\" (UniqueName: \"kubernetes.io/projected/39675a49-9f42-4e22-91d8-ae5b86a91704-kube-api-access-d4xrm\") pod \"test-curl-7597-140449630070080\" (UID: \"39675a49-9f42-4e22-91d8-ae5b86a91704\") " pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:15.850383 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.850339    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4xrm\" (UniqueName: \"kubernetes.io/projected/39675a49-9f42-4e22-91d8-ae5b86a91704-kube-api-access-d4xrm\") pod \"test-curl-7597-140449630070080\" (UID: \"39675a49-9f42-4e22-91d8-ae5b86a91704\") " pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:15.859688 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.859664    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4xrm\" (UniqueName: \"kubernetes.io/projected/39675a49-9f42-4e22-91d8-ae5b86a91704-kube-api-access-d4xrm\") pod \"test-curl-7597-140449630070080\" (UID: \"39675a49-9f42-4e22-91d8-ae5b86a91704\") " pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:15.919252 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:15.919214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:16.055876 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:16.055849    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:16.058389 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:37:16.058362    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39675a49_9f42_4e22_91d8_ae5b86a91704.slice/crio-72d45a2950868e7a7ba79b990cfa4ef4c74ce916e8373d687a62eb21d9d6de1a WatchSource:0}: Error finding container 72d45a2950868e7a7ba79b990cfa4ef4c74ce916e8373d687a62eb21d9d6de1a: Status 404 returned error can't find the container with id 72d45a2950868e7a7ba79b990cfa4ef4c74ce916e8373d687a62eb21d9d6de1a
Jul 15 21:37:16.285771 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:16.285686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449630070080" event={"ID":"39675a49-9f42-4e22-91d8-ae5b86a91704","Type":"ContainerStarted","Data":"72d45a2950868e7a7ba79b990cfa4ef4c74ce916e8373d687a62eb21d9d6de1a"}
Jul 15 21:37:16.286921 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:16.286898    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:16.286921 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:16.286912    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b14c7badd444f077a9a96d5da4fc31d40786c5384eb4cfe07d99d52fdf60826"
Jul 15 21:37:16.298294 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:16.298264    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7597-140449630070080" oldPodUID="db13366b-24e3-414c-a0cb-fca6f8c6da1b" podUID="39675a49-9f42-4e22-91d8-ae5b86a91704"
Jul 15 21:37:17.143438 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:17.143397    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d" path="/var/lib/kubelet/pods/9dc90596-5ccd-44b2-b9b3-a85c5ca59e4d/volumes"
Jul 15 21:37:17.143816 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:17.143738    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db13366b-24e3-414c-a0cb-fca6f8c6da1b" path="/var/lib/kubelet/pods/db13366b-24e3-414c-a0cb-fca6f8c6da1b/volumes"
Jul 15 21:37:17.294692 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:17.294662    2565 generic.go:356] "Generic (PLEG): container finished" podID="39675a49-9f42-4e22-91d8-ae5b86a91704" containerID="39647a2b245219fd5103e55eace3412659d9b75ce297cc8ceb921b89be991b98" exitCode=0
Jul 15 21:37:17.294867 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:17.294725    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7597-140449630070080" event={"ID":"39675a49-9f42-4e22-91d8-ae5b86a91704","Type":"ContainerDied","Data":"39647a2b245219fd5103e55eace3412659d9b75ce297cc8ceb921b89be991b98"}
Jul 15 21:37:18.430622 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.430594    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:18.452576 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.452534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7597-140449630070080_39675a49-9f42-4e22-91d8-ae5b86a91704/test-curl-7597-140449630070080/0.log"
Jul 15 21:37:18.477841 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.477808    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:18.481263 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.481237    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7597-140449630070080"]
Jul 15 21:37:18.576931 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.576834    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4xrm\" (UniqueName: \"kubernetes.io/projected/39675a49-9f42-4e22-91d8-ae5b86a91704-kube-api-access-d4xrm\") pod \"39675a49-9f42-4e22-91d8-ae5b86a91704\" (UID: \"39675a49-9f42-4e22-91d8-ae5b86a91704\") "
Jul 15 21:37:18.578978 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.578952    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39675a49-9f42-4e22-91d8-ae5b86a91704-kube-api-access-d4xrm" (OuterVolumeSpecName: "kube-api-access-d4xrm") pod "39675a49-9f42-4e22-91d8-ae5b86a91704" (UID: "39675a49-9f42-4e22-91d8-ae5b86a91704"). InnerVolumeSpecName "kube-api-access-d4xrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:37:18.673243 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.673205    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"]
Jul 15 21:37:18.673581 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.673566    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39675a49-9f42-4e22-91d8-ae5b86a91704" containerName="test-curl-7597-140449630070080"
Jul 15 21:37:18.673630 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.673582    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="39675a49-9f42-4e22-91d8-ae5b86a91704" containerName="test-curl-7597-140449630070080"
Jul 15 21:37:18.673674 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.673637    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="39675a49-9f42-4e22-91d8-ae5b86a91704" containerName="test-curl-7597-140449630070080"
Jul 15 21:37:18.676734 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.676710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"
Jul 15 21:37:18.677473 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.677453    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4xrm\" (UniqueName: \"kubernetes.io/projected/39675a49-9f42-4e22-91d8-ae5b86a91704-kube-api-access-d4xrm\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:18.679040 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.679019    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:37:18.679141 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.679087    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zsrf5\""
Jul 15 21:37:18.685311 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.685288    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"]
Jul 15 21:37:18.778059 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.778024    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56db8e4d-aa2e-4af2-a2cb-1187747fa6d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-677131-j4pc7\" (UID: \"56db8e4d-aa2e-4af2-a2cb-1187747fa6d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"
Jul 15 21:37:18.879043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.878944    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56db8e4d-aa2e-4af2-a2cb-1187747fa6d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-677131-j4pc7\" (UID: \"56db8e4d-aa2e-4af2-a2cb-1187747fa6d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"
Jul 15 21:37:18.879635 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.879615    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56db8e4d-aa2e-4af2-a2cb-1187747fa6d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-677131-j4pc7\" (UID: \"56db8e4d-aa2e-4af2-a2cb-1187747fa6d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"
Jul 15 21:37:18.988586 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:18.988550    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"
Jul 15 21:37:19.123645 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:19.123571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"]
Jul 15 21:37:19.126182 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:37:19.126155    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56db8e4d_aa2e_4af2_a2cb_1187747fa6d0.slice/crio-08a301cb975efbc9dd146bd4130a96b8e6bb1dc8cb3c0d5a33d971184445bc75 WatchSource:0}: Error finding container 08a301cb975efbc9dd146bd4130a96b8e6bb1dc8cb3c0d5a33d971184445bc75: Status 404 returned error can't find the container with id 08a301cb975efbc9dd146bd4130a96b8e6bb1dc8cb3c0d5a33d971184445bc75
Jul 15 21:37:19.143628 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:19.143593    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39675a49-9f42-4e22-91d8-ae5b86a91704" path="/var/lib/kubelet/pods/39675a49-9f42-4e22-91d8-ae5b86a91704/volumes"
Jul 15 21:37:19.305587 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:19.305547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7" event={"ID":"56db8e4d-aa2e-4af2-a2cb-1187747fa6d0","Type":"ContainerStarted","Data":"08a301cb975efbc9dd146bd4130a96b8e6bb1dc8cb3c0d5a33d971184445bc75"}
Jul 15 21:37:19.306682 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:19.306663    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7597-140449630070080"
Jul 15 21:37:19.306767 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:19.306699    2565 scope.go:117] "RemoveContainer" containerID="39647a2b245219fd5103e55eace3412659d9b75ce297cc8ceb921b89be991b98"
Jul 15 21:37:20.314032 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:20.313995    2565 generic.go:356] "Generic (PLEG): container finished" podID="56db8e4d-aa2e-4af2-a2cb-1187747fa6d0" containerID="064ae33e58fb2870ced4b1869c9f30ff8c8417c37dff8a56529f717debd33290" exitCode=0
Jul 15 21:37:20.314484 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:20.314077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7" event={"ID":"56db8e4d-aa2e-4af2-a2cb-1187747fa6d0","Type":"ContainerDied","Data":"064ae33e58fb2870ced4b1869c9f30ff8c8417c37dff8a56529f717debd33290"}
Jul 15 21:37:21.454908 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:21.454878    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"
Jul 15 21:37:21.501538 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:21.501496    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56db8e4d-aa2e-4af2-a2cb-1187747fa6d0-maas-api-service-ca\") pod \"56db8e4d-aa2e-4af2-a2cb-1187747fa6d0\" (UID: \"56db8e4d-aa2e-4af2-a2cb-1187747fa6d0\") "
Jul 15 21:37:21.501868 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:21.501843    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56db8e4d-aa2e-4af2-a2cb-1187747fa6d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "56db8e4d-aa2e-4af2-a2cb-1187747fa6d0" (UID: "56db8e4d-aa2e-4af2-a2cb-1187747fa6d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:37:21.602986 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:21.602900    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/56db8e4d-aa2e-4af2-a2cb-1187747fa6d0-maas-api-service-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:22.326076 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:22.326045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7" event={"ID":"56db8e4d-aa2e-4af2-a2cb-1187747fa6d0","Type":"ContainerDied","Data":"08a301cb975efbc9dd146bd4130a96b8e6bb1dc8cb3c0d5a33d971184445bc75"}
Jul 15 21:37:22.326076 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:22.326076    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-677131-j4pc7"
Jul 15 21:37:22.326384 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:22.326092    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08a301cb975efbc9dd146bd4130a96b8e6bb1dc8cb3c0d5a33d971184445bc75"
Jul 15 21:37:32.841035 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:32.840998    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:37:44.871762 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:44.871723    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"]
Jul 15 21:37:44.872172 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:44.872062    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56db8e4d-aa2e-4af2-a2cb-1187747fa6d0" containerName="revoke-keys"
Jul 15 21:37:44.872172 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:44.872074    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="56db8e4d-aa2e-4af2-a2cb-1187747fa6d0" containerName="revoke-keys"
Jul 15 21:37:44.872172 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:44.872140    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="56db8e4d-aa2e-4af2-a2cb-1187747fa6d0" containerName="revoke-keys"
Jul 15 21:37:44.877070 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:44.877050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"
Jul 15 21:37:44.879785 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:44.879759    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zsrf5\""
Jul 15 21:37:44.879944 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:44.879805    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:37:44.883303 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:44.883280    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"]
Jul 15 21:37:45.000279 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:45.000235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d60043db-412e-492f-aee5-8cbc7f71a50c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-266bf8-99llm\" (UID: \"d60043db-412e-492f-aee5-8cbc7f71a50c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"
Jul 15 21:37:45.101615 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:45.101574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d60043db-412e-492f-aee5-8cbc7f71a50c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-266bf8-99llm\" (UID: \"d60043db-412e-492f-aee5-8cbc7f71a50c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"
Jul 15 21:37:45.102210 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:45.102190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d60043db-412e-492f-aee5-8cbc7f71a50c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-266bf8-99llm\" (UID: \"d60043db-412e-492f-aee5-8cbc7f71a50c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"
Jul 15 21:37:45.189190 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:45.189099    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"
Jul 15 21:37:45.324550 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:45.324522    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"]
Jul 15 21:37:45.326684 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:37:45.326650    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60043db_412e_492f_aee5_8cbc7f71a50c.slice/crio-fa57610f1a8ae460ffce434b5bdf543adf0de15c8153ac5c4f14a7b2e3db16d7 WatchSource:0}: Error finding container fa57610f1a8ae460ffce434b5bdf543adf0de15c8153ac5c4f14a7b2e3db16d7: Status 404 returned error can't find the container with id fa57610f1a8ae460ffce434b5bdf543adf0de15c8153ac5c4f14a7b2e3db16d7
Jul 15 21:37:45.437775 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:45.437741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm" event={"ID":"d60043db-412e-492f-aee5-8cbc7f71a50c","Type":"ContainerStarted","Data":"fa57610f1a8ae460ffce434b5bdf543adf0de15c8153ac5c4f14a7b2e3db16d7"}
Jul 15 21:37:46.443843 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:46.443748    2565 generic.go:356] "Generic (PLEG): container finished" podID="d60043db-412e-492f-aee5-8cbc7f71a50c" containerID="7ad229c5d1af4a6e43836994681ee715ff7865695bba9afd1faa672e69e5315f" exitCode=0
Jul 15 21:37:46.444231 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:46.443835    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm" event={"ID":"d60043db-412e-492f-aee5-8cbc7f71a50c","Type":"ContainerDied","Data":"7ad229c5d1af4a6e43836994681ee715ff7865695bba9afd1faa672e69e5315f"}
Jul 15 21:37:47.219713 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:47.219684    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:37:47.227584 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:47.227554    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rdlc8_6079b6dd-e5a8-4daa-a68b-db2d9bcd5f6c/ovn-acl-logging/0.log"
Jul 15 21:37:47.583710 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:47.583683    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"
Jul 15 21:37:47.723699 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:47.723664    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d60043db-412e-492f-aee5-8cbc7f71a50c-maas-api-service-ca\") pod \"d60043db-412e-492f-aee5-8cbc7f71a50c\" (UID: \"d60043db-412e-492f-aee5-8cbc7f71a50c\") "
Jul 15 21:37:47.724018 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:47.723995    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d60043db-412e-492f-aee5-8cbc7f71a50c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d60043db-412e-492f-aee5-8cbc7f71a50c" (UID: "d60043db-412e-492f-aee5-8cbc7f71a50c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:37:47.824314 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:47.824214    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d60043db-412e-492f-aee5-8cbc7f71a50c-maas-api-service-ca\") on node \"ip-10-0-140-96.ec2.internal\" DevicePath \"\""
Jul 15 21:37:48.456626 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:48.456600    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm"
Jul 15 21:37:48.456626 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:48.456618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-266bf8-99llm" event={"ID":"d60043db-412e-492f-aee5-8cbc7f71a50c","Type":"ContainerDied","Data":"fa57610f1a8ae460ffce434b5bdf543adf0de15c8153ac5c4f14a7b2e3db16d7"}
Jul 15 21:37:48.456945 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:48.456661    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa57610f1a8ae460ffce434b5bdf543adf0de15c8153ac5c4f14a7b2e3db16d7"
Jul 15 21:37:58.942192 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:37:58.942157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-td5md"]
Jul 15 21:38:11.375572 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:11.375537    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f94f94478-56s24_a792295e-8d6d-4648-9871-61493181ff4f/authorino/0.log"
Jul 15 21:38:17.776989 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:17.776961    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b849856cb-sf5nk_2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48/copy-manifests/0.log"
Jul 15 21:38:17.785356 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:17.785333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b849856cb-sf5nk_2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48/manager/0.log"
Jul 15 21:38:18.549117 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:18.549087    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735850-rw6xh_e5b2623d-c6c5-4ed0-a23a-cec82d32c8cb/cleanup/0.log"
Jul 15 21:38:19.846343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:19.846314    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-677131-j4pc7_56db8e4d-aa2e-4af2-a2cb-1187747fa6d0/revoke-keys/0.log"
Jul 15 21:38:19.961395 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:19.961366    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-266bf8-99llm_d60043db-412e-492f-aee5-8cbc7f71a50c/revoke-keys/0.log"
Jul 15 21:38:21.393172 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:21.393135    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f94f94478-56s24_a792295e-8d6d-4648-9871-61493181ff4f/authorino/0.log"
Jul 15 21:38:21.742765 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:21.742736    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ssr8j_4d98ea0e-a97d-47c0-89df-9af0fcce7be6/kuadrant-console-plugin/0.log"
Jul 15 21:38:22.099491 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:22.099387    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-td5md_e309234c-4a8c-4ec3-9378-55c56ef80c07/limitador/0.log"
Jul 15 21:38:22.850084 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:22.850056    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-796df4448b-fswmf_b5837dd3-d3b3-4e10-a207-b7b33b41d79e/kube-auth-proxy/0.log"
Jul 15 21:38:24.339525 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:24.339493    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wmmbs_79cac8ab-f692-4383-a0e6-4c1c44a14695/main/0.log"
Jul 15 21:38:29.810749 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.810716    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jhrn6/must-gather-kqtnn"]
Jul 15 21:38:29.811248 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.811045    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d60043db-412e-492f-aee5-8cbc7f71a50c" containerName="revoke-keys"
Jul 15 21:38:29.811248 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.811057    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d60043db-412e-492f-aee5-8cbc7f71a50c" containerName="revoke-keys"
Jul 15 21:38:29.811248 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.811122    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d60043db-412e-492f-aee5-8cbc7f71a50c" containerName="revoke-keys"
Jul 15 21:38:29.814239 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.814220    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhrn6/must-gather-kqtnn"
Jul 15 21:38:29.816831 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.816802    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jhrn6\"/\"openshift-service-ca.crt\""
Jul 15 21:38:29.817533 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.817515    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jhrn6\"/\"kube-root-ca.crt\""
Jul 15 21:38:29.817629 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.817538    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jhrn6\"/\"default-dockercfg-h4vxg\""
Jul 15 21:38:29.823230 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.823207    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhrn6/must-gather-kqtnn"]
Jul 15 21:38:29.877674 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.877637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsc77\" (UniqueName: \"kubernetes.io/projected/d3103376-0ca4-4c95-bd29-a4635b41b650-kube-api-access-dsc77\") pod \"must-gather-kqtnn\" (UID: \"d3103376-0ca4-4c95-bd29-a4635b41b650\") " pod="openshift-must-gather-jhrn6/must-gather-kqtnn"
Jul 15 21:38:29.877844 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.877684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3103376-0ca4-4c95-bd29-a4635b41b650-must-gather-output\") pod \"must-gather-kqtnn\" (UID: \"d3103376-0ca4-4c95-bd29-a4635b41b650\") " pod="openshift-must-gather-jhrn6/must-gather-kqtnn"
Jul 15 21:38:29.978648 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.978616    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsc77\" (UniqueName: \"kubernetes.io/projected/d3103376-0ca4-4c95-bd29-a4635b41b650-kube-api-access-dsc77\") pod \"must-gather-kqtnn\" (UID: \"d3103376-0ca4-4c95-bd29-a4635b41b650\") " pod="openshift-must-gather-jhrn6/must-gather-kqtnn"
Jul 15 21:38:29.978827 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.978660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3103376-0ca4-4c95-bd29-a4635b41b650-must-gather-output\") pod \"must-gather-kqtnn\" (UID: \"d3103376-0ca4-4c95-bd29-a4635b41b650\") " pod="openshift-must-gather-jhrn6/must-gather-kqtnn"
Jul 15 21:38:29.978989 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.978974    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d3103376-0ca4-4c95-bd29-a4635b41b650-must-gather-output\") pod \"must-gather-kqtnn\" (UID: \"d3103376-0ca4-4c95-bd29-a4635b41b650\") " pod="openshift-must-gather-jhrn6/must-gather-kqtnn"
Jul 15 21:38:29.986815 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:29.986788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsc77\" (UniqueName: \"kubernetes.io/projected/d3103376-0ca4-4c95-bd29-a4635b41b650-kube-api-access-dsc77\") pod \"must-gather-kqtnn\" (UID: \"d3103376-0ca4-4c95-bd29-a4635b41b650\") " pod="openshift-must-gather-jhrn6/must-gather-kqtnn"
Jul 15 21:38:30.124609 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:30.124525    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhrn6/must-gather-kqtnn"
Jul 15 21:38:30.256542 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:30.256323    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhrn6/must-gather-kqtnn"]
Jul 15 21:38:30.259306 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:38:30.259280    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3103376_0ca4_4c95_bd29_a4635b41b650.slice/crio-1637bf10df08a4d52dd1460c0d588af727068e2af1607b664d50b97c647b8e7f WatchSource:0}: Error finding container 1637bf10df08a4d52dd1460c0d588af727068e2af1607b664d50b97c647b8e7f: Status 404 returned error can't find the container with id 1637bf10df08a4d52dd1460c0d588af727068e2af1607b664d50b97c647b8e7f
Jul 15 21:38:30.646638 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:30.646605    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhrn6/must-gather-kqtnn" event={"ID":"d3103376-0ca4-4c95-bd29-a4635b41b650","Type":"ContainerStarted","Data":"1637bf10df08a4d52dd1460c0d588af727068e2af1607b664d50b97c647b8e7f"}
Jul 15 21:38:31.654134 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:31.654098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhrn6/must-gather-kqtnn" event={"ID":"d3103376-0ca4-4c95-bd29-a4635b41b650","Type":"ContainerStarted","Data":"c7de90be5e49fae3a7f36383c8abd59b2d4c72a90146f5f2bf1f82cf7d799cb1"}
Jul 15 21:38:31.654538 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:31.654144    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhrn6/must-gather-kqtnn" event={"ID":"d3103376-0ca4-4c95-bd29-a4635b41b650","Type":"ContainerStarted","Data":"4edb1e21f1c79b8f812332432a3e375d86d42eb20c5bfb679aa8a528945f7b62"}
Jul 15 21:38:31.672494 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:31.672431    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jhrn6/must-gather-kqtnn" podStartSLOduration=1.7632836699999999 podStartE2EDuration="2.67239227s" totalImagesPullingTime="909.1086ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:31.670622224 +0000 UTC m=+3045.119973856" watchObservedRunningTime="2026-07-15 21:38:31.67239227 +0000 UTC m=+3045.121743903"
Jul 15 21:38:32.880325 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:32.880257    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sc9np_6409d118-ba7a-46a7-8198-968fd28b9954/global-pull-secret-syncer/0.log"
Jul 15 21:38:33.094864 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:33.094809    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nf4gs_47a3070e-0bd9-4581-adc0-a6872fc9b4a4/konnectivity-agent/0.log"
Jul 15 21:38:33.176668 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:33.176581    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-96.ec2.internal_a91adefed4c6e2e0477c8cea8cc9bc10/haproxy/0.log"
Jul 15 21:38:38.537798 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:38.537654    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f94f94478-56s24_a792295e-8d6d-4648-9871-61493181ff4f/authorino/0.log"
Jul 15 21:38:38.640949 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:38.640911    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ssr8j_4d98ea0e-a97d-47c0-89df-9af0fcce7be6/kuadrant-console-plugin/0.log"
Jul 15 21:38:38.851192 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:38.851100    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-td5md_e309234c-4a8c-4ec3-9378-55c56ef80c07/limitador/0.log"
Jul 15 21:38:40.670314 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:40.670280    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f51db3a-58d0-4727-b841-2b8f381bb4c5/alertmanager/0.log"
Jul 15 21:38:40.705664 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:40.705631    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f51db3a-58d0-4727-b841-2b8f381bb4c5/config-reloader/0.log"
Jul 15 21:38:40.746304 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:40.746070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f51db3a-58d0-4727-b841-2b8f381bb4c5/kube-rbac-proxy-web/0.log"
Jul 15 21:38:40.800098 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:40.800073    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f51db3a-58d0-4727-b841-2b8f381bb4c5/kube-rbac-proxy/0.log"
Jul 15 21:38:40.847614 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:40.847584    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f51db3a-58d0-4727-b841-2b8f381bb4c5/kube-rbac-proxy-metric/0.log"
Jul 15 21:38:40.904136 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:40.904110    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f51db3a-58d0-4727-b841-2b8f381bb4c5/prom-label-proxy/0.log"
Jul 15 21:38:40.958896 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:40.958812    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9f51db3a-58d0-4727-b841-2b8f381bb4c5/init-config-reloader/0.log"
Jul 15 21:38:41.092089 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:41.092047    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-qkvww_1b8b716f-ec48-48b6-80d3-f4430da2cb59/kube-state-metrics/0.log"
Jul 15 21:38:41.141882 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:41.141852    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-qkvww_1b8b716f-ec48-48b6-80d3-f4430da2cb59/kube-rbac-proxy-main/0.log"
Jul 15 21:38:41.215920 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:41.215828    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-qkvww_1b8b716f-ec48-48b6-80d3-f4430da2cb59/kube-rbac-proxy-self/0.log"
Jul 15 21:38:41.329669 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:41.329629    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-wcmp6_12c651a3-757d-4479-b0db-c6b300011890/monitoring-plugin/0.log"
Jul 15 21:38:41.379960 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:41.379918    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-75mz8_30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8/node-exporter/0.log"
Jul 15 21:38:41.412153 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:41.412124    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-75mz8_30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8/kube-rbac-proxy/0.log"
Jul 15 21:38:41.438956 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:41.438924    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-75mz8_30c987f7-8e3c-4bb1-b3c6-910f41f1f2e8/init-textfile/0.log"
Jul 15 21:38:41.979989 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:41.979955    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-x6v5w_2f3f1700-05f3-4624-98e8-ccb027cf426a/prometheus-operator/0.log"
Jul 15 21:38:42.007109 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.007078    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-x6v5w_2f3f1700-05f3-4624-98e8-ccb027cf426a/kube-rbac-proxy/0.log"
Jul 15 21:38:42.084078 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.084052    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f89c9cf78-lmjbk_c3ddcd80-570f-4088-bbd4-2e3e43ce28e8/telemeter-client/0.log"
Jul 15 21:38:42.112619 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.112581    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f89c9cf78-lmjbk_c3ddcd80-570f-4088-bbd4-2e3e43ce28e8/reload/0.log"
Jul 15 21:38:42.136332 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.136301    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6f89c9cf78-lmjbk_c3ddcd80-570f-4088-bbd4-2e3e43ce28e8/kube-rbac-proxy/0.log"
Jul 15 21:38:42.785301 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.785272    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"]
Jul 15 21:38:42.792028 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.792002    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:42.803976 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.803934    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"]
Jul 15 21:38:42.910113 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.910076    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-podres\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:42.910343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.910154    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-proc\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:42.910343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.910183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-lib-modules\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:42.910343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.910209    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfxrr\" (UniqueName: \"kubernetes.io/projected/6f36f097-0584-4f97-8975-866f82d986a4-kube-api-access-rfxrr\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:42.910343 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:42.910264    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-sys\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.011627 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-podres\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.012043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-proc\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.012043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-lib-modules\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.012043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011681    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfxrr\" (UniqueName: \"kubernetes.io/projected/6f36f097-0584-4f97-8975-866f82d986a4-kube-api-access-rfxrr\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.012043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-sys\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.012043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011777    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-podres\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.012043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-lib-modules\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.012043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-proc\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.012043 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.011801    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f36f097-0584-4f97-8975-866f82d986a4-sys\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.020916 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.020883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfxrr\" (UniqueName: \"kubernetes.io/projected/6f36f097-0584-4f97-8975-866f82d986a4-kube-api-access-rfxrr\") pod \"perf-node-gather-daemonset-fd8k5\" (UID: \"6f36f097-0584-4f97-8975-866f82d986a4\") " pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.109954 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.109859    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.313181 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.313150    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"]
Jul 15 21:38:43.315283 ip-10-0-140-96 kubenswrapper[2565]: W0715 21:38:43.315235    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f36f097_0584_4f97_8975_866f82d986a4.slice/crio-94beaa5603c1330407352036e7dc29220d7a5458955d8bb9428db5cd5aa864c5 WatchSource:0}: Error finding container 94beaa5603c1330407352036e7dc29220d7a5458955d8bb9428db5cd5aa864c5: Status 404 returned error can't find the container with id 94beaa5603c1330407352036e7dc29220d7a5458955d8bb9428db5cd5aa864c5
Jul 15 21:38:43.737601 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.737565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5" event={"ID":"6f36f097-0584-4f97-8975-866f82d986a4","Type":"ContainerStarted","Data":"db5852d4b3704e0658facfd17f4079c7b275ae6e68cb37c113c11ef7492ff060"}
Jul 15 21:38:43.737786 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.737712    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:43.737786 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.737744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5" event={"ID":"6f36f097-0584-4f97-8975-866f82d986a4","Type":"ContainerStarted","Data":"94beaa5603c1330407352036e7dc29220d7a5458955d8bb9428db5cd5aa864c5"}
Jul 15 21:38:43.754880 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:43.754822    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5" podStartSLOduration=1.754805761 podStartE2EDuration="1.754805761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:38:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:43.753694624 +0000 UTC m=+3057.203046255" watchObservedRunningTime="2026-07-15 21:38:43.754805761 +0000 UTC m=+3057.204157393"
Jul 15 21:38:44.631937 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:44.631907    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-284pl_99dfb8a1-4876-41c2-bb4e-7d2d64c32e5a/download-server/0.log"
Jul 15 21:38:46.501688 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:46.501652    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s9n7s_4d9e685f-1743-444a-9224-f619d79ba4a6/dns/0.log"
Jul 15 21:38:46.526817 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:46.526785    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-s9n7s_4d9e685f-1743-444a-9224-f619d79ba4a6/kube-rbac-proxy/0.log"
Jul 15 21:38:46.580410 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:46.580386    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cv2qk_afaee93c-636f-450c-83ea-2c3cb136e163/dns-node-resolver/0.log"
Jul 15 21:38:47.206995 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:47.206958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7cfffc4cdb-k24hj_5d6e35fc-b81f-45c8-95a4-1d5f6fe41ac4/registry/0.log"
Jul 15 21:38:47.232451 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:47.232403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-97qm5_adf4b109-9939-43ae-9915-f9567149710c/node-ca/0.log"
Jul 15 21:38:48.451461 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:48.451399    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-796df4448b-fswmf_b5837dd3-d3b3-4e10-a207-b7b33b41d79e/kube-auth-proxy/0.log"
Jul 15 21:38:49.421642 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:49.421609    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ttn6s_e878706d-dbf6-460e-8b31-2da090515430/serve-healthcheck-canary/0.log"
Jul 15 21:38:49.758051 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:49.758014    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jhrn6/perf-node-gather-daemonset-fd8k5"
Jul 15 21:38:50.169824 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:50.169742    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shmgt_5c4f7773-c922-48a6-85b7-88c5d91afd19/kube-rbac-proxy/0.log"
Jul 15 21:38:50.194821 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:50.194789    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shmgt_5c4f7773-c922-48a6-85b7-88c5d91afd19/exporter/0.log"
Jul 15 21:38:50.221327 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:50.221294    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-shmgt_5c4f7773-c922-48a6-85b7-88c5d91afd19/extractor/0.log"
Jul 15 21:38:53.374539 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:53.374504    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b849856cb-sf5nk_2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48/manager/0.log"
Jul 15 21:38:53.395366 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:53.395338    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b849856cb-sf5nk_2e1f864d-8060-4ee1-8ce5-cf6b4e63bb48/copy-manifests/0.log"
Jul 15 21:38:53.993450 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:53.993396    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-796df4448b-fswmf_b5837dd3-d3b3-4e10-a207-b7b33b41d79e/kube-auth-proxy/0.log"
Jul 15 21:38:54.712878 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:54.712776    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6bd6785cdc-kv829_c7bd4116-4875-47ca-b11a-84173bb76c71/manager/0.log"
Jul 15 21:38:55.513792 ip-10-0-140-96 kubenswrapper[2565]: I0715 21:38:55.513759    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-796df4448b-fswmf_b5837dd3-d3b3-4e10-a207-b7b33b41d79e/kube-auth-proxy/0.log"